Avision Labs

Product catalog and search site for Avision scanners and printers.

Tech Stack

Layer	Tools
Frontend	React + Vite + TypeScript, Tailwind CSS, Headless UI, Heroicons, React Router
Backend	Express, Drizzle ORM, PostgreSQL (Neon)
Scraper	Cheerio, native fetch, Resend (email reports)
Automation	GitHub Actions

Project Structure

client/   React frontend
server/   Express API + scraper
  src/
    index.ts          API server
    scrape.ts         Avision.com product scraper
    scrape.test.ts    Scraper unit tests (change-detection logic)
    emailService.ts   Post-scrape HTML email reports via Resend
    db/
      schema.ts       Drizzle table definitions
      index.ts        DB client (Neon serverless)

Setup

Prerequisites

• Node.js 20+
• A Neon Postgres database

Environment

Create server/.env:

DATABASE_URL=postgres://...

# Optional — enables post-scrape email reports via Resend
RESEND_API_KEY=re_...
REPORT_EMAIL=you@example.com

Create client/.env:

VITE_ADMIN_PASSWORD=examplepassword123

Install & run

# Install all dependencies
npm install
cd client && npm intall
cd server && npm install

# Push schema to database
cd server && npm run db:push

# Start backend server (port 3000)
cd server && npm run dev

# Start frontend (port 5173)
cd client && npm run dev

# Start Both
cd main folder && npm run dev

Database Schema

avision_products

Column	Type	Notes
id	serial	Primary key
model	text	Product model name
description	text	Short product description
category	text	Scanner type (e.g. DocumentScanner) or Printer / MFP
series	text	Product series slug
url	text	Canonical product URL (unique)
image_url	text	Main product image
features	jsonb	Array of { title, description }
specs	jsonb	Object of "Section / Key": "value" pairs
downloads	jsonb	Drivers, manuals, brochures, quick guides, photos
in_stock	boolean	Whether the product is currently listed as in stock
on_website	boolean	Whether the product should appear on the site (default true)
scraped_at	timestamp	When the product page was last scraped
created_at	timestamp	Row creation time
updated_at	timestamp	Last update time

Category values

Value	Meaning
DocumentScanner	Document scanner
Flatbed Scanner	Flatbed scanner
Network Scanner	Network scanner
Mobile Scanner	Mobile / portable scanner
PaperAir Series	PaperAir compact scanner
Printer	Printer (model name does not start with AM)
MFP	Multifunction printer (model name starts with AM)

Scraper

Crawls all product pages on avision.com and stores structured data in the avision_products table. Extracts features, specs, drivers, manuals, brochures, quick guides, and product photos.

Printer/MFP products are automatically classified: models whose name starts with AM are stored as MFP, all others as Printer.

After each run, a summary email is sent via Resend listing inserted, updated, unchanged, and failed products — if RESEND_API_KEY and REPORT_EMAIL are set.

cd server && npm run scrape

Runs automatically every Sunday at 3 AM UTC via GitHub Actions. Can also be triggered manually from the Actions tab.

API Endpoints

Method	Path	Description
GET	/api/products	All products (supports ?category= ?subcategory=)
GET	/api/products/:model	Single product by model
GET	/api/products/:model/specs	Specs for a product
GET	/api/products/:model/features	Features for a product
GET	/api/products/:model/downloads	Downloads (drivers, manuals, etc.) for a product
GET	/api/categories	All categories
GET	/api/subcategories	All subcategories (supports ?category=)
GET	/api/avision/search?q=	Full-text search across scraped products