- Backend: FastAPI app with all models, services, schemas, routes - Admin Panel: Next.js dashboard with all modules (CRM, POS, repairs, warranties, billing, notifications, etc.) - Ecommerce: storefront (submodule) + product catalog - AI Agents: .agents/ skill library for Antigravity IDE - Docs: architecture, billing, notification gateway markdown - Submodules: Backend/OpenWA, Ecommerce/File 2/storefront
1.3 KiB
1.3 KiB
Product Catalog Architecture (50M Scale)
Data Model & Hierarchy
The catalog supports up to 50,000,000 SKUs utilizing 26-character ULID primary keys.
erDiagram
Category ||--o{ Product : contains
Brand ||--o{ Product : manufactures
DeviceSeries ||--o{ Product : applies_to
DeviceModel ||--o{ Product : applies_to
Product ||--|{ ProductVariant : has
ProductVariant ||--|{ VariantAttribute : defines
AttributeType ||--|{ VariantAttribute : types
High-Scale Pagination Strategy
For scaling beyond 100,000 items, standard SQL OFFSET pagination (e.g. LIMIT 50 OFFSET 100000) becomes prohibitively slow (O(N) scan).
Keyset / Cursor-Based Pagination
All catalog API endpoints enforce Keyset Cursor Pagination using created_at and product_id:
SELECT product_id, name, price, created_at
FROM products
WHERE (created_at, product_id) < (:last_created_at, :last_product_id)
ORDER BY created_at DESC, product_id DESC
LIMIT 50;
Outbox Catalog Indexing Pipeline
When products or variants are updated in MySQL:
- An event is written to
outbox_events(aggregate_type='PRODUCT',aggregate_id=product_id,aggregate_version=v42). - Celery Worker picks up the event, reads
SearchService, and updates OpenSearch asynchronously.