System Design
Design Merchant Product Catalog Ingestion
Asked by:Pinterest
data_modelingstreamingevent_drivenconsistencystorage
Problem Overview & Requirements
Design a multi-tenant catalog pipeline for point and bulk product updates that converge into serving-ready merchant catalogs.
Key Pillars: High Availability, Low Latency, Scalability, Fault Tolerance.
Topics & Components: data_modeling, streaming, event_driven, consistency, storage.
System Design Breakdown
1. Requirements & Scope
Functional & non-functional requirements, DAU/MAU estimates, read/write throughput.
2. High Level Architecture
API Gateway, Load Balancers, Application Microservices, Caching Layer & Message Queue.
3. Data Model & Storage
SQL vs NoSQL selection, schema design, sharding keys, indexing, and replication strategy.
4. Bottlenecks & Trade-offs
CAP theorem trade-offs, consistency models, rate limiting, and cache invalidation strategies.