System Design
Design an E-commerce Recommendation Event Pipeline
Asked by:Amazon
cachingconsistencyevent_drivenmessagingstreaming
Problem Overview & Requirements
Design a high-throughput asynchronous pipeline that turns commerce actions into fresh item-to-item recommendation signals.
Key Pillars: High Availability, Low Latency, Scalability, Fault Tolerance.
Topics & Components: caching, consistency, event_driven, messaging, streaming.
System Design Breakdown
1. Requirements & Scope
Functional & non-functional requirements, DAU/MAU estimates, read/write throughput.
2. High Level Architecture
API Gateway, Load Balancers, Application Microservices, Caching Layer & Message Queue.
3. Data Model & Storage
SQL vs NoSQL selection, schema design, sharding keys, indexing, and replication strategy.
4. Bottlenecks & Trade-offs
CAP theorem trade-offs, consistency models, rate limiting, and cache invalidation strategies.