- Load Balancer
Distributes incoming traffic across multiple servers to ensure no single server gets overwhelmed.
- Caching
Stores frequently accessed data in memory to reduce latency.
- Content Delivery Network (CDN)
Stores static assets across globally distributed edge locations or servers so users download the content from the nearest location
- Message Queue
Decouples components by letting producers enqueue messages that consumers process asynchronously.
- Publish-Subscribe
Enables multiple consumers to receive messages from a topic
- API Gateway
Acts as a single entry point for client requests, handling routing, authentication, rate limiting and protocol translation
- Circuit Breaker
Prevents a system from repeatedly calling a failing service by temporarily stopping requests until the service recovers.
- Service Discovery
Automatically tracks available service instances, enabling components to discover and communicate with each other dynamically.
- Sharding
Sharding splits large datasets across multiple nodes using a shard key to improve scalability and performance.
- Rate Limiting
Rate limiting controls how many requests a client can make within a time window to prevent service overload.
- Consistent Hashing
Consistent hashing is a data distribution technique that minimizes data movement when nodes join or leave the system.
- Auto Scaling
Auto scaling automatically adds or removes compute resources based on demand or predefined metrics.