<Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems> The main reason for wanting to partition data is scalability. For very large datasets, or very high throughput, that is not sufficient: we need to break the data up into partitions, also known as sharding. What we call a partition here is called…