Saturday, April 11, 2009

Background Google BigTable: building blocks

Building blocks:
- Google File System(GFS): raw storage
- Scheduler: schedules jobs onto machines
- Lock service: distributed lock manager, also can reliable hold tiny files (100s of bytes) w/ high availability
- MapReduce: simplified large-scale data processing

BigTable uses of building blocks:
- GFS: stores persistent state
- Scheduler: schedules jobs involved in BigTable serving
- Lock service: master election, location bootstrapping
- MapReduce: often used to read/write BigTable data

Read more Datastore в Google App Engine, Bigtable, Google TechTalk: "BigTable", М.Подколзин, В.Репешко

0 comments:

Post a Comment