Behind all Google services lies a fascinating variety of storage systems with an equally fascinating variety of different goals: low latency, high consistency, high reliability, and wide distribution, to name but a few. In this session, we will discuss two of these storage systems with wildly different goals and that present unique challenges.
Spanner is Google's scalable, multi-version, globally-distributed, and synchronously-replicated database. It is the first system to distribute data at global scale and also support externally-consistent distributed transactions. A novel integration with GPS and atomic clocks lets it offer lock-free read-only transactions over all data. The team received the Jay Lepreau Best Paper Award at OSDI 2012.
Google's Archival Storage systems present very different challenges to those addressed by Spanner. They must defend against hardware failure, software failure, and catastrophic large-scale cluster failure. Data in these Archival Storage systems is held at rest, primarily on tape, and is offline for long periods of time. It needs to be kept reliable for many years, yet it must be thrown away at a moment's notice. It must be easy to access, yet safe. In this part of the session, we will discuss some of the issues presented by such a system at planet scale.
Alex Lloyd is a Senior Staff Software Engineer in the Storage Infrastructure group at Google. In this role, he led the replication implementations for Megastore and Spanner, global storage systems that underpin a wide array of Google services. He is currently working on distributing multiversion concurrency control algorithms. Prior to his current role, Alex worked with the Blogger team. Before joining Google in 2004, Alex built mobile sync middleware at BEA Systems. As an undergraduate, his dorm room startup led him to his first job at Object Design, where he worked on visual templating tools. Alex has a bachelors degree in computer science from Harvard University.
Ian Whalley is a Senior Software Engineer in the Archival Storage team at Google NYC, where he works on current and future generations of Google's archival storage systems. Prior to Google, he worked at IBM Research for twelve years on a variety of projects from virtual machine and clustered application management technologies to anti-virus automation. Before that he designed and implemented detection engines for a UK-based anti-virus company.
The agenda for this event is:
5:30 - 6:30 pm: Attendees Register / Networking
6:30 - 6:35 pm: Welcome & Intro
6:35 - 7:35 pm: Presentation
7:35 - 8:00 pm: Q/A
Please note the venue entrance is on the 8th Avenue side of the building. If you mistakenly go to the 9th avenue entrance, building security will ask you to walk around the building (on the outside!) to the 8th Avenue side. The A,C,E trains stop on the 8th Avenue side of the building.
The RSVP name will be provided to the building security in advance - so please do register with your real name (first/last) as this will significantly speed up registration.
Google volunteers will also be present at the event to answer any questions you may have, look for people who are wearing "Google Wear".
See you there!