Managing Data in Microservices


This session is about the hard stuff – managing data in microservices – and about sharing proven patterns that have been successful at Google, eBay, and Stitch Fix. It begins with a quick tour of some prerequisites for being successful with microservices – an organization of small teams with well-defined areas of responsibility; processes for test-driven development and continuous delivery; and a DevOps culture of “You Build It, You Run It.”

The majority of the session is spent on managing data. It covers the need to isolate a microservice’s data store behind the service interface, as well as the various persistence mechanisms for managing data. It discusses using events as a first-class tool in our architectural toolbox. It covers techniques for service extraction from a monolithic database. Then it composes those building blocks to build up patterns for handling shared data, joins, and transactions in a microservice world.

It concludes with lessons learned, as well as suggestions for how you can implement these ideas successfully in your own organization.

Speaker

randy-shoup

Randy Shoup

 

Randy is a 25-year veteran of Silicon Valley, and has worked as a senior technology leader and executive at companies ranging from small startups, to mid-sized places, to eBay and Google. Randy is currently VP Engineering at Stitch Fix in San Francisco.

Earlier, Randy was Chief Engineer at eBay for 6 12 years, where he was responsible for multiple generations of eBay’s realtime search infrastructure. He was CTO and co-founder of a startup, and learned just how difficult and different it is to build a company from scratch. He was Director of Engineering at Google for Google App Engine, building and operating the world’s largest platform-as-a-service. He also spent a year and a half applying eBay and Google lessons consulting with startups and large enterprises on how to improve their organizations and technology.

Randy has been speaking about scalability, architecture, and engineering culture since 2006. He is a co-organizer of the QCon family of conferences, and is particularly passionate about the nexus of culture, technology, and organization.