Silicon Valley Code Camp : October 11th and 12th 2014
I have been in the software industry for 20+ years. In the past 4 years I have worked on cloud based distributed systems for Netflix and Stubhub. Most of these systems have been associated with data delivery and management. Some of the systems I have with with are: Solr, Cassandra, Zookeeper, Hadoop and StubHubs Big Data Platform. All these systems require a different approach in design,development and access patterns. However, there are underlying patterns in each of these systems. And these patterns radically change the approach of developers and users of these systems. Without them, building and deploying distributed systems, especially at scale, becomes exceedingly problematic. I wish to share some of these design and deployment patterns as well as their programming models with the folks at SVCC.
Cloud based, highly scalable systems provide significant value to business and the software community. However, these systems are not a panacea and there is a paradigm shift when building highly scalable systems, cloud based systems. Though the technical inflection may appear to be slight, building and deploying these systems affects everything - from system architectures, design principles, programming models all the way through to software deployment and maintenance.
This talk goes into some of the common design patterns and practices that can be used to develop and deploy distributed system. Examples of design and access patterns include: Zookeeper, Solr, Cassandra, HBase and the architecture of StubHubs Big Data platform.