fbpx

Leveraging Spark in a Hybrid OLTP/OLAP RDBMS Meetup

January 12, 2016
OLTP/OLAP RDBMS Meetup

Join Splice Machine’s very own Co-Founder and CTO, John Leach, on Thursday, January 21 for a Meetup in San Francisco.

We will discuss how Splice Machine uses Spark as part of a hybrid RDBMS architecture that includes Hadoop and HBase. Other topics of discussion will include how the optimizer evaluates each query and sends OLTP traffic (including CRUD queries) to HBase and OLAP traffic to Spark. This HUG Meetup will focus on the challenges of handling the tradeoffs inherent in an integrated architecture that simultaneously handles real-time and batch traffic.

Lessons to be learned (which can also be applies to other hybrid systems, such as Lambda architectures) include:

  • Embedding Spark into a RDBMS
  • Running Spark on Yarn and isolating OLTP traffic from OLAP traffic – Accelerating the generation of Spark RDDs from HBase
  • Customizing the Spark UI

To learn more and reserve your spot for the Meetup on January 21 at 6:30 PM PDT, please click here.

About John Leach

John Leach is the CTO and Co-Founder of Splice Machine. With over 15 years of software experience under his belt, John’s expertise in analytics and BI drives his role as Chief Technology Officer. Prior to Splice Machine, John founded Incite Retail in June 2008 and led the company’s strategy and development efforts. At Incite Retail, he built custom Big Data systems (leveraging HBase and Hadoop) for Fortune 500 companies. Prior to Incite Retail, he ran the business intelligence practice at Blue Martini Software and built strategic partnerships with integration partners. John was a key subject matter expert for Blue Martini Software in many strategic implementations across the world. His focus at Blue Martini was helping clients incorporate decision support knowledge into their current business processes utilizing advanced algorithms and machine learning. John received dual bachelor’s degrees in biomedical and mechanical engineering from Washington University in Saint Louis. Leach currently is the organizer for the Saint Louis Hadoop Users Group and is active in the Washington University Elliot Society.