This event has ended. Create your own event on Sched.
Back To Schedule
Thursday, June 15 • 3:10pm - 3:40pm
Rethinking RDBMS Data Migration: Modernizing Traditional ETL Processes to Cloud-Native Event Driven Microservices [I] - Anupama Pradhan, Health Care Service Corporation & Jeff Cherng, Pivotal

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Extract, transform, load (ETL) has always been complex and expensive for moving massive data sets from one data source to another. This is especially true if the source system is a traditional RDBMS with complicated relationships between tables. Most of the time, traditional ETL processes are implemented with batch, monolithic, and tightly coupled approaches. As the result, traditional ETL processes are often considered fragile, hard to maintain, not easy to tune, and often introduce high data latency between source and destination systems. In this session, Anupama Pradhan and Jeff Cherng will cover how to modernize traditional RDBMS ETL processes to cloud-native event driven microservices pipelines by using Cloud Foundry, Spring Cloud Stream, and RabbitMQ/Kafka. The pipelines can handle high volume data sets and complex database queries, yet with low data latency between the source RDBMS and destination data store. In addition, the design is highly tunable and scalable. The session will also cover analysis of performance metrics based on implementations of real world use cases.


Jeff Cherng

Pivotal Software Inc.
As a member of the Pivotal Data Engineering team, Jeff Cherng is responsible to work with customers to drive technical innovations on high performance data solutions. Jeff is very passionate about Spring Framework/Cloud Foundry and has worked on many distributed systems projects over... Read More →

Anupama Pradhan

Senior Technology Architect, Health Care Service Corporation
Anupama Pradhan is a Senior Technology Architect at HCSC with more than 20 years of experience in software engineering. As part of Enterprise Architecture team, she helps build reference implementations for various technologies and establish architecture patterns in the enterprise... Read More →

Thursday June 15, 2017 3:10pm - 3:40pm PDT
Grand Ballroom EF