Session Name: Build Robust Versatile Data Pipelines with Serverless
"Serverless has been widely accepted as a mechanism to quickly build & deploy microservices. In this talk, I will show you how to use Serverless to build highly flexible, high throughput data pipelines. We will walk through a real-world example of how we've used Google CloudFunctions and Cloud Run, a technology built upon the Knative open standard, to deploy data pipelines at WP Engine. We will dive deep into how we address fault tolerance, concurrency & auto-scaling while keeping an eye on costs.
The most important thing for modern services is delivering data quickly and accurately. As business processes get more complex, it can be difficult to get the right data to your service quickly and efficiently. Using Serverless, let’s make it dead simple to deploy and adapt our data pipelines to ever changing requirements"
Denver is leading a team that’s pioneering the use of Serverless at WP Engine, a distributed WordPress digital experience platform that serves over 500k production WordPress sites, handling over 4 Billion requests, and generating 1/2 TB of data daily. Denver's passion is building software that is easy to deploy and delivers real customer & business value at every step