Session: Building Skynet: Autoscaling Services On All Dimensions
Why doing toil, if the machine can do it for you? This talk covers all of the multitude of autoscaling mechanisms applicable to service meshes made by containers managed by systems like Borg, Kubernetes, Swarm or DC/OS. From vertical, horizontal, auto turnup, load shifting, etc.
When deploying containerized stateless services on clusters managed by Kubernetes, for example, the most efficient way to run them is with the minimal number of replicas possible to cover the load, maximizing the utilization of resources. How to calculate the number of replicas to maintain a reliable service can be tricky: Pod restarts, traffic imbalances, load shifts, etc.
Further, vertically scaling services is a multidimension problem and services based on virtual machines like the JVM present specific challenges for autoscaling.
Configuring the autoscaler for the right utilization levels, using the right metrics and the right decaying factors is key for successfully scaling services.
About Ramón Medrano Llamas
Ramón Medrano Llamas is a Site Reliability Engineer (SRE) at Google in Zürich, leading the Identity team, responsible for the authentication and Identity management services at Google. He concentrates on the reliability aspects of new Google products and new features of existing products, ensuring that they meet the high bar of a Google service. Before joining Google in 2013, he worked at CERN developing and designing distributed systems for physics data analysis.
He holds a master's degree in computer science and is currently working on a PhD on autonomic system management part time.