DevOps Conference
The Conference for Continuous Delivery, Microservices,
Containers, Clouds and Lean Business

Image processing on the fly: eternal scaling of the spot(less) instances

Session

Thank you for joining!
✓ See you next in Berlin or in Munich

Register Now

Thank you for joining!
✓ See you next in Berlin or in Munich

Register Now

Until the conference starts:
✓ Team discount
✓ Specials for freelancers and academics
Register now
Bis konferenz-beginn:
✓ Kollegenrabatt
✓ Freelancer special
Jetzt anmelden
Until September 24:
✓ Save up to 510 €
✓ Raspberry Pi or PlayStation Classic for free
✓ Group Discount
Register now
Bis 24. September
✓ Über 510 € sparen
✓ Raspberry Pi oder PlayStation Classic for free
✓ Kollegenrabatt
Jetzt anmelden
Until June 18:
✓ Workshop Day for free
✓ Raspberry Pi or C64 Mini for free
✓ Save over $840
Register now
Until June 18:
✓ Workshop Day for free
✓ Raspberry Pi or C64 Mini for free
✓ Save over $840
Register now
Until July 2:
✓ Raspberry Pi or C64 Mini for free
✓ Save up to $330
Register now
Until July 2:
✓ Raspberry Pi or C64 Mini for free
✓ Save up to $330
Register now
Infos
Monday, October 12 2020
11:45 - 12:30

We bring to you the team behind Apollo, OLX’s global media server! At peak we process and serve more than 36K images per second. Under the hood our set of Spring and Rust-based microservices are powered by Kubernetes on top of AWS.

With our backend being integrated rapidly by packs across the globe and traffic surging exponentially, we had to think of cost-effective solutions that would allow us to scale beyond anything we had ever been confronted with before. This talk describes our journey from normal on-demand AWS instances as our primary k8s workers, to creating a truly elastic and cost efficient cluster with spot instances – and the challenges we had to overcome in the process. These include roadblocks we had with KOPS (which we use to deploy and maintain this particular cluster), and core kubernetes components such as the cluster autoscaler that were driven out of their own comfort zone. As an added bonus, we will talk about how we initially used Thumbor as the core component for this application, and later built Dali our open source Rust-based image processor to drive up scale, and drive down cost!

This Session belongs to the Diese Session gehört zum Programm vom BerlinBerlin program. Take me to the program of . Hier geht es zum Programm von London London .

Take me to the full program of Zum vollständigen Programm von Berlin Berlin .

This Session belongs to the Diese Session gehört zum Programm vom BerlinBerlin program. Take me to the program of . Hier geht es zum Programm von Munich München .

This Session belongs to the Diese Session gehört zum Programm vom BerlinBerlin program. Take me to the program of . Hier geht es zum Programm von New York New York .

This Session belongs to the Diese Session gehört zum Programm vom BerlinBerlin program. Take me to the program of . Hier geht es zum Programm von Singapore Singapur .

This Session belongs to the Diese Session gehört zum Programm vom BerlinBerlin program. Take me to the program of . Hier geht es zum Programm von Online Edition Online Edition .

This Session Diese Session belongs to the gehört zum Programm von BerlinBerlin program. Take me to the current program of . Hier geht es zum aktuellen Programm von London London , Berlin Berlin , Munich München , New York New York , Singapore Singapur or oder Online Edition Online Edition .

Stay tuned:

Behind the Tracks

 

Kubernetes Ecosystem

Docker, Kubernetes & Co

Microservices & Software Architecture

Maximize development productivity

Continuous Delivery & Automation

Build, test and deploy agile

Cloud Platforms & Serverless

Cloud-based & native apps

Monitoring, Traceability & Diagnostics

Handle the complexity of microservices applications

Security

DevSecOps for safer applications

Business & Company Culture

Radically optimize IT

Organizational Change

Overcome obstacles on the way towards DevOps

Live Demo #slideless

Showing how technology really works