Modal and Scaling AI Inference with Erik Bernhardsson

Modal is a serverless compute platform that’s particularly centered on AI workloads. The corporate’s aim is to allow AI groups to shortly spin up GPU-enabled containers, and quickly iterate and autoscale.

It was based by Erik Bernhardsson who was beforehand at Spotify for 7 years the place he constructed the music advice system and the favored Luigi workflow scheduler.

On this episode, Erik joins Sean Falconer to speak concerning the motivation for founding his firm, the market hole in ML and AI tooling, optimizing container chilly begin, Modal’s interface design, and extra.

Sean’s been an instructional, startup founder, and Googler. He has revealed works masking a variety of matters from AI to quantum computing. Presently, Sean is an AI Entrepreneur in Residence at Confluent the place he works on AI technique and thought management. You may join with Sean on LinkedIn.