How We Designed Model Runner and What’s Next

Docker's just unleashed a new gadget with Desktop 4.40. Meet the Model Runner, your ticket to running AI models on your local machine. Imagine it as the Peacekeeper of container-host diplomacy. It’s powered by llama.cpp and can ride GPUs like a pro skater. Oh, and it plays nice with the OpenAI API. Models strut their stuff at /models endpoints, mirroring images in Docker's world. Get ready for some heavy-duty AI magic.