heart Posts from the community...
Link
@faun shared a link, 1 week, 4 days ago

Exploring GPU Sharing in Kubernetes with NVIDIA KAI Scheduler and SDG

NVIDIA's KAI SchedulerandExostellar's SDGshowcase the nerd ballet of fractional GPU scheduling. KAI slices GPU time like a master chef carving a roast, yet can't keep its focus solo—leading to app skirmishes. In contrast,Exostellar SDGnails resource control, quarantines workloads like a germaphobe, ..

Exploring GPU Sharing in Kubernetes with NVIDIA KAI Scheduler and SDG
Link
@faun shared a link, 1 week, 4 days ago

Building A Virtual Machine inside ChatGPT

ChatGPTmoonlights as a virtual Linux machine, performing calculations faster than some actual hardware. Impressive, right? But don't get too excited—it can't juggle real-time tasks or tap into a GPU. A digital superhero with a glaring Achilles' heel...

Building A Virtual Machine inside ChatGPT
Link
@faun shared a link, 1 week, 4 days ago

Benchmarking a 65,000-node GKE cluster with AI workloads

GKE’s now flexes with a colossal 65,000-node cluster—a boon for AI workloads that feast on mega infrastructure. Building on their 50,000+ TPU cluster saga, GKE tackles AI workload quirks like resource juggling and node chatter. In CPU stress tests, they whipped up 65,000 StatefulSet Pods, flaunting ..

loading...