ContentPosts from @test12..
Link
@faun shared a link, 2 weeks, 3 days ago

Evolving Kubernetes for generative AI inference

Google Cloud, ByteDance, and Red Hat are wiring AI smarts straight intoKubernetes. Think: faster inference benchmarks, smarter LLM-aware routing, and on-the-fly resource juggling—all built to handle GenAI heat. Their new push,llm-d, bakesvLLMdeep into Kubernetes. That unlocks disaggregated serving ..

Evolving Kubernetes for generative AI inference
 Activity
@charan_devops started using tool GitHub Actions , 2 weeks, 4 days ago.
 Activity
@charan_devops started using tool Azure Pipelines , 2 weeks, 4 days ago.
 Activity
@charan_devops started using tool GitLab , 2 weeks, 4 days ago.
 Activity
@charan_devops started using tool GitLab CI/CD , 2 weeks, 4 days ago.
 Activity
@charan_devops started using tool Argo , 2 weeks, 4 days ago.
 Activity
@charan_devops started using tool Jenkins , 2 weeks, 4 days ago.
 Activity
@charan_devops started using tool Python , 2 weeks, 4 days ago.
 Activity
@charan_devops started using tool Agile Stacks DevOps Automation Platform , 2 weeks, 4 days ago.
 Activity
@lokeshjonnakuti started using tool RxJS , 2 weeks, 5 days ago.