ContentPosts from @oliversbrooks..
Link
@faun shared a link, 3 months, 1 week ago

Implementing High-Performance LLM Serving on GKE: An Inference Gateway Walkthrough

GKE Inference Gatewayflips LLM serving on its head. It’s all about that GPU-aware smart routing. By juggling the KV Cache in real time, it amps up throughput and slices latency like a hot knife through butter...

Implementing High-Performance LLM Serving on GKE: An Inference Gateway Walkthrough
Link
@faun shared a link, 3 months, 1 week ago

Stop Wasting Time: The Only Guide You’ll Ever Need to Setup/Fix SSH on EC2

GitHub's giving passwords the boot for HTTPS logins. Say hello topublic-key SSHor a Personal Access Token. So, load up those SSH keys—or hit the road...

Stop Wasting Time: The Only Guide You’ll Ever Need to Setup/Fix SSH on EC2
Link
@faun shared a link, 3 months, 1 week ago

The reality of GitOps application recreation

52%of teams believe they're ace at cloning apps from Git. High-performers?70%of them share in this delusion. Yet, lurking infrastructure wrinkles often deflate their grand plans. GitOps, that wild ride, inspires confidence. It dips, then soars. But just when enthusiasts think they're cruising, they ..

Link
@faun shared a link, 3 months, 1 week ago

A four day hiking trip into ScreenshotOne infrastructure to solve an issue

Misleading monitor alerts: Turns out, the villain wasexample.comblocking those pesky automated requests. No real service drama here. Just a wake-up call to tame those testing environments!..

A four day hiking trip into ScreenshotOne infrastructure to solve an issue
Link
@faun shared a link, 3 months, 1 week ago

Unlocking High-Performance AI/ML in Kubernetes with DRANet and RDMA

DraNetslaps networking woes straight out the door. It natively handles RDMA in Kubernetes, so you can toss those convoluted scripts. Now in beta and weighing only 50MB, it offers deployments that are lean, speedy, and unyieldingly secure...

Unlocking High-Performance AI/ML in Kubernetes with DRANet and RDMA
Link
@faun shared a link, 3 months, 1 week ago

Critical NVIDIA Container Toolkit Flaw Allows Privilege Escalation on AI Cloud Services

A critical container escape vulnerability (CVE-2025-23266) in NVIDIA Container Toolkit poses a severe threat to managed AI cloud services, earning a CVSS score of 9.0 out of 10.0. This flaw allows37%of cloud environments to potentially be accessed by attackers using a three-line exploit, enabling co..

Critical NVIDIA Container Toolkit Flaw Allows Privilege Escalation on AI Cloud Services
Link
@faun shared a link, 3 months, 1 week ago

Building scalable secrets management in hybrid cloud environments

GitGuardian's 2024 reportsounds the alarm:23 million secrets slipped through leaks in 2023. A whopping 70% hung around for months. Talk about a security nightmare! EnterHashiCorp VaultandAkeyless. These tools mastered the multi-cloud juggling act and automated secrets management. Result? A satisfyin..

Building scalable secrets management in hybrid cloud environments
Link
@faun shared a link, 3 months, 1 week ago

OpenShift LACP bonding performance expectations

Red Hat OpenShift and NIC bonding for high availability is getting popular in data centers. Consider layer2/layer2+3 configurations for balanced traffic distribution across bonded links. Layer3+4 hashing offers highest throughput but may lead to out-of-order packets due to 802.3ad non-compliance. It..

Link
@faun shared a link, 3 months, 1 week ago

Kubernetes Scaling Strategies

Horizontal Pod Autoscaler(HPA) cranks up pods based on CPU, memory, or custom quirks. A dream for stateless adventures, but you'll need a metrics server.Vertical Pod Autoscaler(VPA) fine-tunes CPU and memory for pods. Works like a charm for jobs where scaling out is sketchy, though it demands restar..

Kubernetes Scaling Strategies
Link
@faun shared a link, 3 months, 1 week ago

Automated Kubernetes Threat Detection with Tetragon and Azure Sentinel

Kubernetes security tools usually drop the ball. Enter the dynamic duo:Tetragonwielding eBPF magic for deep observability, and smart notifications for sniper-precise alerts.Fluent Bitpairs withAzure Logic Appsin an automated setup so you can hunt down threats in real-time. Not a drop of sweat needed..

Automated Kubernetes Threat Detection with Tetragon and Azure Sentinel