AI at Amazon: a case study of brittleness
Amazon Alexa floundered amid brittle systems: a decentralized mess where teams rowed in opposing directions, clashing product and science cultures in tow... read more
Posts from @avlllo.. Link
Link
@faun shared a link, 6 months, 3 weeks ago
FAUN.dev()
Deploying Llama4 and DeepSeek on AI Hypercomputer
Meta's Llama4models, Scout and Maverick, strut around with17B active parametersunder a Mixture of Experts architecture. But deploying onGoogle Cloud's Trillium TPUsor A3 GPUs? That's become a breeze with new, fine-tuned recipes. Utilizing tools likeJetStreamandPathways? It means zipping through infe.. read more
Link
@faun shared a link, 6 months, 3 weeks ago
FAUN.dev()
The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity
FrontierLarge Reasoning Models (LRMs)crash into an accuracy wall when tackling overly intricate puzzles, even when their token budget seems bottomless.LRMsexhibit this weird scaling pattern: they fizzle out as puzzles get tougher, while, curiously, simpler models often nail the easy stuff with flair.. read more
Link
@faun shared a link, 6 months, 3 weeks ago
FAUN.dev()
How to Build an Asynchronous AI Agent Network Using Gemini for Research, Analysis, and Validation Tasks
The Gemini Agent Network Protocol introduces powerful AI collaboration with four distinct roles. Leveraging Google’s Gemini models, agents communicate dynamically for improved problem-solving... read more
Link
@faun shared a link, 6 months, 3 weeks ago
FAUN.dev()
Training a Rust 1.5B Coder LM with Reinforcement Learning (GRPO)
DeepSeek-R1flips the script on training LLMs. Armed withGRPO, it challenges the industry heavies like OpenAI's o1 by playing smart with custom data and cleverly designed rewards. Imagine this: a humble 1.5B model, running on merely asingle H100, clocks in at an 80% build pass rate. It’s nibbling at .. read more
Link
@faun shared a link, 6 months, 3 weeks ago
FAUN.dev()
Mistral named most privacy-friendly AI, Google ranks low: report
Mistral AI’s “Le Chat” leads in privacy-focused AI, beating out OpenAI’s ChatGPT and xAI’s Grok.Consumer privacy concerns are reshaping the AI landscape, with 68% worried about online privacy.Regional regulations impact privacy practices, with Mistral AI benefiting from Europe’s strict GDPR rules... read more
Link
@faun shared a link, 6 months, 3 weeks ago
FAUN.dev()
AWS' custom chip strategy is showing results, and cutting into Nvidia's AI dominance
Graviton4just cranked up the juice to600 Gbps. In the grand race of public cloud champions, it's gunning straight for Nvidia's AI kingdom, powered by the formidableProject Rainier... read more
Link
@faun shared a link, 6 months, 3 weeks ago
FAUN.dev()
Run the Full DeepSeek-R1-0528 Model Locally
DeepSeek-R1-0528's nanized form chops space needs down to162GB. But here's the kicker—without a solid GPU, it's like waiting for paint to dry... read more
Link
@faun shared a link, 6 months, 3 weeks ago
FAUN.dev()
Announcing up to 45% price reduction for Amazon EC2 NVIDIA GPU-accelerated instances
AWS chops up to45%from Amazon EC2 NVIDIA GPU prices. Now your AI training costs less even as GPUs play hard to get... read more
Link
@faun shared a link, 6 months, 3 weeks ago
FAUN.dev()
Scaling Test Time Compute to Multi-Agent Civilizations
Turns out, Reasoning AIs use a single test compute unit to pack the punch of something 1,000 to 10,000 times its size—an acrobatics act impossible before the might of GPT-4.Noam Brown spilled the beans on Ilya's hush-hush 2021 GPT-Zero experiment, which flipped his views on how soon we'd see reasoni.. read more
