Join us

DeepSeek-V3 now runs at 20 tokens per second on Mac Studio, and that’s a nightmare for OpenAI

DeepSeek-V3 now runs at 20 tokens per second on Mac Studio, and that’s a nightmare for OpenAI

Meet DeepSeek-V3-0324, the renegade of language models. Packing a whopping 641GB into its digital knapsack, it's rocking an MIT license like a badge of rebellion. It buddies up with a Mac Studio's M3 Ultra processor, scoffing at the need for a stuffy datacenter.

The kicker? It flips the switch on just 37B out of a mind-boggling 685B parameters, only when needed. This clever trick cranks up efficiency and speed by a jaw-dropping 80%.


Let's keep in touch!

Stay updated with my latest posts and news. I share insights, updates, and exclusive content.

Unsubscribe anytime. By subscribing, you share your email with @faun and accept our Terms & Privacy.

Give a Pawfive to this post!


Only registered users can post comments. Please, login or signup.

Start writing about what excites you in tech — connect with developers, grow your voice, and get rewarded.

Join other developers and claim your FAUN.dev() account now!

Avatar

The FAUN

FAUN.dev()

@faun
The FAUN watches over the forest of developers. It roams between Kubernetes clusters, code caves, AI trails, and cloud canopies, gathering the signals that matter and clearing out the noise.
Developer Influence
3k

Influence

302k

Total Hits

3711

Posts