Join us

DeepSeek-V3 now runs at 20 tokens per second on Mac Studio, and that’s a nightmare for OpenAI

DeepSeek-V3 now runs at 20 tokens per second on Mac Studio, and that’s a nightmare for OpenAI

Meet DeepSeek-V3-0324, the renegade of language models. Packing a whopping 641GB into its digital knapsack, it's rocking an MIT license like a badge of rebellion. It buddies up with a Mac Studio's M3 Ultra processor, scoffing at the need for a stuffy datacenter.

The kicker? It flips the switch on just 37B out of a mind-boggling 685B parameters, only when needed. This clever trick cranks up efficiency and speed by a jaw-dropping 80%.


Only registered users can post comments. Please, login or signup.

Start blogging about your favorite technologies, reach more readers and earn rewards!

Join other developers and claim your FAUN account now!

Avatar

The FAUN

@faun
A worldwide community of developers and DevOps enthusiasts!
User Popularity
2k

Influence

236k

Total Hits

1

Posts