Friday, July 11, 2025

Creating liberating content

Britain’s economy contracted for the second consecutive month in May,

Avneet Kaur’s unconventional outfit at Wimbledon, featuring a low-rise mini

Brian Krzanich, chief executive officer of Intel Corp., right, shows

Related News

Britain’s economy contracted for the second consecutive month in May, dealing a blow to finance minister Rachel Reeves as she navigates a shaky domestic recovery and heightened global uncertainty. Official

Avneet Kaur’s unconventional outfit at Wimbledon, featuring a low-rise mini skirt and visible thigh tattoo, ignited a debate online. The look, deemed too revealing by some, clashed with Wimbledon’s traditional

Brian Krzanich, chief executive officer of Intel Corp., right, shows the collision avoidance feature of an AscTec Firefly drone with Intel RealSense cameras during the 2015 Consumer Electronics Show (CES)

Slow US-China trade deal may push Trump’s tariff deadlines Trade deals between the US and China are moving at a pace slower than expected, which may lead to extensions of

A consistent alteration in bowel movement (Diarrhea or Constipation) frequency should raise concerns for you. While diarrhea includes passing more frequent watery stools than normal, constipation refers to having stools

The X logo on a phone. Nurphoto | Nurphoto | Getty Images When xAI’s Grok 4 chatbot was launched on Wednesday, users and media outlets quickly began pointing out examples

Trending News

Britain’s economy contracted for the second consecutive month in May, dealing a blow to finance minister Rachel Reeves as she navigates a shaky domestic recovery and heightened global uncertainty. Official

Slow US-China trade deal may push Trump’s tariff deadlines Trade deals between the US and China are moving at a pace slower than expected, which may lead to extensions of

Access Denied You don’t have permission to access ” on this server. Reference #18.adf5d217.1752215691.16ea1cd4 Source link

Tesla’s entry into India comes at a time when the EV maker is facing reduced sales in Europe and China. (AI image) Elon Musk-led Tesla is set to open its

Market movements are expected to be influenced by India-US trade negotiations and company earnings reports. (AI image) Stock market today: Nifty50 and BSE Sensex, the Indian equity benchmark indices, opened

US President Donald Trump announced a 35 per cent tariff on Canadian imports, effective August 1. The decision was conveyed in a letter to Canadian Prime Minister Mark Carney on

Mixture of experts: The method behind DeepSeek’s frugal success |

Word Count: 710 | Estimated Reading Time: 4 minutes


Mixture of experts: The method behind DeepSeek's frugal success

China’s DeepSeek has pulled off an AI miracle—building a top-tier artificial intelligence model while spending far less than its American rivals. At a time when AI giants are burning billions on GPUs and power-hungry data centers, this start-up has figured out a way to do more with less.
The secret? A mix of smart engineering, a clever neural network design, and some good old-fashioned mathematical efficiency.
Big AI, Small Budget
Most AI firms stack their data centers with thousands of GPUs—Meta’s latest AI model reportedly ran on 16,000 specialized chips, each costing around $40,000. DeepSeek? Just 2,000. Their total compute cost? A mere $6 million, almost a tenth of what Meta is rumored to have spent.
The ‘Mixture of Experts’ Trick
The key to DeepSeek’s frugal success? A method called “mixture of experts.” Traditional AI models try to learn everything in one giant neural network. That’s like stuffing all knowledge into a single brain—inefficient and power-hungry.
DeepSeek, instead, split the system into specialized mini-networks—one for poetry, one for coding, another for biology, and so on. Each “expert” focused on its domain, while a “generalist” network acted as a bridge, coordinating them.
Think of it like a newsroom: specialist reporters cover specific beats, while an editor connects the dots.
The Decimal Game
If that wasn’t enough, DeepSeek also squeezed efficiency out of pure mathematics. AI models rely on mind-boggling amounts of number crunching, typically using 16-bit precision. DeepSeek? They slashed it to 8 bits—halving memory use and speeding up calculations.
Losing precision sounds risky, right? Not really. Just like rounding π to 3.14 works for most practical uses, trimming decimals didn’t hurt the AI’s performance. And when needed, DeepSeek stretched the final results back to 32-bit accuracy—giving them the best of both worlds.
Why Didn’t Others Do It?
AI giants like OpenAI and Google’s DeepMind have the brains and the budget, so why didn’t they crack this code first? Simple: risk.
Building AI models is expensive, and experimenting with new techniques can burn millions with no guarantee of success. DeepSeek took that gamble—and it paid off.
Now that they’ve published their findings, the industry is taking note. AI development just got a whole lot cheaper. The question is—who will be the next to follow suit?





Source link

Most Popular Articles

Sign In

Welcome ! Log into Your Account