image of this article category

DeepSeek.. unveiling the "Sparse Attention" technique and why it matters

01.10.2025 03:33 AM
Latest
DeepSeek.. unveiling the "Sparse Attention" technique and why it matters
dooklik website logo
In a new step within the race to develop artificial intelligence technologies, the Chinese company DeepSeek announced the launch of its experimental model V3.2-exp, which relies on an innovative mechanism known as Sparse Attention.

share
share this article on facebook
share this article on twitter
share this article on whatsapp
share this article on facebook messenger
DeepSeek.. unveiling the "Sparse Attention" technique and why it matters

The core idea of the model is to reduce resource consumption when dealing with long texts. The system uses a unit called the Lightning Indexer to identify the most important segments of the text, then applies a Fine Token Selection mechanism to extract key words and process them within the attention window.

According to initial results, this technology could reduce API call costs by up to 50%, which represents a major breakthrough in improving the efficiency of running large language models. However, the company stressed the need for additional independent testing to confirm these findings.

It is worth noting that DeepSeek had previously stirred debate earlier this year with the launch of its R1 model, which gained attention thanks to its lower cost compared to American competitors. Today, while the V3.2-exp model may not create the same buzz, it represents an important practical step toward making AI operations more efficient and less expensive.

Analysts believe this technology could help major companies—especially in the United States—reduce their operational expenses in AI while maintaining the same performance levels. This opens the door to a new phase of competition between Chinese innovation and Western technologies.

Related Articles
doolik website logo
Recent press reports revealed that OpenAI uses data from Google search to answer some user inquiries, especially those related to news, sports, and financial markets.

doolik website logo
Facebook has launched a wide-scale campaign as part of its ongoing efforts to improve user experience and combat “spam content,” resulting in the deletion of over 10 million accounts during the first half of 2025.

doolik website logo
While OpenAI, the company behind ChatGPT, remains silent about the release date of its latest version, GPT-5, many internet experts predict it will launch during the current month of July, with expectations of astonishing features that surpass all existing AI models on the market.
Live Video Streaming
Live video streaming lets you engage with your audience in real time with a video feed. Broadcast your daily show to your audience with no limits, no buffering and high quality videos. Reach all devices anytime anywhere with different video qualities that suits any device and any connection.
$1,120/YE*
The website uses cookies to improve your experience. We’ll assume you’re ok with this, but you can opt-out if you wish.
ACCEPT