Distillation, also known as model or knowledge distillation, is a process where knowledge is transferred from a large, complex AI ‘teacher’ model to a smaller and more efficient ‘student’ model. Doing ...

The AI industry is witnessing a transformative trend: the use of distillation to make AI models smaller and cheaper. This shift, spearheaded by companies like DeepSeek and OpenAI, is reshaping the AI ...

Chinese artificial intelligence lab DeepSeek roiled markets in January, setting off a massive tech and semiconductor selloff after unveiling AI models that it said were cheaper and more efficient than ...

A flurry of developments in late January 2025 has caused quite a buzz in the AI world. On January 20, DeepSeek released a new open-source AI model called R1 and an accompanying research paper. R1 was ...

What if the most powerful artificial intelligence models could teach their smaller, more efficient counterparts everything they know—without sacrificing performance? This isn’t science fiction; it’s ...

Artificial intelligence companies like OpenAI, Microsoft (MSFT), and Meta (META) are using a technique called ‘distillation’ to make cheaper and more efficient AI models. This method is the industry’s ...

The Chinese AI company DeepSeek released a chatbot earlier this year called R1, which drew a huge amount of attention. Most of it focused on the fact that a relatively small and unknown company said ...

Model distillation is one of the technology trends that has reached a level of maturity identified in Gartner’s 2025 Hype Cycle for artificial intelligence (AI) as “the slope of enlightenment”.

The rapid advancements in AI have brought powerful large language models (LLMs) to the forefront. However, most high-performing models are massive, compute-heavy, and require cloud-based inference, ...

No matter how much data they learn, why do artificial intelligence (AI) models often miss the mark on human intent?

Protection against unauthorized model distillation is an emerging issue within the longstanding theme of safeguarding IP. Existing countermeasures have primarily focused on technical solutions. This ...