Large Language Models (LLMs)

PagedWeight optimizes the serving of MoE LLMs by implementing a dynamic quantization strategy that adapts to runtime memory pressure. It balances hardware efficiency with model accuracy by monitoring expert routing statistics and prompt-specific sensitivities.

This research presents OPD2, a novel distillation technique that focuses on the learning trajectory of reasoning models by using a delta signal between teacher and base models. Experimental results prove it outperforms standard on-policy distillation across multiple complex reasoning domains.

This research presents a novel approach to document retrieval that prioritizes the holistic quality of document sets over individual document relevance. By introducing the SetwiseEvalKit benchmark and the Rubric4Setwise optimization method, the authors demonstrate how addressing redundancy and factual conflicts can significantly improve LLM generation performance.

PagedWeight optimizes the serving of MoE LLMs by implementing a dynamic quantization strategy that adapts to runtime memory pressure. It balances hardware efficiency with model accuracy by monitoring expert routing statistics and prompt-specific sensitivities.

This research presents OPD2, a novel distillation technique that focuses on the learning trajectory of reasoning models by using a delta signal between teacher and base models. Experimental results prove it outperforms standard on-policy distillation across multiple complex reasoning domains.

This research presents a novel approach to document retrieval that prioritizes the holistic quality of document sets over individual document relevance. By introducing the SetwiseEvalKit benchmark and the Rubric4Setwise optimization method, the authors demonstrate how addressing redundancy and factual conflicts can significantly improve LLM generation performance.

The Seed framework addresses the limitations of sparse rewards in agentic reinforcement learning by extracting reusable skills from completed interaction trajectories. It utilizes on-policy distillation to provide dense, token-level supervision that evolves alongside the policy's capabilities.

This research identifies that mode collapse in LLMs is driven by a cognitive typicality bias within preference datasets. To counter this, the authors present Verbalized Sampling, an inference-time method that unlocks model diversity without retraining.

The Seed framework addresses the limitations of sparse rewards in agentic reinforcement learning by extracting reusable skills from completed interaction trajectories. It utilizes on-policy distillation to provide dense, token-level supervision that evolves alongside the policy's capabilities.

This technical paper proposes a new distillation paradigm called Direct-OPD to improve weak-to-strong generalization in reasoning models. By distilling only the policy shift induced by reinforcement learning, the method avoids the capacity limitations inherent in traditional teacher-student imitation.

This technical paper proposes a new distillation paradigm called Direct-OPD to improve weak-to-strong generalization in reasoning models. By distilling only the policy shift induced by reinforcement learning, the method avoids the capacity limitations inherent in traditional teacher-student imitation.

This study demonstrates that reinforcement learning post-training for LLMs is not a uniform process across all parameters but is concentrated in specific middle layers. By leveraging this discovery, researchers developed layer-aware training methods that outperform traditional full-parameter optimization.

This paper presents Distill to Detect (D2D), a technique for identifying stealthy, topic-specific biases in language models that evade standard detection. By distilling the distributional shift of a suspected model into a small prefix adapter, the method amplifies hidden signals until they become visible in generated text.

This study demonstrates that reinforcement learning post-training for LLMs is not a uniform process across all parameters but is concentrated in specific middle layers. By leveraging this discovery, researchers developed layer-aware training methods that outperform traditional full-parameter optimization.

This paper presents Distill to Detect (D2D), a technique for identifying stealthy, topic-specific biases in language models that evade standard detection. By distilling the distributional shift of a suspected model into a small prefix adapter, the method amplifies hidden signals until they become visible in generated text.

This paper proposes APPO, a method to enhance the training of autonomous LLM agents through more granular credit assignment. It moves beyond trajectory-level rewards by identifying and branching at specific high-impact decision points within the reasoning process.

Scientists successfully demonstrated quantum enhancement in large language models by creating a hybrid system that integrates quantum circuit blocks. This novel approach significantly improved the LLM's perplexity and factual accuracy, paving the way for more powerful, resource-efficient AI.

Barnes & Noble CEO James Daunt announced that the company is willing to sell AI-written books in its stores, provided that the books are transparently labeled as synthetic content. He stressed that the key criterion is maintaining clarity for the customer, ensuring the book does not falsely imitate human authorship.