Large Language Models (LLMs)

The paper introduces TTPO, a method designed to optimize LLM reasoning during test-time training by utilizing asymmetric learning signals from pseudo-labels. It effectively mitigates the risks of noisy majority-vote labels by distilling agreeing rollouts and penalizing disagreeing ones.

The paper introduces TTPO, a method designed to optimize LLM reasoning during test-time training by utilizing asymmetric learning signals from pseudo-labels. It effectively mitigates the risks of noisy majority-vote labels by distilling agreeing rollouts and penalizing disagreeing ones.

Researchers have developed MCR-Bench to move beyond static code review evaluation by simulating the iterative nature of real-world developer interactions. The study reveals that current LLMs struggle significantly with maintaining defect state consistency across multiple rounds of code changes.

This paper presents ConceptGuard, a novel benchmark for evaluating machine unlearning in LLMs through the lens of dual-use concepts. It demonstrates that current unlearning methods are insufficient at distinguishing between harmful and benign contexts of the same underlying knowledge.

Researchers have developed u-OPSD, a technique that allows large language models to perform self-distillation using only their own generated outputs. By leveraging internal consistency through majority voting, the model can correct its own errors without requiring external ground-truth data.

This research evaluates whether replacing structured JSON tool calls with executable Python scripts improves LLM agent performance. The findings suggest that programmatic tool calling is a more robust and scalable alternative, particularly for complex, multi-step, and high-parallelism tasks.

Google has leveraged AI-driven agents to patch over 1,000 security vulnerabilities in recent Chrome releases. This automated workflow covers everything from initial discovery via fuzzing to the generation of candidate patches.

PagedWeight optimizes the serving of MoE LLMs by implementing a dynamic quantization strategy that adapts to runtime memory pressure. It balances hardware efficiency with model accuracy by monitoring expert routing statistics and prompt-specific sensitivities.

This research presents OPD2, a novel distillation technique that focuses on the learning trajectory of reasoning models by using a delta signal between teacher and base models. Experimental results prove it outperforms standard on-policy distillation across multiple complex reasoning domains.

This research presents a novel approach to document retrieval that prioritizes the holistic quality of document sets over individual document relevance. By introducing the SetwiseEvalKit benchmark and the Rubric4Setwise optimization method, the authors demonstrate how addressing redundancy and factual conflicts can significantly improve LLM generation performance.

This research identifies that mode collapse in LLMs is driven by a cognitive typicality bias within preference datasets. To counter this, the authors present Verbalized Sampling, an inference-time method that unlocks model diversity without retraining.

The Seed framework addresses the limitations of sparse rewards in agentic reinforcement learning by extracting reusable skills from completed interaction trajectories. It utilizes on-policy distillation to provide dense, token-level supervision that evolves alongside the policy's capabilities.

This technical paper proposes a new distillation paradigm called Direct-OPD to improve weak-to-strong generalization in reasoning models. By distilling only the policy shift induced by reinforcement learning, the method avoids the capacity limitations inherent in traditional teacher-student imitation.

This study demonstrates that reinforcement learning post-training for LLMs is not a uniform process across all parameters but is concentrated in specific middle layers. By leveraging this discovery, researchers developed layer-aware training methods that outperform traditional full-parameter optimization.

This paper presents Distill to Detect (D2D), a technique for identifying stealthy, topic-specific biases in language models that evade standard detection. By distilling the distributional shift of a suspected model into a small prefix adapter, the method amplifies hidden signals until they become visible in generated text.

This paper proposes APPO, a method to enhance the training of autonomous LLM agents through more granular credit assignment. It moves beyond trajectory-level rewards by identifying and branching at specific high-impact decision points within the reasoning process.

Scientists successfully demonstrated quantum enhancement in large language models by creating a hybrid system that integrates quantum circuit blocks. This novel approach significantly improved the LLM's perplexity and factual accuracy, paving the way for more powerful, resource-efficient AI.

Barnes & Noble CEO James Daunt announced that the company is willing to sell AI-written books in its stores, provided that the books are transparently labeled as synthetic content. He stressed that the key criterion is maintaining clarity for the customer, ensuring the book does not falsely imitate human authorship.