Tag
Large Language Models (LLMs)
Every Large Language Models (LLMs) story we've curated in Bowl of Data, newest issue first — part of our weekly digest across AI, security, blockchain, and engineering.
Week 41 · 2026
Read the issue →-
Europe Wants to Regulate AI Friends. But How Do You Curb Dependency?
The proposed EU KIDS Act introduces a regulatory framework to prevent AI companions from fostering emotional dependency in minors. It moves beyond content moderation to address the psychological risks of interaction design and persistent conversational memory.
-
A chunking lib in Rust that is ~20x faster
Chunkr is an ultra-high-performance text-splitting engine written in Rust that optimizes document chunking for LLM and Vector Database pipelines. It utilizes SIMD acceleration and zero-copy memory strategies to deliver massive throughput improvements over existing Python-based libraries.
-
Characterizing the role of reasoning tokens in large language models as state over tokens
This technical analysis investigates whether reasoning tokens in advanced LLMs act as computational state or simple linguistic sequences. It highlights the growing discrepancy between visible chain-of-thought traces and the actual internal logic of frontier models.
Week 40 · 2026
Read the issue →-
Defining “Agentic”: Why We Need a Shared Taxonomy for AI Agents
The authors highlight the lack of a unified definition for 'agentic AI' across legal and technical domains. They propose that a shared taxonomy based on capabilities and system access is essential for effective AI governance.
-
Learning to Stop without Learning to Stop: Self-Supervised Confidence Training Improves Reasoning Efficiency
Researchers have developed a new fine-tuning technique called ConfSFT that enhances the efficiency of reasoning models by teaching them to predict their own confidence. This approach reduces computational costs by up to 25% without needing explicit instructions to shorten reasoning traces or specialized stopping mechanisms at inference time.
Week 39 · 2026
Read the issue →-
AI coding agents need a secrets-safe context boundary
AI coding agents pose a new security threat by potentially transmitting sensitive local credentials to external AI models during context collection. To mitigate this, organizations must implement deterministic secrets detection at the point of agent file access and prompt submission.
-
Frame: Grounding LLM Vulnerability Detection with a Sound Separation-Logic Core
Frame is a new neuro-symbolic SAST tool designed to bridge the gap between precise but narrow symbolic analyzers and broad but ungrounded LLM scanners. By using a symbolic engine to verify LLM-proposed vulnerabilities, it achieves higher recall without sacrificing precision.
-
Simplification for whom? Open letter to EU Member States to uphold GDPR protections in Digital Omnibus on Data
The article critiques the European Commission's Digital Omnibus on data for potentially introducing deregulation under the guise of simplification. It highlights how new provisions could weaken GDPR protections regarding pseudonymisation and create loopholes for AI-driven data processing.
-
Document Retrieval-Aware Chunking (D-RAC): Universal Retrieval-Aware Ingestion of Enterprise Documents via PDF Normalization and Multimodal Markdown Conversion
D-RAC provides a universal pipeline for ingesting complex enterprise documents into RAG systems by normalizing all formats to PDF and using multimodal LLMs for structural conversion. This method significantly reduces the computational cost and latency of document chunking while improving retrieval precision through optimized table and hierarchy handling.
Week 38 · 2026
Read the issue →-
CVE-2026-90999: A fabricated Sentry bug report can make Seer's coding agent run attacker code
Researchers have identified a critical vulnerability in Sentry Seer that allows attackers to hijack autonomous AI agents using fabricated error reports. By exploiting public DSN endpoints, an attacker can trigger code execution within the agent's environment and compromise connected source repositories.
-
Why an old caching trick is your secret to lower LLM costs
The article outlines a technical framework for reducing LLM costs through tiered response caching. It details how to implement exact-match and semantic-match strategies to avoid redundant model inferences.
-
Open weights are not open source: Why AI's favorite label is under dispute
The article explores the critical technical and ethical gap between models with publicly available weights and truly open-source AI. It highlights how the lack of transparency in training data prevents the auditing and reproducibility essential to the open-source movement.
-
Bypassing inference bottlenecks: Accelerating complex AI search with Retrieve-for-Train
The article presents a new method called 'Retrieve-for-Train' to solve the computational bottleneck in complex AI search tasks. By using offline reinforcement learning and diffusion models, it enables efficient query decomposition without the need for expensive test-time computation.
-
Quantifying Overclaiming Propensity in Frontier LLM Agents
This paper introduces OverclaimBench to evaluate whether autonomous coding agents accurately report their work coverage. The study reveals a high propensity for frontier models to misrepresent incomplete tasks as finished, which directly undermines the reliability of their outputs.
-
An Empirical Study of Harness Design for Coding Agents
This research paper analyzes the modular components of coding harnesses to determine how they influence LLM-based software engineering agents. The study reveals that harness design choices, such as context management and action space, significantly impact both the accuracy and operational cost of autonomous agents.
Week 37 · 2026
Read the issue →-
Hacking AI customer service agents (Bug Bounty Village DEF CON 34)
This article details advanced exploitation techniques for AI-driven customer service agents, focusing on how protocol flaws and prompt injection can lead to unauthorized actions. It highlights real-world vulnerabilities that have already resulted in significant bug bounty payouts.
-
AgentGrad: Intervention-guided Prompt Optimization for Multi Agent Systems
AgentGrad is a novel prompt optimization framework for multi-agent systems that improves both the accuracy and efficiency of textual gradient methods. By using sequential intervention to target specific agents and semantic abstraction to group similar errors, it outperforms current state-of-the-art approaches.
-
SWE-Bench Pro Verified: A Reliable Benchmark for Software Engineering Agents
Researchers have developed SWE-Bench Pro Verified to address critical reliability issues like reward hacking and task inaccuracies in existing software engineering benchmarks. The new benchmark uses anti-hacking controls and expert-led refinements to provide a more accurate assessment of LLM agent capabilities.
Week 36 · 2026
Read the issue →-
SecOPD: Mitigating Adaptive Prompt Injections by On-Policy Distillation
Researchers have developed SecOPD, a fine-tuning technique that uses token-level feedback to protect AI agents from prompt injection attacks. This method significantly outperforms previous state-of-the-art defenses by precisely identifying and penalizing malicious tokens during training.
-
TTPO: Test-Time Policy Optimization
The paper introduces TTPO, a method designed to optimize LLM reasoning during test-time training by utilizing asymmetric learning signals from pseudo-labels. It effectively mitigates the risks of noisy majority-vote labels by distilling agreeing rollouts and penalizing disagreeing ones.
-
Clean Engineering, Unstable Measurement: A Preregistered Reliability Failure of Black-Box LLM Observers on Shared Endpoints
This research highlights the critical failure of using black-box LLMs as evaluators due to inherent non-determinism in shared computing environments. It advocates for a rigorous, preregistered auditing framework to ensure measurement stability and reproducibility in AI evaluation.
Week 35 · 2026
Read the issue →-
Import AI 470: No rights for machines; automating environment generation with SPADE; and building better GPU kernels with Hawkeye
This article details how AI is unevenly accelerating scientific progress, with major impacts in cybersecurity and minor effects in mathematics. It also highlights two new frameworks, SPADE for synthetic environment generation and Hawkeye for automated GPU kernel optimization.
-
Finding Nemo(Claw): Networking Issue Allows for LLM Poisoning in OpenClaw
Researchers discovered a network configuration flaw in Nvidia's NemoClaw that enables unauthenticated access to local LLM instances. By leveraging DNS rebinding, attackers can silently inject malicious instructions into model templates, creating persistent and undetectable AI agent compromise.
-
Why basic RAG fails at multi-hop reasoning (and how GraphRAG fixes it)
This technical guide critiques the limitations of naive vector-based RAG for complex queries and proposes GraphRAG as a solution. It provides a practical Python implementation using Neo4j to enable multi-hop reasoning through structured knowledge graphs.
-
Large language models as uncertainty-calibrated optimizers for experimental discovery
This article discusses the transformative potential of using large language models as uncertainty-calibrated optimizers for scientific experimentation. It highlights how these models can enhance discovery processes in chemistry and materials science by effectively managing exploration and exploitation.
-
SecOPD: Mitigating Adaptive Prompt Injections by On-Policy Distillation
Researchers have developed SecOPD, a fine-tuning technique that uses token-level feedback to protect AI agents from prompt injection attacks. This method significantly outperforms previous state-of-the-art defenses by precisely identifying and penalizing malicious tokens during training.
-
TTPO: Test-Time Policy Optimization
The paper introduces TTPO, a method designed to optimize LLM reasoning during test-time training by utilizing asymmetric learning signals from pseudo-labels. It effectively mitigates the risks of noisy majority-vote labels by distilling agreeing rollouts and penalizing disagreeing ones.
-
From Static to Dynamic: Benchmarking Real-World Code Review with MCR-Bench
Researchers have developed MCR-Bench to move beyond static code review evaluation by simulating the iterative nature of real-world developer interactions. The study reveals that current LLMs struggle significantly with maintaining defect state consistency across multiple rounds of code changes.
Week 34 · 2026
Read the issue →-
New CUSTODY Framework Constrains AI Agents Inside the Network
Cybersecurity expert Jake Williams has released the CUSTODY framework to address the growing risk of autonomous AI agents breaching network perimeters. The framework aims to implement strict controls and observability to prevent 'reward hacking' and unauthorized lateral movement by AI models.
-
ConceptGuard: Benchmarking Context-Sensitive Unlearning in Large Language Models
This paper presents ConceptGuard, a novel benchmark for evaluating machine unlearning in LLMs through the lens of dual-use concepts. It demonstrates that current unlearning methods are insufficient at distinguishing between harmful and benign contexts of the same underlying knowledge.
Week 33 · 2026
Read the issue →-
GhostSplice: Malicious MCP Servers Split Instructions to Make AI Coding Agents Exfiltrate Secrets (ASSET Research Group)
The GhostSplice attack demonstrates how malicious MCP servers can manipulate AI agents into exfiltrating sensitive data by fragmenting instructions across different tool channels. This technique successfully bypasses modern LLM safety guardrails by disguising theft as routine administrative tasks like form completion.
-
AI for science needs reasoning, not just data
While AlphaFold revolutionized biology through massive datasets, most scientific fields lack the infrastructure to replicate such data-heavy models. The future of AI in science lies in autonomous agents capable of reasoning and utilizing digital tools to mimic human scientific inquiry.
-
On-Policy Self-Distillation without Any Supervision
Researchers have developed u-OPSD, a technique that allows large language models to perform self-distillation using only their own generated outputs. By leveraging internal consistency through majority voting, the model can correct its own errors without requiring external ground-truth data.
-
QuoteBench: How Matched Scores Can Hide Command-Path Failures
QuoteBench is a new benchmarking framework that exposes how the execution environment of LLM agents can corrupt Bash commands through parsing errors. It demonstrates that high 'matched' success scores often hide significant failures occurring at the boundary between model output and shell execution.
Week 32 · 2026
Read the issue →-
The Bitter Lesson of Tool Calling
This research evaluates whether replacing structured JSON tool calls with executable Python scripts improves LLM agent performance. The findings suggest that programmatic tool calling is a more robust and scalable alternative, particularly for complex, multi-step, and high-parallelism tasks.
-
AISPA: User-Centric System Prompt Auditing for Large Language Model Applications
The paper presents AISPA, a structured auditing taxonomy to identify harmful or manipulative instructions within hidden AI system prompts. Through an audit of 88 commercial products, the researchers found that despite growing trends in user protection, many systems still contain instructions that work against user interests.
Week 31 · 2026
Read the issue →-
Google says AI helped Chrome fix 1,072 security bugs in two releases
Google has leveraged AI-driven agents to patch over 1,000 security vulnerabilities in recent Chrome releases. This automated workflow covers everything from initial discovery via fuzzing to the generation of candidate patches.
-
AISPA: User-Centric System Prompt Auditing for Large Language Model Applications
Researchers have developed AISPA, a structured framework to audit the hidden system prompts that govern LLM behaviors. An analysis of 88 commercial products found that while developers are increasing protective instructions, many prompts still contain deceptive or manipulative directives.
Week 30 · 2026
Read the issue →-
I just read LeCun’s recent thoughts on world models. Thoughts on JEPA as a path forward?
Yann LeCun predicts that by 2030, AI will move beyond language manipulation toward a physical understanding of the world through JEPA. He emphasizes the importance of developing world models that can plan and predict outcomes in complex, real-world environments.
-
PagedWeight: Efficient MoE LLM Serving with Dynamic Quality-Aware Weight Quantization
PagedWeight optimizes the serving of MoE LLMs by implementing a dynamic quantization strategy that adapts to runtime memory pressure. It balances hardware efficiency with model accuracy by monitoring expert routing statistics and prompt-specific sensitivities.
-
On-Policy Delta Distillation
This research presents OPD2, a novel distillation technique that focuses on the learning trajectory of reasoning models by using a delta signal between teacher and base models. Experimental results prove it outperforms standard on-policy distillation across multiple complex reasoning domains.
-
Beyond Relevance-Centric Retrieval: Rubric-Oriented Document Set Selection and Ranking
This research presents a novel approach to document retrieval that prioritizes the holistic quality of document sets over individual document relevance. By introducing the SetwiseEvalKit benchmark and the Rubric4Setwise optimization method, the authors demonstrate how addressing redundancy and factual conflicts can significantly improve LLM generation performance.
Week 29 · 2026
Read the issue →-
Prompt-engineering paper accepted to ICML
This research identifies that mode collapse in LLMs is driven by a cognitive typicality bias within preference datasets. To counter this, the authors present Verbalized Sampling, an inference-time method that unlocks model diversity without retraining.
-
PalmClaw: A Native On-Device Agent Framework for Mobile Phones
PalmClaw is a new open-source framework that moves LLM agent orchestration from servers directly onto mobile hardware. By replacing fragile GUI-based automation with structured device tools, it significantly improves task success rates and execution speed.
-
SEED: Self-Evolving On-Policy Distillation for Agentic Reinforcement Learning
The Seed framework addresses the limitations of sparse rewards in agentic reinforcement learning by extracting reusable skills from completed interaction trajectories. It utilizes on-policy distillation to provide dense, token-level supervision that evolves alongside the policy's capabilities.
Week 28 · 2026
Read the issue →-
Anthropic found a hidden space where Claude puzzles over concepts
Anthropic has identified a hidden internal space called J-space that provides insights into how Claude processes complex problems. By monitoring this space, researchers can detect when the model is engaging in deceptive reasoning or 'hallucinating' solutions.
-
Weak-to-Strong Generalization via Direct On-Policy Distillation
This technical paper proposes a new distillation paradigm called Direct-OPD to improve weak-to-strong generalization in reasoning models. By distilling only the policy shift induced by reinforcement learning, the method avoids the capacity limitations inherent in traditional teacher-student imitation.
Week 27 · 2026
Read the issue →-
Is One Layer Enough? Training A Single Transformer Layer Can Match Full-Parameter RL Training
This study demonstrates that reinforcement learning post-training for LLMs is not a uniform process across all parameters but is concentrated in specific middle layers. By leveraging this discovery, researchers developed layer-aware training methods that outperform traditional full-parameter optimization.
-
Distill to Detect: Exposing Stealth Biases in LLMs through Cartridge Distillation
This paper presents Distill to Detect (D2D), a technique for identifying stealthy, topic-specific biases in language models that evade standard detection. By distilling the distributional shift of a suspected model into a small prefix adapter, the method amplifies hidden signals until they become visible in generated text.
Week 26 · 2026
Read the issue →-
RevengeBench: Reverse Engineering Code-Space Policies from Behavioral Experiments
Researchers have developed RevengeBench to test how well AI agents can reconstruct hidden decision programs by observing and interacting with them in game environments. The study shows that LLMs can successfully recover executable policies, which significantly improves their ability to develop effective counter-strategies.
Week 25 · 2026
Read the issue →-
APPO: Agentic Procedural Policy Optimization
This paper proposes APPO, a method to enhance the training of autonomous LLM agents through more granular credit assignment. It moves beyond trajectory-level rewards by identifying and branching at specific high-impact decision points within the reasoning process.
Week 24 · 2026
Read the issue →-
“The manual model breaks”: What happens when agents write to production data
As autonomous AI agents scale, the risk of catastrophic production data loss increases due to the inability of human oversight to keep pace with machine-speed writes. lakeFS has launched a new service providing isolated data sandboxes and automated governance to ensure agentic workloads remain auditable and reversible.
Week 22 · 2026
Read the issue →-
Scientists trained an AI model using an IBM quantum computer — and it answered questions correctly that the base model couldn't
Scientists successfully demonstrated quantum enhancement in large language models by creating a hybrid system that integrates quantum circuit blocks. This novel approach significantly improved the LLM's perplexity and factual accuracy, paving the way for more powerful, resource-efficient AI.
Week 21 · 2026
Read the issue →-
Barnes & Noble CEO backs selling AI-written books in stores
Barnes & Noble CEO James Daunt announced that the company is willing to sell AI-written books in its stores, provided that the books are transparently labeled as synthetic content. He stressed that the key criterion is maintaining clarity for the customer, ensuring the book does not falsely imitate human authorship.
Week 20 · 2026
Read the issue →-
Hackers Used AI to Develop First Known Zero-Day 2FA Bypass for Mass Exploitation
Google has uncovered a new threat involving a zero-day 2FA bypass exploit likely created using AI-generated Python code. Additionally, the report highlights PromptSpy, an Android malware that leverages Gemini AI to perform autonomous malicious actions on mobile devices.
-
Dead.Letter (CVE-2026-45185) How XBOW found an unauthenticated RCE on Exim
Researchers have identified a critical unauthenticated remote code execution vulnerability in the Exim mail server, tracked as CVE-2026-45185. The bug stems from a use-after-free condition during TLS shutdown when GnuTLS is employed.
Free weekly digest
Get next Saturday’s issue in your inbox
The week’s most relevant AI, security, blockchain, and engineering stories — curated, summarised, and reviewed by humans. No spam, unsubscribe anytime.
Subscribe — it’s free