Ollama

The author details a transition from managing LLMs as application-specific code to implementing a robust platform engineering layer. This architectural shift focuses on controlling hallucinations, managing token costs, and ensuring secure tool orchestration.

State-sponsored hackers from China are doubling their attack output by leveraging inexpensive AI models with weak safety controls. This shift allows for the automation of complex tasks like exploit development and network mapping at a much lower cost than previously required.

Researchers discovered a network configuration flaw in Nvidia's NemoClaw that enables unauthenticated access to local LLM instances. By leveraging DNS rebinding, attackers can silently inject malicious instructions into model templates, creating persistent and undetectable AI agent compromise.

FreeToken is a novel serving system that optimizes MoE model inference on consumer-grade hardware by adapting to varying bandwidth and memory availability. It addresses the challenges of expert movement and heterogeneous resource management in agentic workloads.

This report details the rising trend of opportunistic scanning targeting AI-related services and infrastructure. It highlights specific threats to unauthenticated Ollama instances and the use of coordinated sweeps to harvest AI API keys from configuration files.

A critical vulnerability in Ollama allows unauthenticated attackers to trigger an out-of-bounds heap read via malicious GGUF files. This exploit can expose sensitive information like user messages and system prompts by leaking them into newly created model files.