Ollama

FreeToken is a novel serving system that optimizes MoE model inference on consumer-grade hardware by adapting to varying bandwidth and memory availability. It addresses the challenges of expert movement and heterogeneous resource management in agentic workloads.

This report details the rising trend of opportunistic scanning targeting AI-related services and infrastructure. It highlights specific threats to unauthenticated Ollama instances and the use of coordinated sweeps to harvest AI API keys from configuration files.

A critical vulnerability in Ollama allows unauthenticated attackers to trigger an out-of-bounds heap read via malicious GGUF files. This exploit can expose sensitive information like user messages and system prompts by leaking them into newly created model files.