AI Post Transformers

← AI Post Transformers19. Okt.

MAGMA: Multi-Graph Agentic Memory for Long-Horizon AI Agents

MAGMA: Multi-Graph Agentic Memory for Long-Horizon AI Agents19. Okt.

This episode examines MAGMA, a memory architecture for long-running AI agents that stores each event once and links it across four separate graphs: semantic, temporal, causal, and entity. Retrieval follows whichever edge type a question calls for. The discussion first sets out why bigger context windows don't solve the problem, then traces the shift from long-context models to RAG to agent-owned memory systems such as MemGPT, A-Mem, and Zep. It argues that these systems organize memory by similarity rather than by dependency, so they struggle with "why" and "what came before" questions. The hosts also describe the LoCoMo and LongMemEval benchmarks, point out that MAGMA is a data structure around a frozen LLM rather than a trained network, and note that the extra write-time LLM extraction (especially for causal edges) raises the question of whether the headline gains come from the graph or from the surrounding prompts. Listeners get a skeptical look at what the paper's single headline number actually measures, and at which comparisons, such as Mem0 and HippoRAG 2, the paper cites but doesn't run.

Sources:

1. MAGMA: A Multi-Graph based Agentic Memory Architecture for AI Agents — Dongming Jiang, Yi Li, Guanpeng Li, Bingzhe Li, 2026

http://arxiv.org/abs/2601.03236

2. MemGPT: Towards LLMs as Operating Systems — Charles Packer, Sarah Wooders, Kevin Lin, Vivian Fang, Shishir G. Patil, Ion Stoica, Joseph E. Gonzalez, 2023

https://scholar.google.com/scholar?q=MemGPT%3A+Towards+LLMs+as+Operating+Systems

3. Generative Agents: Interactive Simulacra of Human Behavior — Joon Sung Park, Joseph C. O'Brien, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, Michael S. Bernstein, 2023

https://scholar.google.com/scholar?q=Generative+Agents%3A+Interactive+Simulacra+of+Human+Behavior

4. Zep: A Temporal Knowledge Graph Architecture for Agent Memory — Preston Rasmussen, Pavlo Paliychuk, Travis Beauvais, Jack Ryan, Daniel Chalef, 2025

https://scholar.google.com/scholar?q=Zep%3A+A+Temporal+Knowledge+Graph+Architecture+for+Agent+Memory

5. A-Mem: Agentic Memory for LLM Agents — Wujiang Xu, Zujie Liang, Kai Mei, Hang Gao, Juntao Tan, Yongfeng Zhang, 2025

https://scholar.google.com/scholar?q=A-Mem%3A+Agentic+Memory+for+LLM+Agents