Publications

Selected work on structural sequence modelling, self-improving systems, and world models.

A complete publication list is available on Google Scholar .

2026

  1. History Replays Itself: Unleashing Long-Context Capability in Linear Attention

    Li Nanbo†, Firas Laakom†, Yilan Zhang, Piotr Piękos, Yimeng Chen, Liangyu Wang, Yifan Xu, Mateusz Ostaszewski, Dandan Guo, Wenyi Wang, Yanning Dai, Yuhui Wang, Jürgen Schmidhuber

    Preprint

    NoteBank expands the long-context capability of frozen linear attention models with sparse episodic memory and native replay, without additional training.

    † Equal contribution

    sequence modelling, linear attention, long-context memory

  2. Self-Improvements in Modern Agentic Systems: A Survey

    Zhe Ren, Yimeng Chen, Dandan Guo, Guowei Rong, Tonghui Li, R. B. Xiong, Qingfeng Lan, Wenyi Wang, Li Nanbo, Yibo Yang, Mingchen Zhuge, Jürgen Schmidhuber

    arXiv preprint

    A system-level survey of self-improving agents, unifying updates to foundation models and to prompts, memory, tools, and executable control logic.

    self-improvement, agentic systems, survey

  3. Huxley-Gödel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machine

    Wenyi Wang†, Piotr Piękos†, Li Nanbo, Firas Laakom, Yimeng Chen, Mateusz Ostaszewski, Mingchen Zhuge, Jürgen Schmidhuber

    ICLR 2026Oral

    HGM searches over self-modifying coding agents using the performance of their descendants to estimate future improvement potential, rather than selecting only for current ability.

    self-improvement, coding agents, open-endness evolution

2025

  1. FACTS: A Factored State-Space Framework for World Modelling

    Li Nanbo, Firas Laakom, Yucheng Xu, Wenyi Wang, Jürgen Schmidhuber

    ICLR 2025

    FACTS combines graph-structured recurrent memory, learned routing, and selective state-space propagation to model interacting factors across spatial-temporal sequences.

    sequence modelling, world models, structured recurrent memory

2022

2021

2020