History Replays Itself: Unleashing Long-Context Capability in Linear Attention
Preprint
NoteBank expands the long-context capability of frozen linear attention models with sparse episodic memory and native replay, without additional training.
† Equal contribution