Hi, I’m Siyuan Qi. Welcome to my blog.
I co-founded Gyges Labs, a startup building wearable AI to empower humans.
Most of my work is about creating AI; most of my thoughts are about what it means to be human. This blog is where those worlds collide.
Posts
13 Sep 2025
The Impossibility of a Perfect Memory Token
To get a truly continuous personal agent, we’d love a model with infinite memory. A tempting idea is to fold long histories into a single perfect memory token without changing any future logits. Under softmax attention, however, this is mathematically impossible.