The final presentations by teams for the Computational Mechanics Hackathon in June of 2024.

Titles of talks in order:
1. Exploring Hierarchical Structure Representation in Transformer Models through Computational Mechanics
2. Handcrafting a Network to Predict Next Token Probabilities for the Random-Random-XOR Process
3. Steering Model’s Belief States
4. RNNs represent belief state geometry in hidden state
5. Belief State Representations in Transformer Models on Nonergodic Data
6. Investigating the Effect of Model Capacity Constraints on Belief State Representations
7. Looking forward to posterity: what past information is transferred to the future?
8. Unsupervised Recovery of Hidden Markov Models from Transformers with Evolutionary Algorithms

See the associated papers on the following link under "Entries:"
https://www.apartresearch.com/event/c...