<img src="./images/spins.png" width="400px"></img>

Approximate Free-Energy Minimization

Experimental implementation of approximate free-energy minimization in PyTorch.

Blog post: Transformers from Spin Models: Approximate Free Energy Minimization

Setup

Install package in editable mode:

$ pip install -e .

Run (very slow) tests with:

$ python -m unittest