Relreps
Relative representations can be leveraged to enable solving tasks regarding "latent communication": from zero-shot model stitching to latent space comparison between diverse settings.
Install / Use
/learn @lucmos/RelrepsREADME
Relative representations enable zero-shot latent space communication
Slides | OpenReview | arXiv | BibTeX
<p align="center"> <img alt="NN Template" src="./data/assets/teaser.gif"> </p>Luca Moschella*, Valentino Maiorca*, Marco Fumero, Antonio Norelli, Francesco Locatello, Emanuele Rodolà
* equal contribution
Installation
<p align="left"> <a href="https://github.com/grok-ai/nn-template"><img alt="NN Template" src="https://shields.io/badge/nn--template-0.2.1-emerald?style=flat&labelColor=gray"></a> <a href="https://www.python.org/downloads/"><img alt="Python" src="https://img.shields.io/badge/python-3.9-blue.svg"></a> <a href="https://black.readthedocs.io/en/stable/"><img alt="Code style: black" src="https://img.shields.io/badge/code%20style-black-000000.svg"></a> </p>pip install git+ssh://git@github.com/lucmos/relreps.git
Quickstart
Development installation
Setup the development environment:
git clone git@github.com:lucmos/relreps.git
cd relreps
conda env create -f env.yaml
conda activate relreps
pre-commit install
dvc pull
Refer to the template documentation for an high level overview of the code structure.
Update the dependencies
Re-install the project in edit mode:
pip install -e .[dev]
BibTeX
@inproceedings{
moschella2023relative,
title={Relative representations enable zero-shot latent space communication},
author={Luca Moschella and Valentino Maiorca and Marco Fumero and Antonio Norelli and Francesco Locatello and Emanuele Rodol{\`a}},
booktitle={The Eleventh International Conference on Learning Representations },
year={2023},
url={https://openreview.net/forum?id=SrC-nwieGJ}
}
