Multilingual Backpack LMs

An exploration of multilingual language models, from training to comparative evaluation.
- Question
- How can language models be studied beyond dominant corpora and languages?
- Approach
- Training and comparatively evaluating a Backpack architecture for multilingual data.
- Tools
- Python · PyTorch · Transformers · language modelling