#
mid-training
Here are 4 public repositories matching this topic...
[๐๐๐ ๐ ๐ฎ๐ฌ๐ฎ๐ฒ] Dispersion loss counteracts embedding condensation and improves generalization in small language models
dispersion cosine-similarity embedding manifold-learning icml condensation latent-space pre-training embedding-vectors dispersive large-language-models llm geometric-learning llms llm-training small-language-models mid-training icml-2026 embedding-condensation
-
Updated
Jun 21, 2026 - Python
Official code, models, and dataset for "Evolution Fine-Tuning (EFT): Learning to Discover Across 371 Optimization Tasks"
-
Updated
Jun 30, 2026 - Python
Open catalog of datasets used to train and align LLMs across pretraining, mid-training, and post-training.
-
Updated
Jan 6, 2026 - Python
Improve this page
Add a description, image, and links to the mid-training topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the mid-training topic, visit your repo's landing page and select "manage topics."