#

dipaco

Here is 1 public repository matching this topic...

MasonFlint44 / OpenDiPaCo

An open implementation of DiPaCo (Distributed Path Composition) for modular, low-communication language-model training — validated on GPU.

deep-learning pytorch language-models distributed-training mixture-of-experts llm diloco dipaco low-communication-training

Updated Jun 17, 2026
Python

Improve this page

Add a description, image, and links to the dipaco topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the dipaco topic, visit your repo's landing page and select "manage topics."