OpenBA-V2: 3B LLM (Large Language Model) with T5 architecture, utilizing model pruning technique and continuing pretraining from OpenBA-15B.
-
Updated
May 10, 2024 - Python
#
train-from-scratch
Here are 3 public repositories matching this topic...
pytorch implementation of several CNNs for image classification
cnn pytorch imagenet image-classification resnet cifar resnext pretrained-weights senet cbam sknet train-from-scratch
-
Updated
Jul 12, 2020 - Python
Experimental GPT-2 scale (~124M param) LLM trained from scratch. Trained on 22B tokens od Cosmopedia Dataset. Includes full training pipeline, with SFT FineTuning and log analysis tools with backend and frontend and deployment
nlp tokenizer pytorch transformer llama language-model nlp-machine-learning sft gpt2 train-from-scratch llm bitsandbytes openhermes flashattention cosmopedia
-
Updated
May 15, 2026 - Python
Improve this page
Add a description, image, and links to the train-from-scratch topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the train-from-scratch topic, visit your repo's landing page and select "manage topics."