🔄 In a Training Loop

Joseph Jones PRO

KlondikeDev

19 1 17

https://oc.kunix.org/

AI & ML interests

Restoring the Digital Millennium. https://kunix.org/digital-millennium.html

Recent Activity

reacted to Bc-AI's post with 🔥 14 minutes ago

Hello everyone! A small update on things: 1. G1 series status. G1 is training nicely, and the loss is dropping nicely. The metrics are publicly available and i made a small space you can use to see the nice graphs: https://huggingface.co/spaces/hugging-science/Loss-Plot-G1-Large G1-MINI is a lot slower in converging for reasons unknown yet, but we are investigating it. 2. I have built a small chat app for open SLMs here: https://huggingface.co/spaces/ml-intern-explorers/slm-arena Feel free to add your models in a pull request! That's all for now, early G1 versions will be available for beta testers soon. Thanks to our beta testers: @guardamarcos @Timmy6767 @MUK-IS-GOAT @smilyai-large-team @Sbui503 @Banaxi-Tech @Bc-AI @atom77777 @Harley-ml @Datdanboi25 @Fishtiks @smartdigitalnetworks @vovaRL @EmetTheGolum @juiceb0xc0de @ProCreations

repliedto their post about 17 hours ago

A Preview of Boris-2! Hello! Tomorrow, OpenCerebral will be releasing Boris-1.7-D60M-n30M — an experimental architecture. It will be testing a new data mixture, a new tokenizer, and testing Qwen4-like n-gram embeddings. Following this will be Boris-1.8-D60M-n30M, which will test both the n-gram embeddings AND a new architecture. Then, Boris-2 will begin training! Edit: the model is OUT NOW! https://huggingface.co/opencerebral/Boris-1.7-D60M-n30M

repliedto their post 1 day ago

View all activity

Organizations

Posts 6

Post

1384

Boris-1.7-D60M-n30M out NOW!

opencerebral/Boris-1.7-D60M-n30M

Following this will be Boris-1.8-D60M-n30M, which will test both the n-gram embeddings AND a new architecture.

Then, Boris-2 will begin training!

Post

3364

A Preview of Boris-2!

Hello! Tomorrow, OpenCerebral will be releasing Boris-1.7-D60M-n30M — an experimental architecture. It will be testing a new data mixture, a new tokenizer, and testing Qwen4-like n-gram embeddings.

Following this will be Boris-1.8-D60M-n30M, which will test both the n-gram embeddings AND a new architecture.

Then, Boris-2 will begin training!

Edit: the model is OUT NOW! opencerebral/Boris-1.7-D60M-n30M