sz14/cRia-LM-75M
Text Generation • 75.7M • Updated • 2.5k • 8
🔄 In a Training Loop
Mr Munk
GODELEV
AI & ML interests
High schooler by day, LLM builder by night. Driven by a deep love for both Physics and AI. Currently spending my runtime building on Hugging Face, experimenting with transformer architectures, and training custom LLMs.
Recent Activity
liked a model 2 days ago
sz14/cRia-LM-75M liked a model 2 days ago
fromziro/TinyImageGen-0.6M liked a model 4 days ago
fromziro/Sentimental-Mini-0.2MOrganizations
liked 2
models 2 days ago
liked 2
models 4 days ago
liked a
Space 4 days ago
updated a
Space 5 days ago
liked a
model 7 days ago
published a
Space 7 days ago
published a
dataset 7 days ago
updated a
dataset 7 days ago
reacted to KlondikeDev's post with 🔥 7 days ago
Post
2398
Boris-1.7-D60M-n30M out NOW!
opencerebral/Boris-1.7-D60M-n30M
Following this will be Boris-1.8-D60M-n30M, which will test both the n-gram embeddings AND a new architecture.
Then, Boris-2 will begin training!
opencerebral/Boris-1.7-D60M-n30M
Following this will be Boris-1.8-D60M-n30M, which will test both the n-gram embeddings AND a new architecture.
Then, Boris-2 will begin training!
reacted to Banaxi-Tech's post with 🔥 8 days ago
Post
2889
We're excited to release BananaMind 2.1 Pico Preview!
It includes the first preview of our BananaMind 2.1 architecture!
This model gets near BananaMind 2 Micro performance at half the parameters and 37.5x less tokens!
Thats insane!
The current architectures includes about 500K parameters of the total 1.5M parameters in n-gram embeddings and the layer 2 is run twice.
It also includes XSA and the XSA refresh gate.
We're still going to improve the architecture in the final release.
Check it out at:
Follow us for more models:
BananaMind
@Banaxi-Tech
@vovaRL
@DedeProGames
It includes the first preview of our BananaMind 2.1 architecture!
This model gets near BananaMind 2 Micro performance at half the parameters and 37.5x less tokens!
Thats insane!
The current architectures includes about 500K parameters of the total 1.5M parameters in n-gram embeddings and the layer 2 is run twice.
It also includes XSA and the XSA refresh gate.
We're still going to improve the architecture in the final release.
Check it out at:
Follow us for more models:
@Banaxi-Tech
@vovaRL
@DedeProGames
- 3 replies
liked a
model 9 days ago
reacted to KlondikeDev's post with 🔥 9 days ago
Post
3451
A Preview of Boris-2!
Hello! Tomorrow, OpenCerebral will be releasing Boris-1.7-D60M-n30M — an experimental architecture. It will be testing a new data mixture, a new tokenizer, and testing Qwen4-like n-gram embeddings.
Following this will be Boris-1.8-D60M-n30M, which will test both the n-gram embeddings AND a new architecture.
Then, Boris-2 will begin training!
Edit: the model is OUT NOW! opencerebral/Boris-1.7-D60M-n30M
Hello! Tomorrow, OpenCerebral will be releasing Boris-1.7-D60M-n30M — an experimental architecture. It will be testing a new data mixture, a new tokenizer, and testing Qwen4-like n-gram embeddings.
Following this will be Boris-1.8-D60M-n30M, which will test both the n-gram embeddings AND a new architecture.
Then, Boris-2 will begin training!
Edit: the model is OUT NOW! opencerebral/Boris-1.7-D60M-n30M
- 70 replies
liked a
model 9 days ago
Ant1.5-5M
❤️👍 2
2
#2 opened 11 days ago
by Banaxi-Tech
liked a
model 12 days ago
liked a
Space 12 days ago
reacted to appvoid's post with 🔥 13 days ago
Post
2639
Nobody knows what is doing, when you train a model, you are experimenting to advance the frontier, so keep failing 🫵
- 17 replies