ποΈ Building on HF
AxionLab
AxionLab-official
AI & ML interests
Owner of SupraLabs
Recent Activity
liked a model about 5 hours ago
liodon-ai/Supra2-100M-Instruct-imatrix-GGUF new activity about 18 hours ago
AxiomicLabs/Open_SLM_Leaderboard:Public Execution Policy reacted to Banaxi-Tech's post with π 1 day ago
BananaMind is in the google situation before argon right now, right?Organizations
reacted to Banaxi-Tech's post with π 1 day ago
reacted to appvoid's post with π₯ 1 day ago
Post
3,674
You know, I can't believe we are actually doing it, literally advancing the frontier at the edge! We've come a long way since the first models on open slm leaderboard, and, as many things that change, performance is one of the main things that has exploded.
7 years ago, the best we had was GPT-2. Today, we got 90m models beating smollm2! I can't barely see what a future with increasingly powerful small models will look like.
All I can say is that the best is yet to come. And will be agentic.
7 years ago, the best we had was GPT-2. Today, we got 90m models beating smollm2! I can't barely see what a future with increasingly powerful small models will look like.
All I can say is that the best is yet to come. And will be agentic.
replied to DedeProGames's post 4 days ago
DavidAU's least obvious alt π€£
reacted to DedeProGames's post with π₯π§ ππ€πβ 4 days ago
reacted to DedeProGames's post with π§ ππ₯ 11 days ago
Post
3,449
Meet Supra2.5-Ultra-Preview-001. 230M parameters, ~40.4B training tokens.
SupraLabs has released the first preview of its Supra2.5-Ultra family: a compact, Llama-style base model for text completion and small-model experimentation.
What's inside?
β’ 230M parameters
β’ 32 transformer layers
β’ 2,048-token context window
β’ Grouped Query Attention: 12 attention heads, 4 KV heads
β’ 49,152-token vocabulary
β’ SwiGLU activation, RoPE and tied embeddings
β’ BF16 weights and Hugging Face Transformers support
β’ Apache 2.0 license
Training
The model was trained on approximately 40.4B tokens from FineWeb-Edu, DCLM-Baseline and FineMath using a single A100 SXM.
Reported zero-shot results
β’ HellaSwag: 37.18% normalized accuracy
β’ PIQA: 65.78% accuracy
β’ ARC-Easy: 57.11% accuracy
β’ ARC-Challenge: 26.28% normalized accuracy
Want to experiment?
Code on REPO.
Model, weights and usage example:
SupraLabs/Supra2.5-Ultra-Preview-001
SupraLabs has released the first preview of its Supra2.5-Ultra family: a compact, Llama-style base model for text completion and small-model experimentation.
What's inside?
β’ 230M parameters
β’ 32 transformer layers
β’ 2,048-token context window
β’ Grouped Query Attention: 12 attention heads, 4 KV heads
β’ 49,152-token vocabulary
β’ SwiGLU activation, RoPE and tied embeddings
β’ BF16 weights and Hugging Face Transformers support
β’ Apache 2.0 license
Training
The model was trained on approximately 40.4B tokens from FineWeb-Edu, DCLM-Baseline and FineMath using a single A100 SXM.
Reported zero-shot results
β’ HellaSwag: 37.18% normalized accuracy
β’ PIQA: 65.78% accuracy
β’ ARC-Easy: 57.11% accuracy
β’ ARC-Challenge: 26.28% normalized accuracy
Want to experiment?
Code on REPO.
Model, weights and usage example:
SupraLabs/Supra2.5-Ultra-Preview-001
reacted to mithulaartigala's post with π₯ 12 days ago
replied to DedeProGames's post 12 days ago
Wishing you a strong fresh start with SupraLabs. The focused direction sounds promisingβlooking forward to seeing what you build next.
You are so cool bro ngl
replied to Banaxi-Tech's post 12 days ago
@LH-Tech-AI @AxionLab-official which model are you talking about?
That BGA shitty thing
replied to Banaxi-Tech's post 13 days ago
If you are going to make the same slop shit you already did, you should stop. Please stop using AI to make AI slop.
reacted to Banaxi-Tech's post with π 13 days ago
Post
4,530
Hi everyone, we're back!
And we're releasing something major again now, if you have seen Grok Bot, its very powerful, but there isn't really a local alternative yet.
Today we're releasing Minds, they're personal AI bots that live on your computer.
They can run anywhere, on your phone, on your mac, on windows, and even on linux.
They support OpenAI Oauth as the main integration because most people already have a ChatGPT sub.
But locally, It supports ANY openai compatible api which allows you to setup ollama and llama.cpp and everything else.
It uses Jev for command approval on OpenRouter and Muse Spark Transcribe for transcription.
Its fully Open Source!
Check it out: https://github.com/BananaMind/Minds
And we're releasing something major again now, if you have seen Grok Bot, its very powerful, but there isn't really a local alternative yet.
Today we're releasing Minds, they're personal AI bots that live on your computer.
They can run anywhere, on your phone, on your mac, on windows, and even on linux.
They support OpenAI Oauth as the main integration because most people already have a ChatGPT sub.
But locally, It supports ANY openai compatible api which allows you to setup ollama and llama.cpp and everything else.
It uses Jev for command approval on OpenRouter and Muse Spark Transcribe for transcription.
Its fully Open Source!
Check it out: https://github.com/BananaMind/Minds
reacted to DedeProGames's post with π₯π 14 days ago
Post
5,138
Iβve just left
BananaMind to focus my work on
SupraLabs .
Following some internal pressure from SupraLabs and issues @Banaxi-Tech encountered with certain architectures, I decided it was time to change direction.
I want to thank
BananaMind for inviting me to join their organization and for helping shape my knowledge and passion regarding SLMs.
Now, itβs just me and
SupraLabs .
Following some internal pressure from SupraLabs and issues @Banaxi-Tech encountered with certain architectures, I decided it was time to change direction.
I want to thank
Now, itβs just me and