No, we don't have enough compute ๐
Banaxi PRO
Banaxi-Tech
P(doom) 10%
AI & ML interests
SLMs, training from scratch, LoRA, TTS, Ternary models. AI Interpretability. BCI. Contact at banaxitech@gmail.com
Recent Activity
updated a bucket about 5 hours ago
Banaxi-Tech/bananamind-arena-logs repliedto their post about 6 hours ago
We're introducing ACR 1.0.
We trained this model on a 5070 Ti for weeks, here are some of the architecture details:
57M parameters, with one M and one G stream.
When we tested it on benchmarks, we got these results:
Benchmark Full G-Only Delta
PIQA 62.24% 53.43% +8.81
ARC-Easy 41.96% 32.28% +9.68
HellaSwag 33.19% 29.08% +4.11
Tiny ToM 40.65% 33.75% +6.90
ArithMark 3.0 33.40% 32.80% +0.60
Base Bench 1.1 51.71% 40.29% +11.42
Check it out at https://huggingface.co/saicr/ACR-1.0 published a model about 8 hours ago
Refract-Labs/Orion-Flagship-Nano-T2.1