AI & ML interests

Building small models for everyone :D

Recent Activity

CompactAI  new activity about 4 hours ago
CompactAI-O/Homepage:AxionLab
CompactAI  updated a collection about 6 hours ago
PRISM Datasets
CompactAI  updated a collection about 6 hours ago
PRISM Datasets
View all activity

Organization Card

CompactAI

We teach tiny neural networks to think. Sometimes they surprise us. Sometimes they just output zeros.

What I Think We Do

We train small AI models from absolute scratch. Every weight begins at nothing. Every parameter earns its place through stubborn repetition and repeated failure. We design architectures that fit on a laptop instead of requiring a small moon for cooling. Our creations handle specific tasks without demanding a power plant.

How We Build Them

We start with completely blank networks that know nothing about the world. We feed them examples. They guess wrong. We sigh and adjust the math. We repeat the cycle until the loss function stops mocking us. Our training rigs sound like struggling ceiling fans. We optimize every single operation because our budget barely covers decent coffee. The result is a lean system that actually runs on consumer hardware.

initialize_weights_to_zero
for epoch in range our_patience
    train_on_data
    watch_loss_curve_cry
    adjust_learning_rate
    hope_for_the_best

Why We Keep Them Small

Massive models consume memory and pretend to understand human emotion. We build modest alternatives. They deploy on everyday machines. They run without requiring a cloud architecture degree. They occasionally mix up a decimal place, but they do so with remarkable efficiency. We believe intelligence works best without a huge data center. We chase practical utility over computational excess.

  • They load instantly on mobile devices
  • They cost pennies to run at scale
  • They never ask for your life story
  • They respect your limited RAM

Getting Started

Read the documentation if we have written any. Download a model if we have released one. Run it on your machine. Watch it do something small, but do it efficiently. If nothing works, blame the random seed.

We are CompactAI. We make small things work. We apologize in advance when they do not. jk.