FlameF0X/trackio-bucket
677 kB
Daniel Fox PRO
FlameF0X
AI & ML interests
Pre-training text generator.
(Brother, im 18)
Please don't try to contact me.
Recent Activity
liked a model about 8 hours ago
Jackrong/Qwopus3.5-4B-Coder-GGUF liked a Space about 9 hours ago
AxiomicLabs/Open_SLM_Leaderboard liked a dataset about 10 hours ago
openbmb/Ultra-FineWeb-L3Organizations
Posts 18
Post
215
I did some testing on the scalability of FWKV. It hits a speed bottleneck at 1B due to the T4’s bandwidth limitations. Theoretically, it should match RWKV’s inference speed if the GPU had more bandwidth. So the 1B size is not accurate.
Post
270
Greetings Hugging Face!
I started a new project called **FWKV** (Feed-forward Weighted Key Value, or Floored Weighted Key Value), a RWKV-style LM that uses FFNNs (Feed-Forward Neural Networks) instead of RNN and
So far I have:
- FlameF0X/FWKV-29M — this one is undertrained and doesn't have a Space yet. In the attached image you can see its speed on a T4 compared to models with the same configuration.
The only model that's fully working right now is:
- FlameF0X/FWKV-TinyStories — trained on TinyStories for one epoch. The demo Space is FlameF0X/FWKV-demo.
I started a new project called **FWKV** (Feed-forward Weighted Key Value, or Floored Weighted Key Value), a RWKV-style LM that uses FFNNs (Feed-Forward Neural Networks) instead of RNN and
floor(W·K·V). I'm hoping to make it much more efficient and scalable than RWKV.So far I have:
- FlameF0X/FWKV-29M — this one is undertrained and doesn't have a Space yet. In the attached image you can see its speed on a T4 compared to models with the same configuration.
The only model that's fully working right now is:
- FlameF0X/FWKV-TinyStories — trained on TinyStories for one epoch. The demo Space is FlameF0X/FWKV-demo.
spaces 15
pinned
Running on Zero
Agents
TerraLM - AI Plays Terraria
🌍
Watch an AI (TerraLM-350M) play a bare-minimum Terraria!
pinned
Sleeping
Agents
HF Community Chat
💬
Join a live community chat with rooms and direct messages
Running
MCP
2
ChessSLM
🦀
Play chess against a GPT‑2 based AI opponent
Running
Agents
FWKV 50M Demo
🦀
Generate AI-written text continuations from a prompt
Running
Agents
1
FWKV Demo
👁
Generate a short story from your prompt
Sleeping
Agents
NanoSR 6x
📚
Upscale images 6x with NanoSR super‑resolution
models 37
FlameF0X/LFM2.5-1.2B-Thinking-CodeX
Text Generation • 1B • Updated • 421 • 1
FlameF0X/LFM2.5-1.2B-Distilled-Claude-4.6
Text Generation • 1B • Updated • 522 • 2
FlameF0X/Qwen3-4B-Distilled-Claude-4.6
Text Generation • 4B • Updated • 82 •
FlameF0X/LFM2.5-1.2B-Distilled-Claude
Text Generation • 1B • Updated • 69 • 1
FlameF0X/ChessSLM
Text Generation • 30.3M • Updated • 138 • 2
FlameF0X/FWKV-50M
Text Generation • 50.6M • Updated • 129
FlameF0X/FWKV-TinyStories
Text Generation • Updated • 1
FlameF0X/FWKV-29M
Text Generation • 28.9M • Updated • 259
FlameF0X/LC1-1.2B-Base
Text Generation • Updated
FlameF0X/TerraLM-350M
Text Generation • 0.4B • Updated • 190
datasets 22
FlameF0X/assets
Viewer • Updated • 3 • 32
FlameF0X/nano-banana-pro-gen-zh-en
Viewer • Updated • 1.25k • 53
FlameF0X/Claude-Sonnet-4.6-4x
Viewer • Updated • 4 • 79 • 1
FlameF0X/TerraLM-train
Viewer • Updated • 1.2M • 65
FlameF0X/NanoSR
Viewer • Updated • 1.6k • 1.43k • 1
FlameF0X/TinyTask-BM
Viewer • Updated • 1.48k • 6 • 1
FlameF0X/Traces-Test
Viewer • Updated • 1 • 8
FlameF0X/Claude-Corpus
Viewer • Updated • 41 • 29
FlameF0X/Chess
Viewer • Updated • 200 • 1
FlameF0X/coherence-RLAIF
Viewer • Updated • 49 • 11