DaisyChain-Web
🌼
7
Train a shared model P2P by opening a browser tab
C.Bysk
ChBysk
AI & ML interests
None yet
Recent Activity
liked a Space 1 day ago
Quazim0t0/DaisyChain-Web liked a dataset 1 day ago
markov-ai/gaming-500-hours updated a Space 1 day ago
ChBysk/Lora_merger_bet2Organizations
None yet
liked a
Space 1 day ago
liked a
dataset 1 day ago
updated a
Space 1 day ago
reacted to Quazim0t0's post with 👍❤️ 1 day ago
Post
4895
🌼 DaisyChain-Web: train a language model with friends or by yourself with multiple devices, in the browser, no install
Open a webpage, share a room link, and every device that joins becomes part of the training cluster. Phones, laptops, old PCs: they connect peer-to-peer over WebRTC and train one shared transformer together, entirely in the browser.
What's actually happening under the hood:
🧠 A mini transformer LM trains on FineWeb-Edu, streamed live from the HuggingFace Hub. Each device pulls its own slice (data parallelism), tokenized with our 16.5k-token Spikewhale tokenizer
⚡ Every single multiply runs through verified INT8 neural units, no float fallback. On WebGPU browsers it uses the GPU's DP4A integer dot-product hardware, admitted only after proving bit-identical results against the verified units, with a 3×INT8 fast-accurate scheme (CUTLASS's 3xTF32 trick, ported to 8-bit)
🔒 Devices average gradients every step under a sync guard: a per-step roster protocol plus weight-hash verification keeps every device's model bit-identical. If anything drifts, training stops instead of silently forking
📊 Live logs show exactly what every device contributes, step by step
💾 When you're done: test generations right on the page, download a checkpoint, or grab the inference kit, a single self-contained HTML file with the weights baked in that runs generations offline, anywhere
Works solo too. Every extra device just grows the effective batch.
👉 Try it: Quazim0t0/DaisyChain-Web
🛠 Training framework: DaisyChainAI/DaisyChain-Train
Proof of concept: only train with devices you trust. Feedback welcome!
Open a webpage, share a room link, and every device that joins becomes part of the training cluster. Phones, laptops, old PCs: they connect peer-to-peer over WebRTC and train one shared transformer together, entirely in the browser.
What's actually happening under the hood:
🧠 A mini transformer LM trains on FineWeb-Edu, streamed live from the HuggingFace Hub. Each device pulls its own slice (data parallelism), tokenized with our 16.5k-token Spikewhale tokenizer
⚡ Every single multiply runs through verified INT8 neural units, no float fallback. On WebGPU browsers it uses the GPU's DP4A integer dot-product hardware, admitted only after proving bit-identical results against the verified units, with a 3×INT8 fast-accurate scheme (CUTLASS's 3xTF32 trick, ported to 8-bit)
🔒 Devices average gradients every step under a sync guard: a per-step roster protocol plus weight-hash verification keeps every device's model bit-identical. If anything drifts, training stops instead of silently forking
📊 Live logs show exactly what every device contributes, step by step
💾 When you're done: test generations right on the page, download a checkpoint, or grab the inference kit, a single self-contained HTML file with the weights baked in that runs generations offline, anywhere
Works solo too. Every extra device just grows the effective batch.
👉 Try it: Quazim0t0/DaisyChain-Web
🛠 Training framework: DaisyChainAI/DaisyChain-Train
Proof of concept: only train with devices you trust. Feedback welcome!
- 5 replies
liked a
model 1 day ago
liked a
model 3 days ago
liked a
Space 3 days ago
reacted to SeaWolf-AI's post with 🔥 4 days ago
Post
5303
🔵 VKUE — No GPU? Runs anyway.
"Frontier models need a datacenter GPU" rests on a hidden assumption: that the model reads ALL its parameters every token. Decode is memory-bandwidth bound — sweep 34B params/token and an 8 GB card dies at 1–2 tok/s.
So we ran ONE 34.7B reasoning model — Ourbox-35B-JGOS, a sparse Mixture-of-Experts — as the identical weights across the whole hardware spectrum. All measured:
• B200: 18,057 tok/s (aggregate)
• 1× A10G: 126 tok/s
• 8 GB laptop (RTX 5060): 20 tok/s
• GPU-less CPU: 17 tok/s
Why it works: Ourbox holds 34.7B params but only ~3B are active per token (256 experts, top-8). Since decode is bandwidth-bound, a dense 34B moves ~16.7 GB/token while Ourbox moves ~1.45 GB — ~11× less traffic. Put the experts in system RAM, keep attention/router/shared on the GPU, and a 34.7B reasoner runs on an 8 GB laptop — or no GPU at all.
Sparsity alone, proven (same laptop, same quant, ~same footprint): Ourbox-35B (A3B) 20.01 tok/s vs Qwen2.5-32B (dense) 5.36 → 3.7× from sparsity alone, ~2× the best dense-32B on any 8 GB machine. Not a toy: GPQA Diamond 86.4% (maj@8).
Try it live (same prompt, GPU vs GPU-less CPU, live tok/s). Honest scope: one machine's measurements; the CPU path proves it RUNS without a GPU, not that it beats one.
📝 Article: https://huggingface.co/blog/FINAL-Bench/vkue
🔵 GPU vs CPU demo: https://final-bench-ourbox-35b-vkue-demo.hf.space/
🔵 CPU-only demo: https://final-bench-ourbox-35b-vkue-cpu.hf.space
📊 VKUE leaderboard: FINAL-Bench/VKUE
🤗 Model: FINAL-Bench/Ourbox-35B-JGOS-GGUF
⚡ VKAE (speed): VIDraft/vkae
VKUE is the "runs anywhere" side of our serving line; VKAE the "fast on datacenter GPUs" side. VKAE is fast; VKUE is everywhere.
"Frontier models need a datacenter GPU" rests on a hidden assumption: that the model reads ALL its parameters every token. Decode is memory-bandwidth bound — sweep 34B params/token and an 8 GB card dies at 1–2 tok/s.
So we ran ONE 34.7B reasoning model — Ourbox-35B-JGOS, a sparse Mixture-of-Experts — as the identical weights across the whole hardware spectrum. All measured:
• B200: 18,057 tok/s (aggregate)
• 1× A10G: 126 tok/s
• 8 GB laptop (RTX 5060): 20 tok/s
• GPU-less CPU: 17 tok/s
Why it works: Ourbox holds 34.7B params but only ~3B are active per token (256 experts, top-8). Since decode is bandwidth-bound, a dense 34B moves ~16.7 GB/token while Ourbox moves ~1.45 GB — ~11× less traffic. Put the experts in system RAM, keep attention/router/shared on the GPU, and a 34.7B reasoner runs on an 8 GB laptop — or no GPU at all.
Sparsity alone, proven (same laptop, same quant, ~same footprint): Ourbox-35B (A3B) 20.01 tok/s vs Qwen2.5-32B (dense) 5.36 → 3.7× from sparsity alone, ~2× the best dense-32B on any 8 GB machine. Not a toy: GPQA Diamond 86.4% (maj@8).
Try it live (same prompt, GPU vs GPU-less CPU, live tok/s). Honest scope: one machine's measurements; the CPU path proves it RUNS without a GPU, not that it beats one.
📝 Article: https://huggingface.co/blog/FINAL-Bench/vkue
🔵 GPU vs CPU demo: https://final-bench-ourbox-35b-vkue-demo.hf.space/
🔵 CPU-only demo: https://final-bench-ourbox-35b-vkue-cpu.hf.space
📊 VKUE leaderboard: FINAL-Bench/VKUE
🤗 Model: FINAL-Bench/Ourbox-35B-JGOS-GGUF
⚡ VKAE (speed): VIDraft/vkae
VKUE is the "runs anywhere" side of our serving line; VKAE the "fast on datacenter GPUs" side. VKAE is fast; VKUE is everywhere.
- 6 replies
upvoted an article about 2 months ago
Article
SDXL in 4 steps with Latent Consistency LoRAs
- +5
pcuenq, valhalla, SimianLuo, dg845, tyq1024, sayakpaul, multimodalart
• • 16 liked 2
datasets about 2 months ago
Create app.py
#1 opened 4 months ago
by ChBysk
published a
Space 4 months ago
liked 2
models 4 months ago
updated a
Space 4 months ago
published a
Space 4 months ago
updated a
Space 4 months ago
published a
Space 4 months ago