ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF
Image-Text-to-Text • 27B • Updated • 1.52M • 2.07k
Marcin Wolny
MarcinEU
P(doom) 1%
AI & ML interests
Applications, local onnx.
Recent Activity
liked a model 1 day ago
ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF liked a model 2 days ago
ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-GGUF updated a model 2 days ago
MarcinEU/Ideogram-4-INT4-AWQ-GPTQ-G32-embed8-16GB-VRAM-ONNXOrganizations
None yet
liked a
model 1 day ago
liked a
model 2 days ago
updated a
model 2 days ago
published a
model 2 days ago
updated a
model 2 days ago
reacted to Undi95's post with 🔥 3 days ago
Post
4195
Yo, I'm back, and I'm currently trying to teach a local LLM to stop waiting for a prompt kek.
I'm building a small proof of concept: can an open-weight model (Qwen3.8-27B, running locally on 2 RTX 5090 GPUs) learn to direct itself, then improve from its own exploration, without a human in the loop and without breaking it for normal use?
No user, no task. The model only gets observations from its environment. Each turn, it writes its own agenda (goal/open questions/next step), then picks an action: search the web, read a page, or take a note.
The environment is the judge, not another LLM. A note is accepted only if it quotes the page it read word for word. Facts are checked by exact match.
Later, code will be checked by actually running tests.
The best episodes become fine-tuning data (LoRA). The helper system prompt is removed at training time, so the behavior has to live in the weights.
Each new model goes through a fixed benchmark gate: math, general knowledge, "does it still answer humans normally?", autonomy, and learned facts on held-out sources. It's kept only if nothing regresses, otherwise it's discarded. Then the loop starts again.
The full pipeline works end to end: collect, train, merge, deploy, benchmark. The baseline is clear. Without any instructions, the base model's real autonomy is zero: it behaves like a chatbot waiting for a question. That's the number this small project is trying to move.
I haven't found a public tool that runs this whole loop (self-directed exploration, verifiable rewards, continual fine-tuning and a regression gate) on home hardware. The goal isn't AGI in a bedroom. It's to show that anyone can try it, measure it honestly, and see where it breaks.
Code and results will be released once the first real iterations are done. At the moment the code is... running, but made with scotch and stick, still only a PoC I want to try.
Did you already tried something like that? What was your result? I'm curious!
I'm building a small proof of concept: can an open-weight model (Qwen3.8-27B, running locally on 2 RTX 5090 GPUs) learn to direct itself, then improve from its own exploration, without a human in the loop and without breaking it for normal use?
No user, no task. The model only gets observations from its environment. Each turn, it writes its own agenda (goal/open questions/next step), then picks an action: search the web, read a page, or take a note.
The environment is the judge, not another LLM. A note is accepted only if it quotes the page it read word for word. Facts are checked by exact match.
Later, code will be checked by actually running tests.
The best episodes become fine-tuning data (LoRA). The helper system prompt is removed at training time, so the behavior has to live in the weights.
Each new model goes through a fixed benchmark gate: math, general knowledge, "does it still answer humans normally?", autonomy, and learned facts on held-out sources. It's kept only if nothing regresses, otherwise it's discarded. Then the loop starts again.
The full pipeline works end to end: collect, train, merge, deploy, benchmark. The baseline is clear. Without any instructions, the base model's real autonomy is zero: it behaves like a chatbot waiting for a question. That's the number this small project is trying to move.
I haven't found a public tool that runs this whole loop (self-directed exploration, verifiable rewards, continual fine-tuning and a regression gate) on home hardware. The goal isn't AGI in a bedroom. It's to show that anyone can try it, measure it honestly, and see where it breaks.
Code and results will be released once the first real iterations are done. At the moment the code is... running, but made with scotch and stick, still only a PoC I want to try.
Did you already tried something like that? What was your result? I'm curious!
- 21 replies
updated a
model 4 days ago
published a
model 4 days ago
liked a
model 4 days ago
liked 3
models 11 days ago
liked 2
models 16 days ago
liked a
model 17 days ago
liked 2
models 18 days ago
liked a
dataset 20 days ago
liked a
model 21 days ago
liked a
model 23 days ago
