Massimiliano PRO
Bayway
AI & ML interests
None yet
Recent Activity
reacted to jiteshkprasad's post with 🔥 1 day ago
Last week we released Gargi, a 384M English language model trained from scratch on about 17B tokens, roughly 1,000× less training data than Qwen2.5-0.5B (~18T tokens, as published by its authors).
What we measured (same harness for every model: lm-evaluation-harness, 0-shot, greedy, each model's start token):
- Base model vs Qwen2.5-0.5B: ARC-Easy 62.8 vs 64.7, ARC-Challenge 32.3 vs 32.4, WinoGrande 54.6 vs 56.1.
- Chat model: thinking on or off; GSM8K 36.0 with thinking on.
- Long inputs: needle-in-a-haystack recall 100% at 8K, 93% at 16K and 90% at 20K tokens, so use it up to about 16K.
Where it falls short: knowledge and everyday common sense still scale with data. MMLU is 25.5 vs 47.3, and it trails on HellaSwag and PIQA. It is not a maths specialist, and it is not safety-tuned: put a moderation layer in front of any public use.
It runs on a laptop: GGUF (Q8_0 at 410 MB, Q4_K_M, f16) and MLX builds.
`ollama run hf.co/udgamlabs/Gargi-GGUF:Q8_0`
Apache-2.0 ·
weights: https://huggingface.co/udgamlabs/Gargi
try it: https://udgamlabs.com/models/gargi
code: https://github.com/udgamlabs/gargi
Named after Gargi Vachaknavi, the Vedic philosopher remembered for asking the hardest questions. reacted to gianlucamazza's post with 🔥 11 days ago
I released my own benchmark sets behind emotional-memory, my library for mood-aware recall in LLM agents. The card opens with the limits: the main set is built to favour the method, and the negative results are listed up front, e.g. on LoCoMo AFT scores F1 0.168 against 0.271 for a naive RAG baseline. Use it to check where affect-conditioned retrieval helps and where it doesn't.
https://huggingface.co/datasets/gianlucamazza/emotional-memory-benchmarks reacted to gianlucamazza's post with 🚀 11 days ago
Upstream models my open-source projects run or my articles discuss. Each note says which it is. thenlper/gte-small is real use: RAGFS embeds file chunks with it locally. The two retrieval models from my RAG article, a cross-encoder re-ranker and a bi-encoder, are examples, labelled as such, not claims of production use.
https://huggingface.co/collections/gianlucamazza/models-used-in-my-projects-6aca0b3201f38f4c264ac9bfOrganizations
None yet