Evaluation datasets

community

Activity Feed

AI & ML interests

None defined yet.

lighteval 's collections 9

RULER Datasets SmolLM3-11T-32k-v1-remote-code

RULER Datasets

lighteval/RULER-262144-SmolLM3-11T-32k-v1-remote-code

Viewer • Updated Jun 20, 2025 • 6.5k • 80
lighteval/RULER-131072-SmolLM3-11T-32k-v1-remote-code

Viewer • Updated Jun 20, 2025 • 6.5k • 82
lighteval/RULER-65536-SmolLM3-11T-32k-v1-remote-code

Viewer • Updated Jun 20, 2025 • 6.5k • 67
lighteval/RULER-32768-SmolLM3-11T-32k-v1-remote-code

Viewer • Updated Jun 20, 2025 • 6.5k • 29

RULER Datasets gemma3-base

RULER Datasets

lighteval/RULER-262144-gemma3-base

Viewer • Updated Jun 19, 2025 • 6.5k • 73
lighteval/RULER-131072-gemma3-base

Viewer • Updated Jun 18, 2025 • 6.5k • 26
lighteval/RULER-65536-gemma3-base

Viewer • Updated Jun 18, 2025 • 6.5k • 47
lighteval/RULER-32768-gemma3-base

Viewer • Updated Jun 18, 2025 • 6.5k • 9

RULER Datasets Falcon-H1-3B-Base

tokenized with: `tokenizer.tokenize(text, add_special_tokens=False)`

lighteval/RULER-262144-Falcon-H1-3B-Base

Viewer • Updated Jun 19, 2025 • 6.5k • 66
lighteval/RULER-131072-Falcon-H1-3B-Base

Viewer • Updated Jun 18, 2025 • 6.5k • 41
lighteval/RULER-65536-Falcon-H1-3B-Base

Viewer • Updated Jun 18, 2025 • 6.5k • 36
lighteval/RULER-32768-Falcon-H1-3B-Base

Viewer • Updated Jun 18, 2025 • 6.5k • 59

RULER Datasets Qwen2.5-Instruct

msg = [{"role": "user", "content": text}] tokenizer.apply_chat_template(msg, add_special_tokens=True, tokenize=True)

lighteval/RULER-262144-Qwen2.5-Instruct

Viewer • Updated Jun 19, 2025 • 6.5k • 79
lighteval/RULER-131072-Qwen2.5-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 62
lighteval/RULER-65536-Qwen2.5-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 84
lighteval/RULER-32768-Qwen2.5-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 12

RULER Datasets Qwen-3

tokenized with: `tokenizer.tokenize(text, add_special_tokens=False)`

lighteval/RULER-262144-Qwen-3

Viewer • Updated Jun 19, 2025 • 6.5k • 26
lighteval/RULER-131072-Qwen-3

Viewer • Updated Jun 18, 2025 • 6.5k • 43
lighteval/RULER-65536-Qwen-3

Viewer • Updated Jun 18, 2025 • 6.5k • 31
lighteval/RULER-32768-Qwen-3

Viewer • Updated Jun 18, 2025 • 6.5k • 219

RULER Datasets gemma3-instruct

RULER Datasets

lighteval/RULER-262144-gemma3-instruct

Viewer • Updated Jun 19, 2025 • 6.5k • 75
lighteval/RULER-131072-gemma3-instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 72
lighteval/RULER-65536-gemma3-instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 44
lighteval/RULER-32768-gemma3-instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 82

RULER Datasets Falcon-H1-3B-Instruct

RULER Datasets

lighteval/RULER-262144-Falcon-H1-3B-Instruct

Viewer • Updated Jun 19, 2025 • 6.5k • 60
lighteval/RULER-131072-Falcon-H1-3B-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 38
lighteval/RULER-65536-Falcon-H1-3B-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 31
lighteval/RULER-32768-Falcon-H1-3B-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 22

RULER Datasets Lamma3-Instruct

msg = [{"role": "user", "content": text}] tokenizer.apply_chat_template(msg, add_special_tokens=True, tokenize=True)

lighteval/RULER-262144-Lamma3-Instruct

Viewer • Updated Jun 19, 2025 • 6.5k • 60
lighteval/RULER-131072-Lamma3-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 70
lighteval/RULER-65536-Lamma3-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 14
lighteval/RULER-32768-Lamma3-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 37

RULER Datasets Qwen-3-Instruct

msg = [{"role": "user", "content": text}] tokenizer.apply_chat_template(msg, add_special_tokens=True, tokenize=True)

lighteval/RULER-262144-Qwen-3-Instruct

Viewer • Updated Jun 19, 2025 • 6.5k • 33
lighteval/RULER-131072-Qwen-3-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 32
lighteval/RULER-65536-Qwen-3-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 36
lighteval/RULER-32768-Qwen-3-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 26 • 3

RULER Datasets SmolLM3-11T-32k-v1-remote-code

RULER Datasets

lighteval/RULER-262144-SmolLM3-11T-32k-v1-remote-code

Viewer • Updated Jun 20, 2025 • 6.5k • 80
lighteval/RULER-131072-SmolLM3-11T-32k-v1-remote-code

Viewer • Updated Jun 20, 2025 • 6.5k • 82
lighteval/RULER-65536-SmolLM3-11T-32k-v1-remote-code

Viewer • Updated Jun 20, 2025 • 6.5k • 67
lighteval/RULER-32768-SmolLM3-11T-32k-v1-remote-code

Viewer • Updated Jun 20, 2025 • 6.5k • 29

RULER Datasets gemma3-instruct

RULER Datasets

lighteval/RULER-262144-gemma3-instruct

Viewer • Updated Jun 19, 2025 • 6.5k • 75
lighteval/RULER-131072-gemma3-instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 72
lighteval/RULER-65536-gemma3-instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 44
lighteval/RULER-32768-gemma3-instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 82

RULER Datasets gemma3-base

RULER Datasets

lighteval/RULER-262144-gemma3-base

Viewer • Updated Jun 19, 2025 • 6.5k • 73
lighteval/RULER-131072-gemma3-base

Viewer • Updated Jun 18, 2025 • 6.5k • 26
lighteval/RULER-65536-gemma3-base

Viewer • Updated Jun 18, 2025 • 6.5k • 47
lighteval/RULER-32768-gemma3-base

Viewer • Updated Jun 18, 2025 • 6.5k • 9

RULER Datasets Falcon-H1-3B-Instruct

RULER Datasets

lighteval/RULER-262144-Falcon-H1-3B-Instruct

Viewer • Updated Jun 19, 2025 • 6.5k • 60
lighteval/RULER-131072-Falcon-H1-3B-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 38
lighteval/RULER-65536-Falcon-H1-3B-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 31
lighteval/RULER-32768-Falcon-H1-3B-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 22

RULER Datasets Falcon-H1-3B-Base

tokenized with: `tokenizer.tokenize(text, add_special_tokens=False)`

lighteval/RULER-262144-Falcon-H1-3B-Base

Viewer • Updated Jun 19, 2025 • 6.5k • 66
lighteval/RULER-131072-Falcon-H1-3B-Base

Viewer • Updated Jun 18, 2025 • 6.5k • 41
lighteval/RULER-65536-Falcon-H1-3B-Base

Viewer • Updated Jun 18, 2025 • 6.5k • 36
lighteval/RULER-32768-Falcon-H1-3B-Base

Viewer • Updated Jun 18, 2025 • 6.5k • 59

RULER Datasets Lamma3-Instruct

msg = [{"role": "user", "content": text}] tokenizer.apply_chat_template(msg, add_special_tokens=True, tokenize=True)

lighteval/RULER-262144-Lamma3-Instruct

Viewer • Updated Jun 19, 2025 • 6.5k • 60
lighteval/RULER-131072-Lamma3-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 70
lighteval/RULER-65536-Lamma3-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 14
lighteval/RULER-32768-Lamma3-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 37

RULER Datasets Qwen2.5-Instruct

msg = [{"role": "user", "content": text}] tokenizer.apply_chat_template(msg, add_special_tokens=True, tokenize=True)

lighteval/RULER-262144-Qwen2.5-Instruct

Viewer • Updated Jun 19, 2025 • 6.5k • 79
lighteval/RULER-131072-Qwen2.5-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 62
lighteval/RULER-65536-Qwen2.5-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 84
lighteval/RULER-32768-Qwen2.5-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 12

RULER Datasets Qwen-3-Instruct

msg = [{"role": "user", "content": text}] tokenizer.apply_chat_template(msg, add_special_tokens=True, tokenize=True)

lighteval/RULER-262144-Qwen-3-Instruct

Viewer • Updated Jun 19, 2025 • 6.5k • 33
lighteval/RULER-131072-Qwen-3-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 32
lighteval/RULER-65536-Qwen-3-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 36
lighteval/RULER-32768-Qwen-3-Instruct

Viewer • Updated Jun 18, 2025 • 6.5k • 26 • 3

RULER Datasets Qwen-3

tokenized with: `tokenizer.tokenize(text, add_special_tokens=False)`

lighteval/RULER-262144-Qwen-3

Viewer • Updated Jun 19, 2025 • 6.5k • 26
lighteval/RULER-131072-Qwen-3

Viewer • Updated Jun 18, 2025 • 6.5k • 43
lighteval/RULER-65536-Qwen-3

Viewer • Updated Jun 18, 2025 • 6.5k • 31
lighteval/RULER-32768-Qwen-3

Viewer • Updated Jun 18, 2025 • 6.5k • 219

AI & ML interests

Team members 7

lighteval 's collections 9