nm-testing/tinyllama-one-shot-w4a16-group-packed
Text Generation • 1B • Updated • 146
NM Testing
company
AI & ML interests
None defined yet.
Recent Activity
View all activity
nm-testing/tinyllama-marlin24-w4a16-group128
Text Generation • 0.3B • Updated • 147
nm-testing/nonuniform
Text Generation • 8B • Updated • 144
nm-testing/llama7b-one-shot-2_4-w4a16-marlin24-t-alt
Text Generation • 0.9B • Updated • 145
nm-testing/llama7b-one-shot-2_4-w4a16-marlin24-t
Text Generation • 1B • Updated • 298 • 1
nm-testing/llama3-8b-w8_channel-a8_tensor-compressed
Text Generation • 8B • Updated • 146
nm-testing/llama-3-instruct-w8a8-dyn-per-token-test
Text Generation • 8B • Updated • 146
nm-testing/granite-8b-code-instruct-128k2of4-W8A8-FP8-Dynamic-Per-Token
8B • Updated • 14
nm-testing/granite-3.1-8b-instruct2of4-W8A8-FP8-Dynamic-Per-Token
8B • Updated • 14
nm-testing/TinyLlama-1.1B-Chat-v1.0-kvcache-fp8-tensor
1B • Updated • 5.55k
nm-testing/TinyLlama-1.1B-Chat-v1.0-kvcache-fp8-attn_head
1B • Updated • 5.2k
nm-testing/TinyLlama-1.1B-Chat-v1.0-kv_cache_default_tinyllama-e2e
1B • Updated • 55
nm-testing/SmolLM-360M-Instruct-quantized.w4a16
0.4B • Updated • 12
nm-testing/SmolLM-135M-Instruct-quantized.w4a16
Text Generation • 0.2B • Updated • 299
nm-testing/Qwen2-1.5B-Instruct-FP8W8
Text Generation • 2B • Updated • 4.91k
nm-testing/Qwen2-0.5B-Instruct
Text Generation • 0.6B • Updated • 145
nm-testing/Phi-3-mini-4k-instruct-kv_cache_default_phi3-e2e
4B • Updated • 68
nm-testing/Phi-3-mini-128k-instruct-FP8
4B • Updated • 993
nm-testing/Mixtral-8x7B-Instruct-v0.1-W8A16-quantized
47B • Updated • 18
nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-quantized
47B • Updated • 203
nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-channel-quantized
47B • Updated • 23
nm-testing/Mixtral-8x7B-Instruct-v0.1-FP8-quantized
47B • Updated • 15
nm-testing/Mistral-7B-Instruct-v0.32of4-W8A8-FP8-Dynamic-Per-Token
7B • Updated • 15
nm-testing/Meta-llama3-8b-Instruct-quant-FP8
Text Generation • 8B • Updated • 16
nm-testing/Meta-llama3-8b-Instruct-SmoothQuant-Fp8
Text Generation • 8B • Updated • 138
nm-testing/Meta-Llama-3.1-8B-Instruct-FP8-hf
Text Generation • 8B • Updated • 97
nm-testing/Meta-Llama-3-8B-Instruct-spinquantR3-FP8_asym-attn
8B • Updated • 14
nm-testing/Meta-Llama-3-8B-Instruct-nonuniform-test
Text Generation • 8B • Updated • 23.1k
nm-testing/Meta-Llama-3-8B-Instruct-attention-fp8
8B • Updated • 15
nm-testing/Meta-Llama-3-8B-Instruct-W8A8-FP8-Channelwise-compressed-tensors
Text Generation • 8B • Updated • 35 • 2