RedHatAI/Phi-3-mini-128k-instruct-quantized.w8a16
Text Generation • 4B • Updated • 51
AI & ML interests
OpenSource and AI
Recent Activity
View all activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/Phi-3-mini-128k-instruct-quantized.w4a16
Text Generation • 4B • Updated • 35 • 1
RedHatAI/Phi-3-mini-128k-instruct-FP8
Text Generation • 4B • Updated • 71
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a8
Text Generation • 14B • Updated • 35 • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a16
Text Generation • 14B • Updated • 58 • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w4a16
Text Generation • 14B • Updated • 158 • 3
RedHatAI/Phi-3-medium-128k-instruct-FP8
Text Generation • 14B • Updated • 44 • 5
RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w8a16
Text Generation • 12B • Updated • 23
RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w4a16
Text Generation • 12B • Updated • 722 • 4
RedHatAI/Mistral-Large-Instruct-2407-FP8
Text Generation • 123B • Updated • 62
RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w8a8
Text Generation • 7B • Updated • 107 • 2
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8
Text Generation • 8B • Updated • 782 • 5
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a16
Text Generation • 8B • Updated • 37 • 1
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 11.7k • 20
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16
Text Generation • 8B • Updated • 693 • 12
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8
Text Generation • 8B • Updated • 54.9k • 45
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a8
Text Generation • 71B • Updated • 22
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a16
Text Generation • 71B • Updated • 21
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8
Text Generation • 71B • Updated • 786 • 21
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16
Text Generation • 71B • Updated • 64 • 5
RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8-dynamic
Text Generation • 71B • Updated • 537 • 7
RedHatAI/Meta-Llama-3.1-70B-FP8
Text Generation • 71B • Updated • 689 • 3
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a8
Text Generation • 406B • Updated • 52 • 2
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16
Text Generation • 406B • Updated • 66 • 2
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16
Text Generation • 406B • Updated • 88 • 11
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8-dynamic
Text Generation • 406B • Updated • 3.43k • 15
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8
Text Generation • 406B • Updated • 668 • 31
RedHatAI/Meta-Llama-3.1-405B-FP8
Text Generation • Updated • 61
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 1.04k • 2
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a8
Text Generation • 71B • Updated • 21