AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
Paper • 2306.00978 • Published • 17
estudo-continuo
-
-
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
Paper • 2210.17323 • Published • 13 -
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
Paper • 2208.07339 • Published • 6 -
QLoRA: Efficient Finetuning of Quantized LLMs
Paper • 2305.14314 • Published • 65 -
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Paper • 2402.17764 • Published • 632 -
Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection
Paper • 2302.12173 • Published • 1 -
Ignore Previous Prompt: Attack Techniques For Language Models
Paper • 2211.09527 • Published • 1 -
Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations
Paper • 2312.06674 • Published • 10 -
Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads
Paper • 2401.10774 • Published • 61 -
Qwen Technical Report
Paper • 2309.16609 • Published • 40