ποΈ Building on HF
Marc Sun
AI & ML interests
LLM, Quantization, Training, Inference
Recent Activity
updated a model 3 days ago
marcsun13/topk updated a model 7 days ago
marcsun13/ggml-norm updated a model 7 days ago
marcsun13/ggml-attnOrganizations
nunchaku-diffusers
1
#647 opened about 2 months ago
by
rootonchair
Implement make_opt_flags function for XPU
8
#5 opened 12 months ago
by
YangKai0616
Kernel assertion errors on 5090 using generation with MXfp4 (gpt-oss) - (stable on 4090)
5
#1 opened about 1 year ago
by
cmp-nct
Update torch-ext/triton_kernels/matmul_ogs_details/opt_flags.py
#3 opened about 1 year ago
by
marcsun13
Update build/torch-universal/triton_kernels/matmul_ogs_details/opt_flags.py
#2 opened about 1 year ago
by
marcsun13
Don't think this works on 4090 with transformers, for me anyway
π 2
21
#53 opened about 1 year ago
by
Fancellu
Request: 4-bit GPTQ or AWQ quantized version of openai/gpt-oss-20b
πβ€οΈ 19
13
#32 opened about 1 year ago
by
powtac
running mxfp4 on H100 using tranformers with triton_kernel: make_default_matmul_mxfp4_w_layout not found
5
#64 opened about 1 year ago
by
uillliu
gpt_oss error when running on kaggle
2
#72 opened about 1 year ago
by
thehai
Open AI open source models not able to run ...
π 3
3
#34 opened about 1 year ago
by
pskmattegunta
RTX 5000 can't not use this model...
π 2
2
#41 opened about 1 year ago
by
arvis
MXFP4 only runs on h100 or b100 or later versions,
π 2
12
#61 opened about 1 year ago
by
kishan51
information how to get it working on a 3090
π 4
11
#63 opened about 1 year ago
by
TheBigBlockPC
how to ignore the quantization
β€οΈπ 4
3
#70 opened about 1 year ago
by
zzbysd
OOM on 3090
4
#52 opened about 1 year ago
by
TheBigBlockPC
add multi_xpu configuration
3
#5 opened over 1 year ago
by
faaany
Error accessing Llama4 models: 'does not have any library metadata on the Hub'
3
#39 opened over 1 year ago
by
asharma2024
GPTQ group size effects vRAM usage
2
#18 opened almost 3 years ago
by
sgjohnson
Determining Minimum GPU Memory and Input Text Length Calculation in Model Training
π 1
2
#19 opened almost 3 years ago
by
kobe8-24
microsoft/Florence-2-base raises error without any detail
#36 opened almost 2 years ago
by
fcakyon