Marc Sun's picture

🏗️ Building on HF

Marc Sun

marcsun13

huggingface

·

AI & ML interests

LLM, Quantization, Training, Inference

Recent Activity

upvoted an article 4 days ago

Is it agentic enough? Benchmarking open models on your own tooling

liked a Space 5 days ago

nanotron/ultrascale-playbook

liked a model 11 days ago

google/gemma-4-E4B-it-qat-mobile-transformers

View all activity

Organizations

marcsun13 's models 19

marcsun13/Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated Mar 20, 2025 • 3

marcsun13/phi-4-bnb-4bit

Text Generation • 15B • Updated Mar 18, 2025 • 8

marcsun13/Llama-3.2-1B-bnb-4bit

Text Generation • 1B • Updated Mar 18, 2025 • 7

marcsun13/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8

2B • Updated Feb 13, 2025 • 7

marcsun13/paligemma_vqav2

Updated Feb 4, 2025

marcsun13/Meta-Llama-3-8B-torchao-int8_weight_only

Updated Oct 18, 2024 • 6

marcsun13/sft_openassistant-guanaco

Text Generation • 7B • Updated Jul 5, 2024 • 3

marcsun13/gemma-2-27b-it-bnb-colab

Text Generation • 28B • Updated Jul 4, 2024 • 2

marcsun13/gemma-2-9b-it-GPTQ

Text Generation • 9B • Updated Jul 3, 2024 • 12 • 3

marcsun13/test_push_checkpoint

Fill-Mask • 0.1B • Updated Jun 28, 2024 • 2

marcsun13/Mixtral-8x7B-v0.1-GPTQ

Text Generation • 47B • Updated Dec 11, 2023 • 2

marcsun13/Mixtral-tiny-GPTQ

Text Generation • 0.2B • Updated Dec 11, 2023 • 7

marcsun13/Llama-2-13B-AWQ

Text Generation • 13B • Updated Nov 6, 2023 • 6

marcsun13/opt-125m-awq

Text Generation • Updated Oct 30, 2023 • 7

marcsun13/opt-350m-gptq-4bit

Text Generation • Updated Jul 31, 2023 • 850

marcsun13/gpt2-xl-linear-sharded

Updated Jun 30, 2023 • 2

marcsun13/gpt2-xl-linear

Updated Jun 28, 2023

marcsun13/bloom-1b7_with_lm_head

Text Generation • Updated Jun 21, 2023 • 4.33k

marcsun13/dummy-model

Fill-Mask • Updated May 23, 2023 • 3