Henkie Tenkie

HenkTenk's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cyankiwi/Qwen3.8-Flash-Next-AWQ-INT4 3 days ago

Running Qwen3.8-Flash-Next-AWQ-INT4

13

#1 opened 3 months ago by

cpatonn

New activity in cyankiwi/Qwen3.6-27B-AWQ-BF16-INT8 6 months ago

Compatible with vLLM on Ampere?

➕ 4

7

#3 opened 6 months ago by

HenkTenk

New activity in cyankiwi/Qwen3.6-27B-AWQ-BF16-INT4 6 months ago

What is the update ?

9

#4 opened 7 months ago by

robert1968

New activity in Qwen/Qwen3.6-27B-FP8 7 months ago

Garbage output

👍 2

6

#8 opened 7 months ago by

andylele

New activity in QuantTrio/Qwen3.6-35B-A3B-AWQ 7 months ago

PPLX or KLD, or other benchmark

1

#4 opened 7 months ago by

HenkTenk

New activity in cyankiwi/Qwen3.6-35B-A3B-AWQ-4bit 7 months ago

How does this compare to the original 8bit qwen quant and the 4 bit auto-round quant?

2

#5 opened 7 months ago by

sparx3

New activity in cyankiwi/GLM-4.6V-AWQ-4bit 9 months ago

Can't seem to correctly generate structured output

17

#3 opened 11 months ago by

kldzj

New activity in cyankiwi/GLM-4.5-Air-AWQ-4bit 10 months ago

Running on 6 GPUs

🤗 1

4

#10 opened about 1 year ago by

0xSero

KV Cache per token and Doubling the context size

3

#12 opened 10 months ago by

HenkTenk

New activity in cyankiwi/Devstral-2-123B-Instruct-2512-AWQ-4bit 11 months ago

Unable to use on 4x3090

3

#4 opened 11 months ago by

marutichintan

New activity in cyankiwi/GLM-4.5-Air-AWQ-4bit 11 months ago

Running on 4 GPUs with TP=4

3

#11 opened 11 months ago by

nephepritou

New activity in cyankiwi/Devstral-2-123B-Instruct-2512-AWQ-4bit 11 months ago

Duplicate files

➕ 1

7

#3 opened 11 months ago by

darkstar3537

New activity in cyankiwi/GLM-4.5-Air-AWQ-4bit about 1 year ago

Improved useability

2

#7 opened about 1 year ago by

HenkTenk

New activity in gghfez/c4ai-command-a-03-2025-AWQ about 1 year ago

Newest vLLM produces nonsense with longer context

4

#1 opened about 1 year ago by

HenkTenk

New activity in cyankiwi/GLM-4.5-Air-AWQ-4bit about 1 year ago

Does this actually work with VLLM?

32

#1 opened over 1 year ago by

sirus