Sihwa Lee

macto's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted a paper 5 days ago

Tangram: Unlocking Non-Uniform KV Cache Compression for Efficient Multi-turn LLM Serving

Paper • 2606.06302 • Published 6 days ago • 10

updated 5 models over 2 years ago

macto/Qwen-7B-awq-w4-g128

Updated Mar 5, 2024

macto/exllamav2-test

Text Generation • Updated Feb 27, 2024 • 1

macto/marlin-test

Text Generation • Updated Feb 26, 2024 • 1

macto/trt-qwen-w4-awq

Updated Feb 25, 2024

macto/aicas-test

Text Generation • 8B • Updated Feb 25, 2024 • 5