test2 / README.md
fastgpu's picture
Model list 2026-11-06: 149 models added to search (13,692), 22 new among the 200 trending models on the card
b458132 verified
|
Raw History Blame Contribute Delete
11.2 kB
metadata
title: VRAM & GPU Cost Calculator
emoji: ⚡
colorFrom: blue
colorTo: indigo
sdk: static
pinned: true
license: mit
short_description: VRAM any HF model needs + live GPU rental prices
tags:
  - vram
  - gpu
  - gpu-prices
  - calculator
  - inference
  - fine-tuning
  - llm
  - cloud-gpu
datasets:
  - fastgpu/cloud-gpu-prices
models:
  - moonshotai/Kimi-K3.1-Pro
  - Pika-Labs/Pika-H3-Flex
  - deepseek-ai/DeepSeek-V4.1-Flash-1017
  - sensenova/SenseNova-Loop-9B-Preview
  - baidu/Unlimited-OCR-2
  - microsoft/Mage-VL-Cowork
  - ccore/Qwen3.5-4B-GLB-3D-Coder
  - unsloth/DeepSeek-V4.1-Flash-1017-GGUF
  - ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO-Coder-GGUF
  - nvidia/DeepSeek-V4.1-Flash-1017-NVFP4
  - PrunaAI/P-H3-Image
  - unsloth/Qwen3.8-Flash-Next-GGUF
  - baidu/ERNIE-5.5-Flash-Base
  - webAI-Official/TwIL-8B
  - Qwen/Qwen3.8-Flash-Next
  - autotrust/Qwen3.8-Flash-Next-E384-FP4-V2
  - ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF
  - Diffuspace/Clover-35B-A3B-Preview
  - RecursiveSI/flint
  - nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-4GB
  - ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-GGUF
  - ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF
  - divagr1925/Qwen3.5-4B-Qwenputer
  - Nanbeige/Nanbeige4.3-33B
  - fishaudio/drama-3
  - XHToken/Spark-X2.6-4B
  - prism-ml/Ternary-Bonsai-2-27B-gguf
  - deepseek-ai/DeepSeek-V4.1-Flash
  - deep-principle/Hydrogen-1.0
  - zai-org/GLM-5.3-Flash
  - Jackrong/Qwopus3.8-27B-Coder-Flash-GGUF
  - BreezeBlue/Breeze-TTS-2
  - moonshotai/Kimi-K3
  - Axion1-0/Axion-1.0-35B
  - black-forest-labs/flux-3-image-klein
  - lodestones/chroma-h3
  - nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16
  - summerAIO/Qwen3.8-27B-Longbook27-v2
  - sensenova/SenseNova-6.8-Code2Video
  - XHToken/Spark-X2.6-4B-GGUF
  - jialinyyzz/humanizer
  - ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-Coder-GGUF
  - GrootTeam/Groot-19B-A3B-261023
  - krea/Krea-2-Raw
  - baidu/ERNIE-5.5-Flash-Base-BF16
  - lightx2v/Qwen-Image-2.1-Lightning-v2-RL
  - KBlueLeaf/MOSS-Image-heal
  - black-forest-labs/FLUX.2-dev
  - unsloth/flint-GGUF
  - peculiar-ragdoll/Cyber-Tiel-Coder-35B-A3B-GGUF-MTP
  - AtomicChat/Ripple-65B-Preview-GGUF
  - OpenMOSS-Team/MOSS-Image-Base
  - Apexintelligence-AI/Apex-35B-V1.0
  - google/gemma-4-E4B-it
  - LessThanThreeAI/Gemma-4-31B-Humanlike-Chat-GGUF
  - zai-org/GLM-5.3
  - ConwayResearch/Underdog-Saluki-27B-1.0
  - Jackrong/Qwopus3.8-27B-Coder-Flash
  - ukisai/Swift-1.5-Qwen3.8-27B-GSQ-RCO-GGUF
  - Qwen/Qwen-Image-2.1-Turbo
  - nvidia/LocateAnything-3B
  - Qwen/Qwen3.6-35B-A3B
  - Sparset/Thinklite-27B
  - meta-models/Muse-Glimmer-30B
  - unsloth/Qwen3.6-35B-A3B-GGUF
  - ceia-br/lumi-4b
  - migtissera/Tess-4.5-27B-GGUF
  - openvivo/BluePixel-Turbo
  - >-
    nerkyor/Qwen3.8-27B-Coder390-EfficientThink-Opus5.5-GPT6Astra-Grok4.7-DSV4Pro-K3-SFT-RLOO-MTP-DFlash2
  - HemmingwayAI/Hemmingway-1.5
  - Diffuspace/Clover-35B-A3B-Preview-GGUF
  - tencent/WeVisOne-VL-4B
  - beipo-ai/NorthCUA-Pro
  - HuggingFaceBio/Carbon-X
  - InternScience/Sage-A1.5
  - nvidia/Qwen3.8-Flash-Next-FP4-Local
  - XHToken/Spark-X2.6-4B-DSpark-GGUF
  - ornith-ai/Ornith-1.5-9B-GGUF
  - DavidAU/Qwen3.8-27B-Turbo-Brilliance-50X-Reasoning-Instruct-NEO-MAX-MTP-GGUF
  - Cloudflare/clef
  - agentionai/Qwen3.8-Flash-Next-Gyro-GGUF
  - briaai/Fibo-2.0-edit-turbo
  - akhaliq/MOSS-Image-SFT-4-steps
  - meta-models/Muse-Spark-Open-816B-A42B
  - empero-ai/Qwen3.8-35B-A3B-Distill-GGUF
  - Linum-AI/pjit-21k
  - GrootTeam/Groot-19B-A3B-261023-GGUF
  - tencent/Hy4-preview
  - Qwen/Qwen3.8-2.4T-A95B
  - baidu/Unlimited-OCR
  - tencent/WeVisCut
  - higa2515/Qwen3.8-27B-QSA-GGUF
  - MiniMaxAI/MiniMax-M3.1-Flash
  - empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF
  - reflection/Beam-1.0-501B-A23B
  - unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF
  - nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-GGUF
  - ornith-ai/Ornith-1.5-35B-A3B-GGUF
  - AtomicChat/SenseNova-Loop-9B-Preview-GGUF
  - unsloth/gemma-4-26B-A4B-it-GGUF
  - unsloth/NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF
  - nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4
  - empero-ai/Qwen3.8-9B-Distill-GGUF
  - XiaomiMiMo/MiMo-V2.6-Pro-RL
  - lodestones/Kromoss
  - google/gemma-4-12B-it
  - MuyaoYuan/LoCo-7B
  - JetBrains/Mellum2.1-12B-A2.5B-Thinking-MTP
  - Hansda/Mage-VL-Cowork-GGUF
  - nvidia/GLM-5.3-Flash-FP4-Local
  - GrootTeam/Groot-65B-A6B-261023-GGUF
  - nota-ai/Kimi-K3.1-Pro-Global-Pruned-30
  - vllm-project/Kimi-K3.1-Pro-pruned75
  - abacusai/Smaug-Humanizer
  - peculiar-ragdoll/Tiel-Coder-35B-A3B-GGUF-MTP
  - google/gemma-4-26B-A4B-it
  - Cloudflare/clef-flash
  - LiquidAI/LFM2.5-24B-A2B
  - microsoft/UserLM-2.0
  - bosonai/higgs-tts-3-4b
  - fastino/GLiDE-27B
  - yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF
  - google/gemma-4-E2B-it
  - gugujiji/novel-humanize-4b
  - unsloth/gemma-4-12b-it-GGUF
  - kandinskylab/Kandinsky-S2V-1.0-Pro-distill-Diffusers
  - ornith-ai/Ornith-1.5-35B-A3B
  - YTan2000/Qwopus3.8-27B-Coder-Flash-TQ
  - unsloth/Qwen3.5-9B-GGUF
  - Qwen/Qwen3-Coder-Next
  - yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF
  - deep-principle/Hydrogen-1.0-MXFP4
  - Wan-AI/Wan2.1-T2V-1.3B
  - speridlabs/iris-3b
  - inclusionAI/Ling-3.0-tiny
  - ChenDY/NitroFusion2
  - webAI-Official/Air-26B-A4B-gguf
  - unsloth/Ornith-1.5-122B-GGUF
  - inclusionAI/Ling-3.1-flash-1019
  - empero-ai/Qwen3.8-35B-A3B-Distill
  - fishaudio/s2-pro
  - InternScience/Sage-A1.5-Q4_K_M-GGUF
  - RavichandranJ/Dolphin3-Cyber-8B-GGUF
  - google/gemma-4-12B
  - >-
    deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF
  - nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-NVFP4
  - deepseek-ai/DeepSeek-V4-Flash
  - ornith-ai/Ornith-1.5-122B
  - nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16
  - Qwen/Qwen2.5-Coder-7B-Instruct-GGUF
  - stabilityai/stable-diffusion-3.5-medium
  - Aleph-Alpha/Kolibri-1
  - Maximilian228/Qwen3.8-Flash-Next-NVFP4-GPTQ-Strata
  - ibm-granite/granite-4.2-3b
  - orcarouter/Mistral-Large-4-1T-A52B-GGUF
  - deep-principle/Hydrogen-1.0-NVFP4
  - divagr1925/QwenPU
  - CohereLabs/tiny-aya-global
  - meta-llama/Meta-Llama-3-8B
  - summerAIO/Diffusion-Qwen3.8-27B
  - black-forest-labs/flux-3-image-klein-base
  - HuggingFaceBio/Carbon-X-Base
  - nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4
  - unsloth/Qwen-Image-2.1-GGUF
  - JetBrains/Mellum2.1-12B-A2.5B-Thinking
  - z-lab/Qwen3.8-27B-DFlash2
  - lodestones/Chroma1-HD
  - unsloth/gpt-oss-20b-GGUF
  - briaai/Fibo-2.0-dev
  - peasantsmith/DeepSeek-V4.1-Flash-1017-Maya-GGUF
  - JetBrains/Mellum2.1-12B-A2.5B-Thinking-GGUF
  - unsloth/Qwen-Image-2.1-Turbo-GGUF
  - inclusionAI/Ling-3.0-flash-Sante
  - Lightricks/LTX-2.5-Diffusers
  - hitsfmdj/Qwen3.8-27B-GGUF-4.2BPW-16GB
  - turintech/Nemotron-3.5-Bolt-E4B-Artemis-GGUF
  - JuneoAI/Laplace-1-Atlas
  - inclusionAI/Ling-3.1-flash
  - nvidia/Qwen3.8-27B-NVFP4
  - agentionai/Qwen3.8-Flash-Next-Gyro-Coder-GGUF
  - Octen/Octen-WebGR-4B
  - divagr1925/Qwen3.5-4B-Qwenputer-Filesystem
  - ornith-ai/Ornith-1.5-9B
  - Qwen/Qwen3-4B
  - KRAFTON/Raon-1-mini-preview
  - unsloth/GLM-4.7-Flash-GGUF
  - Qwen/Qwen2.5-3B-Instruct
  - zai-org/GLM-5.2
  - dphn/Dolphin-Mistral-24B-Venice-Edition
  - deepseek-ai/DeepSeek-V4-Pro
  - HuggingFaceBio/Carbon-X-SFT
  - black-forest-labs/FLUX.1-Kontext-dev
  - empero-ai/Qwen3.8-4B-Distill-GGUF
  - guideboardlabs/SenseNova-Loop-9B-Preview-GGUF
  - Logics-MLLM/Logics-SWE-Qwen3.6-35B-A3B
  - Lythri/Lythri-Tada-4B
  - Nanbeige/Nanbeige4.3-33B-INT4
  - webAI-Official/TwIL-LM3-Pro
  - bartowski/HemmingwayAI_Hemmingway-1.5-GGUF
  - MemTensor/MemT-1.0-Nano

VRAM & GPU Cost Calculator

Pick any Hugging Face model, or paste its org/name or its page address, and see:

  • how much GPU memory it needs to run, fine-tune with LoRA, fully fine-tune, generate, transcribe or embed, at its published precision or at 16, 8 or 4 bits;
  • the cheapest GPU setups that hold it (one H100, two A100s, four RTX 4090s...), each priced live across the GPU clouds FastGPU tracks, with a link to every offer.

It reads each model's own metadata from the Hub (the parameter count in its safetensors or GGUF header, its quantization config) and asks FastGPU's free match API for the sizing and the live prices. Nothing to install, no sign-in. Type a size such as 70B for a model that is not on the Hub.

Which models

Any public model on the Hub that publishes a parameter count. The search box lists 13,692 of them: the text, vision-language, image, video, speech and embedding models the Hub counted at 1,000 or more downloads in the 30 days before a build day from 2026-10-11 to 2026-11-06, plus the ones trending on those days. Left out of the list: models too small to need a rented GPU, adult and refusal-stripped fine-tunes, and builds for Apple silicon, CPUs or phones. Anything else is found through the Hub's own search as you type, or by pasting its org/name.

How the memory is sized

The same way as on fastgpu.co, by FastGPU's matcher:

  • Run / serve: the weights (parameters × bytes per parameter: 2 at 16-bit, 1 at 8-bit, 0.5 at 4-bit), plus the KV cache for one request at a 4K-token context and runtime headroom.
  • Fine-tune with LoRA: the frozen weights plus the adapters, their optimizer state and activations.
  • Full fine-tune: about 16 bytes per parameter (weights, gradients and Adam states) plus activations.
  • Image, video, speech and embedding models FastGPU knows (FLUX, SDXL, Wan, Whisper and more) use a figure for the whole pipeline, text encoders and VAE included.

A quantized repo (AWQ, GPTQ, FP8, NVFP4, bitsandbytes) is sized at the bits it is stored in unless you pick another precision.

A GGUF repo is sized from the build you pick. The Weights menu lists the builds the repo holds (Q4_K_M, Q5_K_M, Q8_0 and so on) with the size of each file on the Hub, and that file is the weights a GPU has to hold: a build called 4-bit stores more than 4 bits per parameter, so sizing it from the name comes out too small. The answer shows the file's size and the bits per parameter it works out to. The full method: fastgpu.co/methodology.

Where the prices come from

FastGPU collects the GPU rental prices providers publish (marketplaces, neoclouds and hyperscalers) and refreshes them through the day. Each price here is the provider's own per-GPU rate times the number of GPUs in the setup. "Lowest price" (the default) sorts by price alone. "Best match" orders by FastGPU's score, led by price and weighing reliability and availability. Providers that pay FastGPU a referral fee when you rent from them through FastGPU are marked ★; that never changes their order here.

The price history is open: fastgpu/cloud-gpu-prices (CC BY 4.0, updated daily).

Use it from code

curl "https://fastgpu.co/api/v1/match?model=Qwen/Qwen3-32B&params_b=32.8&task=inference"

No key needed. Docs: fastgpu.co/docs.