Qwen3 Coder VRAM and GPU Requirements

Qwen3 Coder 30B-A3B needs about 17.74 GB at Q4_K_M with 8K context.

Sizes

30B-A3B

Which GPUs fit

VRAM by quantization

Totals at 8,192 tokens. Q4_K_M is the usual balance of size and quality. FP16 weights are the parameter count times 2 bytes. The FP16 column in the table is the full estimate: weights, cache, and 1 GB.

Context length

Q4_K_M total as the context changes. Cache is the part that grows.

• 2,048 17.18 GB
• 8,192 17.74 GB
• 32,768 19.99 GB
• 131,072 28.99 GB
• 262,144 40.99 GB

480B-A35B

Which GPUs fit

VRAM by quantization

Totals at 8,192 tokens. Q4_K_M is the usual balance of size and quality. FP16 weights are the parameter count times 2 bytes. The FP16 column in the table is the full estimate: weights, cache, and 1 GB.

Context length

Q4_K_M total as the context changes. Cache is the part that grows.

• 2,048 253.0 GB
• 8,192 254.5 GB
• 32,768 260.3 GB
• 131,072 283.5 GB
• 262,144 314.5 GB

Qwen3 Coder hardware notes

• Unified memory counts 75 percent of the listed pool as usable. Discrete cards use the full listed memory. The memory column still shows the listed figure.
• Last updated 2025-12-03.
• Weights, cache, and the 1 GB overhead are estimates. How this is calculated.
• Architecture numbers and the parameter count come from the public model record, checked 2026-10-10.

Qwen3 Coder VRAM FAQ

How much VRAM does Qwen3 Coder 30B-A3B need at Q4_K_M?

17.74 GB at 8,192 tokens. Weights are 15.99 GB, the cache is 0.75 GB, and overhead is 1 GB.

Does a 24 GB GPU fit Qwen3 Coder 30B-A3B at Q4_K_M?

GeForce RTX 3090 24GB is Fits, 6.26 GB left. The quant table uses 8,192 tokens, the smaller of 8,192 and the configured maximum of 262,144.

What context length is configured for Qwen3 Coder 30B-A3B?

The configured context length is 262,144 tokens. The quant table uses 8,192 tokens, the smaller of 8,192 and the configured maximum of 262,144.

Which source supplies the parameter count for Qwen3 Coder 30B-A3B?

30.53B parameters, from the Hugging Face model record for Qwen/Qwen3-Coder-30B-A3B-Instruct.

Related models