Qwen3 30B A3B

Model Overview

Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models. Built upon extensive training, Qwen3 delivers groundbreaking advancements in reasoning, instruction-following, agent capabilities, and multilingual support, with the following key features: Uniquely support of seamless switching between thinking mode Significantly enhancement in its reasoning capabilities Superior human preference alignment Expertise in agent capabilities Support of 100+ languages and dialects with strong capabilities for multilingual instruction following and translation.

• Qwen3-30B-A3B Model Architecture:

  • Type: Causal Language Models
  • Training Stage: Pretraining & Post-training
  • Number of Parameters: 30.5B in total and 3.3B activated
  • Number of Paramaters (Non-Embedding): 29.9B
  • Number of Layers: 48
  • Number of Attention Heads (GQA): 32 for Q and 4 for KV
  • Number of Experts: 128
  • Number of Activated Experts: 8
  • Context Length: 32,768 natively and 131,072 tokens with YaRN.

• Model Source: Qwen/Qwen3-30B-A3B

• License: apache-2.0

QPC Configurations

Precision	SoCs / Tensor slicing	NSP-Cores (per SoC)	Full Batch Size	Chunking Prompt Length	Context Length (CL)	CCL_Enabled	QPC URL	QPC Size	QPC Download	Onnx URL	Onnx Download	Generation Date
MXFP6	4	16	1	128	8192	False	https://dc00tk1pxen80.cloudfront.net/SDK1.21.6/Qwen/Qwen3-30B-A3B/Qwen3-30B-A3B_qpc_16cores_128pl_8192cl_4devices_mxfp6_mxint8.tar.gz	49GB	Download	https://qualcom-qpc-models.s3-accelerate.amazonaws.com/SDK1.21.6/Qwen/Qwen3-30B-A3B/Qwen_Qwen3-30B-A3B_CCL_Disabled_ONNX.tar.gz	Download	24-June-2026
MXFP6	4	16	1	128	65536	True	https://dc00tk1pxen80.cloudfront.net/SDK1.21.6/Qwen/Qwen3-30B-A3B/Qwen3-30B-A3B_qpc_16cores_128pl_65536cl_4devices_mxfp6_mxint8_ccl.tar.gz	50GB	Download	https://qualcom-qpc-models.s3-accelerate.amazonaws.com/SDK1.21.6/Qwen/Qwen3-30B-A3B/Qwen_Qwen3-30B-A3B_CCL_Enabled_ONNX.tar.gz	Download	24-June-2026

Run This Model

Download QPCs

mkdir -p Qwen/Qwen3-30B-A3B
cd Qwen/Qwen3-30B-A3B

# Download QPC
wget <QPC_Download_URL>
tar xzvf <qpc_filename.tar.gz>

Run QPC

Replace QPC_PATH with actual extracted QPC directories.

python3 -m vllm.entrypoints.openai.api_server \
  --host 0.0.0.0 \
  --port <PORT> \
  --model Qwen/Qwen3-30B-A3B \
  --device-group <DEVICE_IDS> \
  --max-model-len <CTX_LEN> \
  --max-seq-len-to-capture <PREFILL_SEQ_LEN> \
  --max-num-seqs <MAX_NUM_SEQS> \
  --override-qaic-config "qpc_path=<QPC_PATH>"

Run Inference

Once the server is running, send a request to the OpenAI-compatible endpoint:

curl http://localhost:<PORT>/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "Qwen/Qwen3-30B-A3B",
    "messages": [
      {"role": "user", "content": "<PROMPT>"}
    ],
    "max_tokens": 200
  }'

Useful Links

• Environment Setup