RunLocalAI
glm
9B parameters
Restricted

GLM-4 9B

Zhipu's GLM-4 at 9B. Strong on Chinese-language tasks; tool-calling format slightly different from OpenAI convention.

License: GLM License·Released Jun 15, 2024·Context: 131,072 tokens

Overview

Zhipu's GLM-4 at 9B. Strong on Chinese-language tasks; tool-calling format slightly different from OpenAI convention.

Family & lineage

How this model relates to others in its lineage. Family members share architecture and training-data roots; parent / children edges record direct distillation or fine-tune relationships.

Distilled / fine-tuned from this
GLM-5 Pro144B
Datacenter
GLM-4V 9B13.9B
Consumer

Strengths

  • Chinese-language depth
  • Strong tool-calling

Weaknesses

  • Restricted license
  • Custom tool-call format

Quantization variants

Each quantization trades model quality for file size and VRAM. Q4_K_M is the most popular starting point.

QuantizationFile sizeVRAM required
Q4_K_M5.5 GB8 GB

Get the model

HuggingFace

Original weights

huggingface.co/THUDM/glm-4-9b-chat

Source repository — direct quantization required.

Hardware that runs this

Cards with enough VRAM for at least one quantization of GLM-4 9B.

NVIDIA GB200 NVL72
13824GB · nvidia
AMD Instinct MI355X
288GB · amd
AMD Instinct MI325X
256GB · amd
AMD Instinct MI300X
192GB · amd
NVIDIA B200
192GB · nvidia
NVIDIA H100 NVL
188GB · nvidia
NVIDIA H200
141GB · nvidia
Intel Gaudi 3
128GB · intel
Compare alternatives

Models worth comparing

Same parameter band, plus what's one tier above and below — so you can decide what actually fits your hardware.

Step up
More capable — bigger memory footprint
Step down
Smaller — faster, runs on weaker hardware

Frequently asked

What's the minimum VRAM to run GLM-4 9B?

8GB of VRAM is enough to run GLM-4 9B at the Q4_K_M quantization (file size 5.5 GB). Higher-quality quantizations need more.

Can I use GLM-4 9B commercially?

GLM-4 9B is released under the GLM License, which has restrictions for commercial use. Review the license terms before using it in a product.

What's the context length of GLM-4 9B?

GLM-4 9B supports a context window of 131,072 tokens (about 131K).

Source: huggingface.co/THUDM/glm-4-9b-chat

Reviewed by RunLocalAI Editorial. See our editorial policy for how we research and verify model claims.