Qwen
Qwen3-4B
Qwen3-4B: Text generation, text processing and conversational applications.
Specifications
- Source-reported parameters
- 4,022,468,096
- Architectures
- Unknown
- Layers
- 36
- KV heads
- 8
- Head dimension
- 128
- config.json context
- 40960
- Native context in model card
- Unknown
- Extended context
- Unknown
- Weight dtype
- Unknown
- File formats
- Unknown
- Declared languages
- Unknown
- Estimation method
- Weights + logical KV, excluding runtime