Open-weight local LLM

DBRX (132B MoE)

Databricks open MoE LLM. 132B total with 36B active. Strong general purpose. 111K downloads.

Large-memory workstation 96 GB RAM Q4_K_M General local assistant
Parameters
132B (36B active)
Minimum RAM
96 GB
Model size
75 GB
Quantization
Q4_K_M

Can DBRX (132B MoE) run locally?

DBRX (132B MoE) needs a serious workstation with large unified memory or high VRAM.

Search for dbrx-instruct in LM Studio or another GGUF-compatible runtime.

chatgeneralquality

Install path

01
Check RAM fitMinimum 96 GB RAM. Start with the Q4_K_M quant.
02
Load the modelSearch dbrx-instruct in LM Studio.
03
Control locallyUse LocalClaw to manage models, agents, chat, channels and scheduled OpenClaw work.

Strengths

  • Databricks open MoE LLM. 132B total with 36B active. Strong general purpose. 111K downloads.

Limitations

  • Performance depends on quantization, RAM bandwidth and runtime support.

Best use cases

  • chat
  • general
  • quality

Capability profile

speed
2
quality
9
coding
8
reasoning
8

Technical notes

Developer
dbrx
License
See model repository
Context window
Unknown tokens
Architecture
See model card

This model fits these next steps

Hardware fit is based on LocalClaw's RAM tier, model size and quantization metadata. Always leave memory headroom for your OS and runtime.

Where to go next