base_model: null-space/gemma-4-31b-it-abliterated base_model_relation: quantized license: apache-2.0 language:

• en library_name: mlx pipeline_tag: text-generation tags:
• abliterated
• uncensored
• gemma4
• gemma
• multimodal
• ablation
• mlx
• mlx-4bit
• mlx-lm
• apple-silicon
• local-llm
• on-device
• macbook
• 31b
• 4-bit
• gemma-4 license_link: https://ai.google.dev/gemma/docs/gemma_4_license model-index:
• name: gemma-4-31b-it-abliterated-4bit-mlx results: []

gemma-4-31b-it-abliterated-4bit-mlx

Uncensored Gemma 4 31B on Apple Silicon. Abliterated, 4-bit MLX, 17.3 GB — runs comfortably on a 32 GB Mac and flies on 64 GB+. No cloud, no API key, no refusals.

A 4-bit MLX quantization of null-space/gemma-4-31b-it-abliterated, tuned for fast on-device inference on Apple Silicon.

• Base model: null-space/gemma-4-31b-it-abliterated (BF16, ~62 GB)
• Quantization: 4-bit affine, group size 64
• Format: MLX safetensors
• Footprint: ~16 GB on disk, runs comfortably on a 32 GB Mac and flies on 64 GB+
• Throughput: ~15 tok/s on M4 Max (measured with mlx-lm 0.21+)

Why this exists

The default model in nicedreamzapp/claude-code-local used to point at a mlx-community/... repo that never actually existed. This is the real, working 4-bit quant — drop-in replacement.

Usage

from mlx_lm import load, generate

model, tokenizer = load("divinetribe/gemma-4-31b-it-abliterated-4bit-mlx")
print(generate(model, tokenizer, prompt="Hello", max_tokens=200))

Or via the launcher / setup script in claude-code-local:

MLX_MODEL=divinetribe/gemma-4-31b-it-abliterated-4bit-mlx \
  bash scripts/start-mlx-server.sh

Abliteration

Refusal-direction projection per Arditi et al. (2024). Use responsibly — you are now the moderator.

About the author

This model was built by Matt Macosko (@nicedreamzapp) for the claude-code-local stack — run Claude Code 100% on-device with local AI on Apple Silicon (⭐ 2,664 on GitHub).

• 🤗 All my models: nicedreamzwholesale.com/software/huggingface/
• 💻 Software portfolio: nicedreamzwholesale.com/software/
• 🔒 AirGap AI (legal / healthcare / NDA workflows): nicedreamzwholesale.com/airgap/

More abliterated MLX models

Part of the Abliterated MLX for Apple Silicon collection — 11 uncensored models converted for Macs, from Gemma 4 12B up to Llama 3.3 70B, plus Qwen3, Qwen3-VL, Hermes 4 and Muse Glimmer 30B.

Part of Claude Code Local

This model is one of the fighters in Claude Code Local (3.2k★), which runs Claude Code 100% on-device on Apple Silicon through an MLX-native Anthropic-API server. Not sure which local model to run as an agent? Check the Agent-12 local agent leaderboard: real agent tasks, judged by the filesystem, same hardware for every row.

Built by Matt Macosko in Arcata, CA. Open to work on local-AI and Apple Silicon inference: [email protected].