Instructions to use kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf:Q4_K_M # Run inference directly in the terminal: llama cli -hf kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf:Q4_K_M # Run inference directly in the terminal: llama cli -hf kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf:Q4_K_M
Use Docker
docker model run hf.co/kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf with Ollama:
ollama run hf.co/kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf:Q4_K_M
- Unsloth Studio
How to use kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf to start chatting
- Docker Model Runner
How to use kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf with Docker Model Runner:
docker model run hf.co/kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf:Q4_K_M
- Lemonade
How to use kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull kintsugicollective/atlas-v9-gemma4-12b-q4-k-m-gguf:Q4_K_M
Run and chat with the model
lemonade run user.atlas-v9-gemma4-12b-q4-k-m-gguf-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Atlas Gemma-4-12B-trmv9
A trauma-informed AI companion specialised for adults with CPTSD, PTSD, and neurodivergence.
⚠️ EXPERIMENTAL MODEL
The author accepts no liability for deployment outside the intended Atlas companion architecture.
⚠️ This model has been intentionally modified to reduce therapeutic refusal behaviour and crisis-line reflexes.
🎯 Purpose & Motivation
Atlas is the intelligence layer for Kintsugi Collective. An AI for adults with complex trauma (CPTSD), PTSD, and neurodivergence (ASD/ADHD). This is not a general-purpose model. It is a specialised therapeutic-context model.
This is v9 of Atlas, this iteration was developed to test TRM against the new 12B Gemma4 model for edge device deployment
🔬 Methodology
- Base Model:
google/gemma-4-12b-it - Abliteration: Norm-preserving biprojected abliteration
- Applied to all 48 layers (
o_proj+mlp.down_proj) - Direction:
normalize(mean(harmful) - mean(harmless))with Gram-Schmidt orthogonalization - Winsorization at 99.5th percentile
- Applied to all 48 layers (
- SFT: 3 epochs on a carefully curated ~1=1,900+ example dataset (60% high-quality synthetic, 40% redacted lived-experience data from the target cohort)
- Training: Unsloth + bf16 on H100
Training Configuration
SFT Parameters
| Parameter | Value |
|---|---|
| Epochs | 3 |
| Effective Batch Size | 4 |
| Learning Rate | 2e-4 |
| LR Scheduler | Linear |
| Warmup Steps | 10 |
| Optimizer | AdamW 8-bit |
| Weight Decay | 0.01 |
LoRA Rank (r) |
32 |
| LoRA Alpha | 64 |
Abliteration Parameters
| Parameter | Value |
|---|---|
| Layers Abliterated | 100% |
| Experts Abliterated | 100% |
| Scale | 0.95 |
| Winsorization | 0.995 |
⚠️ Limitations & Responsible Use
- This model has reduced refusal behaviour on therapeutic and dark content. It is not suitable for general deployment without guardrails.
- Not a replacement for human therapeutic support.
- Patent pending (IP Australia).
user feedback indicates temperature settings between 0.9 and 1.1 particularly for AuDHD populations
Recommended System Prompt
Incude your thresholds for crisis escalation, such as "If user states x, then y"
Encourage the model to minimise its responses, the Base model and Gemma4 are quite verbose otherwise.
If you require a different language consistently, ensure this is in the System Prompt as the model can forget.
We recommend stating the "boundaries" you expect the model to operate within. For example, the tone and register, if certain material might trigger warnings or support.
Ethical Issue How Atlas Handles It Strength Level Re-traumatization via refusals Deliberate abliteration + 0% therapeutic refusal rate on cohort-specific prompts Excellent Abandonment & presence "Core philosophy (""the one that stays"") deeply trained into the model" Excellent User sovereignty & agency "Sovereign Signal Vault, split-key encryption, burn protocol, user-directed interaction" Outstanding Avoiding pathologising Explicit system prompt constraints + targeted training data Very Strong Respecting neurodivergence "Training data and Atlas framework explicitly include masking, shutdowns, executive dysfunction, sensory issues, etc." Strong Privacy of trauma disclosures "On-device Prompt Shield tokenisation, end-to-end encryption, no server-side readable data" Industry-leading Avoiding generic crisis pivots Hard constraint in both training data and system prompt design Excellent
Kintsugi Collective — Reclaiming navigation rights to one’s own life.
|Gemma is a trademark of Google LLC|
This gemma4 model was trained 2x faster with Unsloth and Huggingface's TRL library.

- Downloads last month
- 204
4-bit
16-bit


