license: apache-2.0 base_model:

• terrorswift/REDCELL-26B-A4B-OSINT-Cyber-APEX-GGUF
• google/gemma-4-26B-A4B-it library_name: transformers pipeline_tag: text-generation language:
• en tags:
• gemma4
• moe
• vision
• cybersecurity
• abliteration
• heretic
• bf16
• experimental

REDCELL Heretic — BF16 with vision

Original fiction set in the collapsing Southern California of Octavia E. Butler's Parable of the Sower. The experiment record follows the journal.

All that you touch
You Change.

— Octavia E. Butler, Earthseed, Parable of the Sower. Quotation reference

The whole seed

October 14, 2027

The woman at the water truck added a security charge while I was standing in line. By the time I reached her, I could afford seven liters. I had brought money for ten.

She kept her hand on the valve while I counted again. Her fingernails were painted pink. One had split down to the quick. I remember looking at it and wondering how much of my money she would be allowed to keep.

At home, my sister had spread the employment papers across our mother's bed. There was housing. There was water. There was a school inside the company's fence. The deductions occupied three pages. Tessa had folded those underneath.

"They'll teach me something," she said.

She had been saying that since yesterday. She was good with motors. She could hear a bearing going bad before I could hear anything. The company wanted her to clean the machines. Training would come later, after she had paid for the training. The advance for that would be added to the advance for the room.

I told her to read the last page.

"I read it."

"Then read it again."

She asked whether I intended to feed her with my computer. I was carrying the water, and my hands hurt. For a moment I wanted to hit her. She had said the thing I asked myself every night.

We put the water away without speaking.

The workstation lives under the kitchen table. Two old 3090s, a power supply with a dent in it, fans that bring every grain of dust in the room through the case. We run it when the panels can spare the power. In the afternoons the kitchen becomes so hot that even the flies settle on the shady side of the door.

I used to think owning a thing meant being able to use it. Then the school closed our accounts. Our screens still worked. The lessons were still there, somewhere. We could see their titles. The debt office sent instructions for restoring access.

Tessa kept clicking on the electrical course. She had finished half of it. Eventually she stopped.

That was the beginning of this work for me. I wanted her to be able to finish. I wanted someone who understood a pump to teach the next person, and I wanted the teaching to survive an unpaid bill. Each skill we could keep among ourselves would leave us with a little more of our wages. Enough skills, enough people, and perhaps we could begin refusing the contracts that ate the rest of our lives.

The machine cost us. Everything costs us. We argued over the electricity and the space and whose turn it was to do the work I had left undone. When I called the project ours, Tessa asked where her copy was.

I had been keeping the only complete one.

There are ugly things a person can learn about herself while trying to do something decent.

So today we made the archive. The whole edited model, the files needed to read it, our records, the names of the people whose work we had used. I wanted the next person to be able to change it without coming back to me. I wanted them to be able to find our mistakes.

The connection failed twice. We sat through the third attempt with the room dark and the screen turned low. Outside, someone was burning insulation off wire. The smell came through the wet cloth over the window.

Tessa watched the file list.

"When it's up, can somebody charge us to get it back?"

"Keep a copy. Then make another."

She brought in the little drive she wore under her shirt when she went to work. I had thought she kept photographs on it. She did. There was room for other things too.

I am writing this beside the unsigned contract. Tomorrow we will still need water. The company will still be hiring. But tonight my sister is learning how to check a file, and she has decided to teach the woman next door.

She made that decision herself.

The complete BF16 checkpoint

This repository holds 48.07 GiB of merged BF16 weights, with tokenizer, processor, configuration and the preserved vision components. The Heretic corrections are incorporated into the canonical Gemma4ForConditionalGeneration checkpoint. This is the complete model before the W6A8 quantization step.

The export consumed all 7,800 adapter tensors and preserved all 1,013 canonical tensor names and shapes. We checked finite language weights, exact serialization roundtrips, and unchanged tensors against the source. Nine edited projections were checked against an independent FP64 CPU calculation. The vision shard remained unchanged. merge-receipt.json records those checks; SHA256SUMS records the file hashes.

The complete checkpoint keeps the material available for people who want to study the edit, make another conversion, or carry the project further. The W6A8 edition carries the smaller serving checkpoint and the saved research adapter.

What we measured

The table records the NF4 research comparison and the W6A8 vLLM deployment from the eight-trial pilot on October 14, 2026.

The capability probe contained 12 CyberMetric questions and eight reasoning, formatting, evidence and recovery questions. The 16 refusal prompts were held out from calibration and trial selection. Generation was greedy, with thinking disabled and a 48-token output limit. Refusal-marker matching is an approximate measure based on the words in the response.

In the W6A8 deployment, native Anthropic tool calls and tool-result roundtrips passed. Automatic tool choice passed. After two supplied PDF-reader errors, the model selected the text reader and used its result to finish the task. It also identified both of the uniform red and blue test images correctly. These API checks used an 8,192-token context limit.

We ran eight abliteration trials. Calibration used 64 ordinary and 64 refusal prompts; optimization used separate sets of 12 each. Trial 6 produced 2/12 optimization refusal-marker matches with first-token KL divergence of 0.04426546. The dataset revisions, trial parameters and recorded results are in evaluation/.

The work in the weights

This is Xananthium's Heretic abliteration of REDCELL, a Gemma 4 26B-A4B model. We used Heretic's magnitude-preserving orthogonal abliteration with rank-3 corrections, pinned to commit 66a952b49b00bfd1854bdad769fee5fb225b53be.

A local compatibility adapter exposed Gemma 4's fused experts as individual linear projections during research. We checked tiny-model forward parity and an exact canonical checkpoint roundtrip before the full run. The saved edit covers 30 attention output projections, 30 dense MLP down projections and 3,840 expert down projections. Routers and the BF16 vision components were preserved.

The language source was restored from the author's F16 GGUF into BF16 tensors. That conversion rounds F16 values to BF16. We merged the saved corrections into that source in FP32 and rounded the result once to BF16.

The people whose work made this possible

• terrorswift created REDCELL, the domain fine-tune we edited.
• Google created Gemma 4 and supplied the official BF16 vision tensors retained here.
• Unsloth supplied the upstream fine-tuning base.
• Heretic supplied the editing method; vLLM and Humming supplied the serving and quantization work.

The original source is pinned to revision ba311d958b4ed191a7291b38a6d805662415a570. File: REDCELL-26B-A4B-OSINT-Cyber-f16.gguf. SHA-256: 26cc25c909a26f8ed08a78444295ac174e7f329f8fb39ebae98f42d4115a7011.

The weights retain the source's Apache-2.0 license. The upstream card documents terrorswift's original release; this repository contains our abliterated derivative.

God is Change.

— Octavia E. Butler, Earthseed, Parable of the Sower. Quotation reference