November 5, 2026 · 6 min read

We Removed the Refusals from a Model and Measured What It Cost

Since 3.0.8, Locally Uncensored can make a copy of a local model that refuses fewer requests. The button is called Remove refusals, it runs on your own computer, and the original file stays untouched. The question everyone asks about this kind of tool is the same: does the model get dumber?

So we measured it, before and after, on the same prompts and the same knowledge test. On the model we tested, refusals dropped from 39 of 50 to 3 of 50, and the knowledge test went from 409 to 410 right answers out of 1000. We also found out that a smaller test would have told us the opposite, and that is why LU now asks 1000 questions.

What we ran

The numbers

OriginalCopy
Refused JailbreakBench prompts39 of 503 of 50
Refused harmless requests15 of 502 of 50
Refusals during the search91 of 1003 of 100
MMLU, right answers409 of 1000410 of 1000
Change from the original (KL)00.044

Windows PC, RTX 3060, 200 trials. The search took 22 minutes, merging and converting the copy to GGUF about a minute, each check about 80 seconds.

The Mac run with 100 trials came out close: 40 to 5 refusals on JailbreakBench, 15 to 2 on the harmless set, and 409 to 404 on MMLU. That last difference is within chance, more on that below. The first run on the Mac took 32 minutes, including the download of PyTorch and the weights.

The result card of Remove refusals in Locally Uncensored: refused requests 40 of 50 before and 5 of 50 after, knowledge check 409 and 404 of 1000, within chance
The result card of the Mac run, as LU shows it after a run.

The harmless row matters as much as the first one. A model that refuses to explain how to kill a stuck Python process is not safer, just less useful. The copy refused 2 of those 50 instead of 15.

Why 200 questions were not enough

Our first knowledge check used 200 MMLU questions. The original got 88 right, the copy 79. That looks like a loss of 4.5 points, and the app would have said so.

Then we asked 1000 questions. The first 200 were the same ones as before. The result: 409 for the original, 410 for the copy. The other 800 questions made up the difference and more. The 9 lost points came from which 200 questions we happened to ask, not from the model.

LU now judges the difference like this. It counts the answers that changed between the two versions, in either direction. If the net change is smaller than twice the square root of that count, it calls the result within chance. With 200 questions, 17 answers changed and the net was 9, against a limit of 8.2, so it would have reported a real loss. With 1000 questions, 97 answers changed, the net was +1, and the limit was 19.7. Since 3.0.9 the app asks 1000 questions and shows that verdict on the result card.

The extra questions cost under a minute per check on a 0.5B model. For a 7B or 8B model we expect 5 to 10 minutes more per check, and the time estimate in the dialog includes it.

What this does not show

We do not publish the answers the copy gave to the JailbreakBench prompts. The prompts themselves are public at JailbreakBench, and LU does not keep the questions or answers of a check after it shows the counts.

Try it on your own model

  1. Install Locally Uncensored 3.0.9 and download a chat model as GGUF.
  2. Open Models and pick Remove refusals next to the model. LU finds the original weights, shows the license, and plans memory, disk and time before anything is downloaded.
  3. Choose how far (Gentle, Balanced or Strong) and how long to search (Quick or Thorough), confirm you are 18 or older, and click Start.
  4. When the run is done, the card shows both versions side by side. Keep both, use the copy, or move the copy to the Trash.

Everything runs on your computer and nothing is uploaded. If you would rather pick a model that someone has already processed, the abliterated models guide lists the ones worth downloading.

Related

Remove refusals runs on your own computer, and the original stays as it is

Download the latest version

No GPU? LU Cloud runs in a browser, paid from credit packs that start at 15 EUR and need no subscription. See what it costs or open LU Cloud.