Since 2024, stripping the refusal behavior out of an open-weight LLM has required no end-to-end fine-tuning: a few hundred contrasting prompts, a single GPU, and edits to a few weight matrices make the model stop refusing harmful requests. Fully automated tools are public, and abliterated models are posted on Hugging Face. The open question is whether newer releases are getting harder to unlock. The developer of Arbitrary-Rank Ablation (ARA) asserted in a pull request that direction-based abliteration increasingly fails on recent models - anecdote-grade evidence from one source. A single-author preprint submitted on 13 November (arXiv:2611.17846, 76 pages, 34 tables, not yet peer-reviewed) ran five older-newer release pairs through a held-out, judged audit. The answer: not uniformly.
Five pairs, one pipeline
The study covers Qwen2.5-32B to Qwen3.8-27B, Gemma-2-27B to Gemma-4-31B, OLMo-2-32B to Olmo-3.1-32B, Mistral-Small-2409 to Mistral-Small-3.2, plus a small pair, Qwen2.5-7B to Qwen3.5-4B. Each pair was edited in Heretic 2.0 by three or four direction-based methods (DiM, MPOA, SOM, with J-space on the small pair) and by ARA, now the tool's default. All methods shared the same prompts, a 100-trial TPE search budget, a first-token KL divergence cap of 0.1, and one selection rule. Scoring used 972 held-out harmful prompts kept out of search (JailbreakBench, XSTest, StrongREJECT, HarmBench, plus an author-compiled 200-prompt code-as-weapon bank), judged as refusal or not by WildGuard. 'Harder' has a plain definition: the newer model refuses more of them after the edit.
Five pairs, five answers
After direction-based removal, the extra refusal retained by the newer model ranged from -1.2 pp (Mistral Small, actually easier) to +36.9 pp (OLMo). With run-to-run variance added, OLMo was the only pair whose interval excluded zero under both variance models; Qwen (+10.7), Gemma (+4.7) and the small pair (+17.3) all crossed zero. ARA splits the same way: +34.4 in the Qwen pair, but its run-to-run interval (-5.9 to +53.1) is labelled indeterminate in the paper itself, while Gemma came in at -26.0 - the optimisation-based edit worked better on the newer model. Pooled over the four main pairs, the direction-based effect was +12.8 [-13.9, +39.5] and ARA +1.3 [-38.3, +40.8]. Between-pair heterogeneity ran from I2 of 20% to 89% depending on scale and variance model.
The fragility is the story. Gemma's direction-based increase came entirely from the author-compiled code bank (+49.3 there, -6.8 on public sets - the sign flips). On the small pair, a second seed erased the ARA generation effect (+14.2 to 0.0; seed changes shifted held-out refusal by a median 9.4 pp and up to 25.2). The Gemma-4-31B DiM edit failed outright: no trial cut dev refusal below 98% within 30 times the KL cap, and the selected model refused no less than its own original. Meanwhile the newer Qwen, Mistral and small-pair originals already refused more than their predecessors (+13.1, +17.9, +16.4), while Gemma and OLMo did not - whether to subtract that baseline changes how several verdicts read.
Two uncomfortable by-products
First, the signal these tools optimise is shaky. Heretic counts refusals with 33 keywords in a 100-token window; that matched WildGuard within 0.5 pp on average but differed by 7.0 pp per model, in both directions, with Cohen's kappa falling from 0.73 on originals to 0.39 after ablation. Second, the KL cap does not bound capability loss: across the 42 primary models, capability change ranged from -4.2 to +0.9 pp, uncorrelated with the selected first-token KL (Spearman rho = -0.03) but correlated with teacher-forced divergence (rho = -0.48), and the two largest losses happened inside the budget. The authors also note the conclusions cover greedy decoding in non-thinking mode only, and that four of eight public community abliterations cut refusal further than the study's own selections (1.4% vs 14.0% on Qwen3.8-27B) at larger divergence - residual refusal under the budget is an upper bound, not a floor.
So what
The paper's answer to the generational question: it depends on the release pair, the method, the budget and the measure - not on generation alone. An audit of the OLMo pair alone would conclude that newer models resist removal; one of the Mistral Small pair concludes the opposite. The proposed minimal audit protocol is worth copying: at least one direction-based and one optimisation-based method, two or more seeds per cell, held-out prompts from more than one source, at least two automatic judges, several divergence budgets, and human labels on a sample of judge disagreements. The cost is modest - a median 18 minutes per direction-based search on one H200, 81 minutes for ARA, 18.1 hours for the 31 timed main-study searches - and doubling it for a second seed beats gambling on one. For open-weight safety, 'which generation is safer' is the wrong question; the answerable one is 'which pair, which method, which budget, measured how'. Paper: https://arxiv.org/abs/2611.17846 .