Synapse Open Synapse
AI

Inference time abliteration

Reddit · r/LocalLLaMA · · 1 min read

AbliteratedOutTheBox is a llama.cpp fork that abliterates any model you load, live at inference, with no fine-tuning and no extra files. This eliminates any hassle of abliteration without requiring any more vram. https://github.com/heterodoxin/AbliteratedOutTheBox

Latest from Reddit · r/LocalLLaMA