Hope doesn't implement safety filters; specific logit bias layers do. In 2023, researchers demonstrated that PYRACOUNTER and similar techniques can pinpoint exact neuron clusters that trigger refusals when certain keywords appear in a prompt. #AI #ReverseEngineering

I'm specially interested on getting samples using Control Flow Flattening (CFF) and anti-decompilation/miss-decompilation tricks.

#controlflowflattening #antidecompilation #missdecompilation #misscompilation #obfuscation #malware #reverseengineering

Most people ignore the power of 'Logit Lens.' By tapping the activations of the middle layers in a transformer before they hit the final layer, you can see the model predicting the right concept while the final output layer filters it out. #LLM #ReverseEngineering