MAI-2023-0003

A vulnerability has been identified within the fine-tuning API of GPT-4, which permits adversaries to bypass the Reinforcement Learning from Human Feedback RLHF safety mechanisms. By employing a relatively small set of meticulously crafted prompt-response pairs, attackers can fine-tune the model ...