MAI-2024-0053

Large Language Models LLMs that utilize reinforcement learning from human feedback RLHF are susceptible to jailbreaking attacks due to issues with reward misspecification. The reward function employed during the alignment process inadequately assesses the quality of responses, especially when fac...