Safe Delta: Consistently Preserving Safety When Fine-Tuning LLMs on Diverse Datasets

Large language models LLMs have shown great potential as general-purpose AI assistants across various domains. To fully leverage this potential in specific applications, many companies provide fine-tuning API services, enabling users to upload their own data for LLM customization. However,...