Privacy-Preserving Prompt Personalization in Federated Learning for Multimodal Large Language Models

Prompt learning is a crucial technique for adapting pre-trained multimodal language models MLLMs to user tasks. Federated prompt personalization FPP is further developed to address data heterogeneity and local overfitting, however, it exposes personalized prompts - valuable intellectual assets - ...