No Free Efficiency: Revisiting the Trade-Off between Training Efficiency and Model Vulnerability

Training efficiency has become the central driver of recent progress in foundation models. To overcome the massive computational and data requirements of large-scale training, researchers increasingly adopt strategies such as selective data sampling, efficient pre-training, and simplified...