Improper Validation of Specified Quantity in Input

Overview vllm is an A high-throughput and memory-efficient inference and serving engine for LLMs Affected versions of this package are vulnerable to Improper Validation of Specified Quantity in Input in allreducermsfusion.py when registering pattern replacements for mixed-dtype allreduce RMSNorm...