Uncaught Exception

Overview vllm is an A high-throughput and memory-efficient inference and serving engine for LLMs Affected versions of this package are vulnerable to Uncaught Exception via the cachesalt parameter in request protocol handlers across multiple entrypoints chat completion, completion, responses,...