1 matches found
vLLM: Completion prompt lists fan out into unbounded engine requests
SummaryThe /v1/completions request model accepts prompt as a list of text prompts or a list of token-id prompts without any outer prompt-count bound. The serving path turns each element into a separate engine input, creates one engine generator per element, merges all generators, and allocates a...
6.5CVSS6.2AI score0.00583EPSS
SaveExploits1References8Affected Software1
20