3 matches found
Vllm P2p Never Connected Zmq_exhaustion
Summary When the "OffloadingConnector" uses "TieringOffloadingSpec" with a P2P secondary tier, an API client can submit many unique non-listening peer addresses through "kvtransferparams.prefill". vLLM keeps every never-established P2P session and its ZeroMQ sockets after the request finishes. On...
vllm p2p never connected zmq_exhaustion
Summary When the OffloadingConnector uses TieringOffloadingSpec with a P2P secondary tier, an API client can submit many unique non-listening peer addresses through kvtransferparams.prefill. vLLM keeps every never-established P2P session and its ZeroMQ sockets after the request finishes. On vLLM...
GHSA-FRVG-QW88-HWW9 vllm p2p never connected zmq_exhaustion
Summary When the OffloadingConnector uses TieringOffloadingSpec with a P2P secondary tier, an API client can submit many unique non-listening peer addresses through kvtransferparams.prefill. vLLM keeps every never-established P2P session and its ZeroMQ sockets after the request finishes. On vLLM...