vLLM is an inference and serving engine for large language models (LLMs). Before version 0.11.0rc2, the API key support in vLLM performs validation using a method that was vulnerable to a timing attack. API key validation uses a string comparison that takes longer the more characters the provided API key gets correct. Data analysis across many attempts could allow an attacker to determine when it finds the next correct character in the key sequence. Deployments relying on vLLM's built-in API key validation are vulnerable to authentication bypass using this technique. Version 0.11.0rc2 fixes the issue.

vLLM is an inference and serving engine for large language models (LLM ...

vLLM is vulnerable to timing attack at bearer auth

Уязвимость класса AuthenticationMiddleware библиотеки для работы с большими языковыми моделями (LLM) vLLM, позволяющая нарушителю обойти ограничения безопасности и раскрыть защищаемую информацию