Skip to content

Commit c9a38a4

Browse files
committed
add None to permitted values
Signed-off-by: Konrad Zawora <kzawora@habana.ai>
1 parent 999fb56 commit c9a38a4

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm/config.py

+2-1
Original file line numberDiff line numberDiff line change
@@ -917,7 +917,8 @@ def _verify_args(self) -> None:
917917
raise ValueError(
918918
"GPU memory utilization must be less than 1.0. Got "
919919
f"{self.gpu_memory_utilization}.")
920-
if current_platform.is_cuda() and self.block_size not in [8, 16, 32]:
920+
if (current_platform.is_cuda()
921+
and self.block_size not in [None, 8, 16, 32]):
921922
raise ValueError(
922923
"CUDA Paged Attention kernel only supports "
923924
f"block sizes [8, 16, 32]. Got {self.block_size}.")

0 commit comments

Comments
 (0)