[Bugfix] Only add Attention.kv_scale if kv cache quantization is enabled#5936
Merged
mgoin merged 2 commits intomainfrom bugfix-explicit-kv-scaleJun 28, 2024
+14-9
Attention.kv_scale if kv cache quantization is enabled#5936