[Question] Cannot reproduce LLaVA-1.5-7b performance on MME with lmms-eval

[DogNeverSleep]

Question

Hi there.
We cannot reproduce MME results following finetune.sh on 665k instruction tuning dataset. We followed all the training settings(pretrain+sft), but get 1497/289 on MME with lmms-eval.

[muktilin]

I also get the similar results:

[DogNeverSleep]

I also get the similar results:我也得到了类似的结果：

same issue, please inform me if you solve it, thanks!!!