Search results

Issue: LongVideoBench Video-LLaVA fails with empty frame list (ValueError: need at least one array to stack)

Status: Open.

#964 In EvolvingLMMs-Lab/lmms-eval;

· omrastogi opened on Jan 1, 2026

Qwen2.5-VL Expect all tensors on the same devices

Status: Open.

#952 In EvolvingLMMs-Lab/lmms-eval;

· yyy195 opened on Dec 27, 2025

wenetspeech_test_net ���单评测接入

Status: Open.

#951 In EvolvingLMMs-Lab/lmms-eval;

· wuyongtai7 opened on Dec 26, 2025

Image features and image tokens do not match

Status: Open.

#948 In EvolvingLMMs-Lab/lmms-eval;

· Resurgamm opened on Dec 23, 2025

MMVet results are low

Status: Open.

#947 In EvolvingLMMs-Lab/lmms-eval;

· Xnhyacinth opened on Dec 23, 2025

The experimental results of Qwen3-VL-8B-Instruct could not be reproduced

Status: Open.

#935 In EvolvingLMMs-Lab/lmms-eval;

· FrankYang-17 opened on Dec 15, 2025

The process can't stop after responding to all samples...

Status: Open.

#934 In EvolvingLMMs-Lab/lmms-eval;

· Maerceci-27 opened on Dec 14, 2025

It costs a long time to test on the DocVQA

Status: Open.

#933 In EvolvingLMMs-Lab/lmms-eval;

· 01upup10 opened on Dec 13, 2025

The test results for Qwen3VL show significant discrepancies compared to the official report.

Status: Open.

#932 In EvolvingLMMs-Lab/lmms-eval;

· Fu-Fu-Fu-Fu opened on Dec 13, 2025

MVBench dataset average result

Status: Open.

#925 In EvolvingLMMs-Lab/lmms-eval;

· ylllllll opened on Dec 8, 2025

用vllm和不用vllm结果差的很多

Status: Open.

#921 In EvolvingLMMs-Lab/lmms-eval;

· Fu-Fu-Fu-Fu opened on Dec 3, 2025

I have a question regarding VLLM parameter settings.

Status: Open.

#920 In EvolvingLMMs-Lab/lmms-eval;

· Fu-Fu-Fu-Fu opened on Dec 2, 2025