Search results

Important context information missing for some Qasper tasks in LongBench v1

Status: Open.

#130 In THUDM/LongBench;

· VisionTheta opened on Jun 24, 2025

o3?

Status: Open.

#129 In THUDM/LongBench;

· OverLordGoldDragon opened on Jun 6, 2025

数据集问题：ID 66f39ac5821e116aacb2da81 的答案无法在 context 中找到

enhancementNew feature or requestNew feature or request

Status: Open.

Bug

#128 In THUDM/LongBench;

· xcczach opened on May 13, 2025

怎么测试qwen2.5系列模型

Status: Open.

#127 In THUDM/LongBench;

· leileilin opened on May 12, 2025

[error need help] error to run longbench V1 following the document

Status: Open.

#125 In THUDM/LongBench;

· gaowayne opened on Apr 26, 2025

[bugs and help need] I followed main readme page guideline, there is connection error and model running error

Status: Open.

#124 In THUDM/LongBench;

· gaowayne opened on Apr 26, 2025

How you evaluate reasoning models like QwQ-32B, since the response time and token length is very long?

Status: Open.

#123 In THUDM/LongBench;

· txchen-USTC opened on Apr 21, 2025

Reproducibility Question

Status: Open.

#119 In THUDM/LongBench;

· qinchuanhui opened on Apr 3, 2025

A bug that has been mentioned many times: 'NoneType' object is not callable

Status: Open.

#118 In THUDM/LongBench;

· zZzZ9zZ9 opened on Apr 1, 2025

Created a markdown version on GitHub

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#117 In THUDM/LongBench;

· itsnamgyu opened on Mar 26, 2025

Do models really answer directly in the non-CoT setting?

Status: Open.

#116 In THUDM/LongBench;

· itsnamgyu opened on Mar 23, 2025

Confused about many shot learning problems (eg #340)

Status: Open.

#115 In THUDM/LongBench;

· Naqu6 opened on Mar 22, 2025