MarathonDocBench 由百度推出,針對 100–300 頁中英檔案的跨頁解析進行評測。
- 資料規模:100 篇檔案、約 18,000 頁、205,000 標註佈局元素。
AI 伴隨問答
針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:
Baidu's MarathonDocBench evaluates the parsing of 100–300-page Chinese and English documents, including cross-page text, tables, and document structure. 🤖https://t.co/NmIpDtAWea
📚 Hundred-page scale: 100 documents, approximately 18,000 pages, and 205,000 annotated layout elements.
🔗 Structure across pages: Human-refined annotations cover bounding boxes, heading hierarchy, reading order, and cross-page text and table continuations.
🧪 Document-level evaluation: Reuses MPDocBench-Parse's eight metrics to assess text, tables, formulas, reading order, figures, and heading structure. Overall is their mean.
📊 A demanding test: Listed general-purpose VLMs score below 34 Overall under the published whole-document protocol, which counts failed requests as empty predictions. Input and output limits also affect results.
📜 Apache-2.0 License.