BEnchmarking Large Language Models for Ophthalmology (BELO): An Expert-Curated Data Set and Evaluation Framework for Knowledge and Reasoning is a dataset published in Ophthalmology Science (2025). On theSindex it has a DataRank of 0.104, placing it in the top 77.8% of the data-sharing corpus. It has been cited 1 time, with 1 citing works in its 1-hop citation network. Its calibrated FAIR score is 21/100.
Ranks in the top 78% for downstream scientific impact
Linked data & code
DataRank reads this dataset's downstream impact straight off the citation graph — no black box, no proprietary weighting. How is this computed?
FAIR checklist signals are shown for context only and do not affect DataRank scoring.
Full FAIR picture · advisory
The headline score is computed from the scored criteria — the fact-shaped checks (a repository, an accession, a licence) that two independent models agree on. The advisory criteria below are real FAIR guidance but rest on judgment calls that models read differently, so they inform without moving the number.
No persistent identifier (DOI, Handle, ARK, URN, or repository accession) is given for the dataset; the only URL is for the leaderboard, not the data. [majority verdict 'no' (3/5 passes agreed)]
RDA-F1-01D — FAIR Data Maturity Model: 'Data is identified by a persistent identifier' (priorit · RDA-F1-02D — FAIR Data Maturity Model: 'Data is identified by a globally unique identifier' · FsF-F1-02D — F-UJI/FAIRsFAIR: 'Data is assigned a persistent identifier'
No repository is named as the holder; the data are held by the authors and accessed via a data usage agreement.
RDA-F4-01M — FAIR Data Maturity Model: metadata is offered so it can be harvested and indexed ( · NIH DMS Policy Element 4 (NOT-OD-21-014) — name the repository where data will be archived · NSTC Desirable Characteristics of Data Repositories (2022) — 'Long-Term Sustainability', 'Reten
No identifier for the dataset appears anywhere in the text, neither in the reference list nor in the body. [majority verdict 'no' (3/5 passes agreed)]
FORCE11 Joint Declaration of Data Citation Principles (2014) — data should be cited as a first- · RDA-F3-01M — metadata clearly and explicitly includes the identifier of the data it describes · FsF-F3-01M — F-UJI: 'Metadata includes the identifier of the data it describes'
Advisory · not in the published score
“Data Availability All data can be provided upon reasonable request and evaluation.”
The statement points to the authors (request) rather than to a repository record, placing it in Colavizza category 1.
Colavizza, Hrynaszkiewicz, Staden, Whitaker & McGillivray (2020), 'The citation advantage of li · Springer Nature research data policy — Data Availability Statements: standard statement templat · RDA-F3-01M — metadata clearly and explicitly includes the identifier of the data it describes
“Table 1 Compositions of the Curated BELO Data Set”
The paper provides an itemized inventory of the dataset's composition in a table, which is a structural text object. [majority verdict 'yes' (4/5 passes agreed)]
RDA-F2-01M — 'Rich metadata is provided to allow discovery' (priority Essential) · FsF-F2-01M — F-UJI: 'Metadata includes descriptive core elements to support data findability' · FsF-R1-01MD — F-UJI: 'Metadata specifies the content of the data'
“Contingent on signing a data usage agreement, stipulating that they would use BELO for validation only, we will then pass the questions to them but without the ground truth answers.”
The text specifies a followable access process with a precondition (signing a data usage agreement), which is a defined, institutional step. [majority verdict 'partial' (3/5 passes agreed)]
RDA-A1.1-01D — 'Data is accessible through a free access protocol' · FsF-A1-01M — F-UJI: 'Metadata contains access level and access conditions of the data' · NSTC Desirable Characteristics of Data Repositories (2022) — 'Free and Easy Access'
Advisory · not in the published score
“All data can be provided upon reasonable request and evaluation.”
The text describes an access action (request and evaluation) but does not apply an explicit access-level label from the standard vocabulary.
FsF-A1-01M — F-UJI: 'Metadata contains access level and access conditions of the data' · RDA-A1-01M — metadata contains information to enable the user to get access to the data · COAR Controlled Vocabularies — Access Rights v1.0 (open / embargoed / restricted / metadata-onl
“All data can be provided upon reasonable request and evaluation.”
The gatekeeper is a natural person (the authors), as the data are obtainable only by asking them. [majority verdict 'partial' (3/5 passes agreed)]
NIH Genomic Data Sharing Policy (NOT-OD-14-124) — controlled-access via a Data Access Committee · RDA-A1.2-01D — 'Data is accessible through an access protocol that supports authentication and · NIH DMS Policy Element 5 (NOT-OD-21-014) — Access, Distribution, or Reuse Considerations (conse
“the BELO data set will remain a hold-out, evaluation-only benchmark to ensure fair and reproducible comparisons of future models.”
The text states that the dataset will remain available indefinitely as a hold-out benchmark, implying a persistence commitment.
NIH DMS Plan Element 4 (NOT-OD-21-014) — Data Preservation, Access, and Associated Timelines · NSTC Desirable Characteristics (2022), Organizational Infrastructure: 'Retention Policy' · RDA-A2-01M — 'Metadata is guaranteed to remain available after data is no longer available'
“These data sets were then standardized and formatted into JavaScript Object Notation files”
JSON is an open, community-standard format.
FsF-R1.3-02D — F-UJI: 'Data is available in a file format recommended by the target research co · RDA-R1.3-02D — data is expressed in a machine-understandable community standard · RDA-I1-01D — data uses a knowledge representation expressed in a standardised format
Advisory · not in the published score
“Our study adheres to the Declaration of Helsinki and follows the Strengthening the Reporting of Observational Studies in Epidemiology reporting guideline.”
The only named standard is a manuscript reporting guideline (STROBE), not a data or metadata community standard. [majority verdict 'partial' (4/5 passes agreed)]
RDA-R1.3-01M — 'Metadata complies with a community standard' (priority Essential) · RDA-R1.3-01D — 'Data complies with a community standard' · RDA-I2-01M — '(Meta)data use vocabularies that follow FAIR principles'
No identifier (accession, DOI, RRID, etc.) is given for any external resource that the data depend on or derive from. [majority verdict 'no' (4/5 passes agreed)]
RDA-I3-01M — '(meta)data include references to other (meta)data' · RDA-I3-03M — 'metadata includes qualified references to other metadata' · FsF-I3-01M — F-UJI: 'Metadata includes links between the data and its related entities'
No licence or terms document is named for the data; the CC BY-NC-ND licence applies to the article, not the data. [majority verdict 'no' (3/5 passes agreed)]
RDA-R1.1-01M — 'Metadata includes information about the licence under which the data can be reu · RDA-R1.1-02M — 'Metadata refers to a standard reuse licence' · RDA-R1.1-03M — 'Metadata refers to a machine-understandable reuse licence'
No version token or date is given to pin the snapshot of the dataset.
DataCite Metadata Schema 4.6 — the 'Version' property · RDA-R1.2-01M — provenance information (which version was used is provenance) · NSTC Desirable Characteristics of Data Repositories (2022) — 'Provenance', 'Retention Policy'
No code location is provided; the study's own code is not mentioned beyond the use of Python, and no repository or DOI is given.
NIH DMS Policy Element 2 (NOT-OD-21-014) — 'Related Tools, Software and/or Code' · FAIR4RS Principles v1.0 (Chue Hong et al., 2022; RDA/FORCE11/ReSA) — FAIR Principles for Resear · FORCE11 Software Citation Principles (Smith, Katz & Niemeyer, 2016, PeerJ CS 2:e86)
“4R00LM014024”
An award number is given for a funder (NIH/NLM), satisfying the requirement for an alphanumeric grant identifier.
DataCite Metadata Schema 4.6 — 'FundingReference' property (funderName, funderIdentifier, award · Crossref Funder Registry — canonical funder identifiers for funding metadata · RDA-F2-01M — rich metadata provided to allow discovery (funding is part of the descriptive reco
Advisory · not in the published score
“We extracted ophthalmic QA pairs from these data sets using 2 approaches: keyword matching and a fine-tuned PubMedBERT-based approach”— not found in the paper; verdict downgraded
The paper names the specific tool (PubMedBERT) used to produce the data. [downgraded to 'partial' — no verifiable quote from the paper] [majority verdict 'partial' (2/5 passes agreed)]
RDA-R1.2-01M — 'Metadata includes provenance information according to community- specific standa · FsF-R1.2-01M — F-UJI: 'Metadata includes provenance information about data creation or generati · W3C PROV-O (W3C Recommendation, 2013) — the entity/activity/agent model of provenance
“Table 1 Compositions of the Curated BELO Data Set”
Variable-level definitions are provided inside the article (Table 1), but no documentation object is said to accompany the data. [majority verdict 'partial' (4/5 passes agreed)]
RDA-R1-01M — '(Meta)data are richly described with a plurality of accurate and relevant attribu · FsF-R1-01MD — F-UJI: 'Metadata specifies the content of the data' · NIH DMS Policy Element 3 (NOT-OD-21-014) — Standards (documentation and metadata to accompany t
Calibrated FAIR score — a parallel quality metric, independent of the DataRank citation score. See the full evaluation →
Base Score Contribution
0.104
From this paper's citation signal
Citation Network Contribution
0
From 0 citing papers with measurable signal
This paper's DataRank is currently driven only by its base citation score. None of the citing papers had measurable citation signal.
Learn more about DataRank methodology →National Library of Medicine
Grant: 4R00LM014024
National Medical Research Council
Grant: NMRC/MOH/HCSAINV25jan-0003
National Medical Research Council
Grant: NMRC/MOH/ HCSAINV21nov-0001
NLM NIH HHS
Grant: R00 LM014024
NLM NIH HHS
Grant: R01 LM014604
National Institutes of Health
National University of Singapore
FWCI
0.31
Citation Percentile
0.7%
Citation Trend
Fields of Study
Keywords
Sustainable Development Goals