The Quest for Orthologs orthology benchmark service in 2022 is a dataset published in Nucleic Acids Research (2022). On theSindex it has a DataRank of 2.0, placing it in the top 10.9% of the data-sharing corpus. It has been cited 98 times, with 47 citing works in its 1-hop citation network. Its calibrated FAIR score is 38/100.
Ranks in the top 11% for downstream scientific impact
DataRank reads this dataset's downstream impact straight off the citation graph — no black box, no proprietary weighting. How is this computed?
FAIR checklist signals are shown for context only and do not affect DataRank scoring.
Full FAIR picture · advisory
The headline score is computed from the scored criteria — the fact-shaped checks (a repository, an accession, a licence) that two independent models agree on. The advisory criteria below are real FAIR guidance but rest on judgment calls that models read differently, so they inform without moving the number.
“Public benchmark results for the latest release are available on the orthology benchmarking service website (https://orthology.benchmarkservice.org) under the 'Public results' section, 'QfO Benchmark release 2020' subsection.”— not found in the paper; verdict downgraded
The strongest identifier given is a web URL (https://orthology.benchmarkservice.org), which is not a persistent identifier scheme (DOI, Handle, ARK, accession). [downgraded to 'no' — no verifiable quote from the paper]
RDA-F1-01D — FAIR Data Maturity Model: 'Data is identified by a persistent identifier' (priorit · RDA-F1-02D — FAIR Data Maturity Model: 'Data is identified by a globally unique identifier' · FsF-F1-02D — F-UJI/FAIRsFAIR: 'Data is assigned a persistent identifier'
“OpenEBench now makes use of B2SHARE (https://b2share.eudat.eu/) for long-term availability and storage of publicly available QfO datasets.”
B2SHARE is a named repository service (part of EUDAT) that is listed in re3data/FAIRsharing.
RDA-F4-01M — FAIR Data Maturity Model: metadata is offered so it can be harvested and indexed ( · NIH DMS Policy Element 4 (NOT-OD-21-014) — name the repository where data will be archived · NSTC Desirable Characteristics of Data Repositories (2022) — 'Long-Term Sustainability', 'Reten
“Public benchmark results for the latest release are available on the orthology benchmarking service website (https://orthology.benchmarkservice.org) under the 'Public results' section, 'QfO Benchmark release 2020' subsection. Public orthologous pair predictions can be downloaded from the EUDAT platform through links under the 'Public projects'.”— not found in the paper; verdict downgraded
The dataset identifier (URL) appears only in the body text, not in the reference list. [downgraded to 'no' — no verifiable quote from the paper]
FORCE11 Joint Declaration of Data Citation Principles (2014) — data should be cited as a first- · RDA-F3-01M — metadata clearly and explicitly includes the identifier of the data it describes · FsF-F3-01M — F-UJI: 'Metadata includes the identifier of the data it describes'
Advisory · not in the published score
“Public benchmark results for the latest release are available on the orthology benchmarking service website (https://orthology.benchmarkservice.org) under the ‘Public results’ section, ‘QfO Benchmark release 2020’ subsection. Public orthologous pair predictions can be downloaded from the EUDAT platform through links under the ‘Public projects’.”— not found in the paper; verdict downgraded
The Data Availability statement points to a repository (EUDAT) and a website, which is a link to archived data in a public repository (Colavizza category 3). [downgraded to 'partial' — no verifiable quote from the paper] [majority verdict 'partial' (2/3 passes agreed)]
Colavizza, Hrynaszkiewicz, Staden, Whitaker & McGillivray (2020), 'The citation advantage of li · Springer Nature research data policy — Data Availability Statements: standard statement templat · RDA-F3-01M — metadata clearly and explicitly includes the identifier of the data it describes
“The QfO Reference Proteomes are available for download in various formats: the protein sequences as FASTA and SeqXML files, CDS sequences for most proteins as FASTA files, and, for an increasing number of species, genomic locus coordinates are available in the XML format.”— not found in the paper; verdict downgraded
The dataset contents are described in running prose, but there is no itemized inventory (section, table, or list) of files or variables. [downgraded to 'no' — no verifiable quote from the paper]
RDA-F2-01M — 'Rich metadata is provided to allow discovery' (priority Essential) · FsF-F2-01M — F-UJI: 'Metadata includes descriptive core elements to support data findability' · FsF-R1-01MD — F-UJI: 'Metadata specifies the content of the data'
“Public benchmark results for the latest release are available on the orthology benchmarking service website (https://orthology.benchmarkservice.org) under the 'Public results' section, 'QfO Benchmark release 2020' subsection. Public orthologous pair predictions can be downloaded from the EUDAT platform through links under the 'Public projects'.”— not found in the paper; verdict downgraded
The data are stated to be publicly available with no precondition (no registration, embargo, or request required). [downgraded to 'partial' — no verifiable quote from the paper]
RDA-A1.1-01D — 'Data is accessible through a free access protocol' · FsF-A1-01M — F-UJI: 'Metadata contains access level and access conditions of the data' · NSTC Desirable Characteristics of Data Repositories (2022) — 'Free and Easy Access'
Advisory · not in the published score
“Public benchmark results for the latest release are available on the orthology benchmarking service website (https://orthology.benchmarkservice.org) under the 'Public results' section, 'QfO Benchmark release 2020' subsection. Public orthologous pair predictions can be downloaded from the EUDAT platform through links under the 'Public projects'.”— not found in the paper; verdict downgraded
The paper labels the data as 'Public', which is a natural-language synonym for 'openly/publicly available' as per the rubric. [downgraded to 'partial' — no verifiable quote from the paper]
FsF-A1-01M — F-UJI: 'Metadata contains access level and access conditions of the data' · RDA-A1-01M — metadata contains information to enable the user to get access to the data · COAR Controlled Vocabularies — Access Rights v1.0 (open / embargoed / restricted / metadata-onl
The data are not sensitive or human-subject; no gatekeeper is named or needed.
NIH Genomic Data Sharing Policy (NOT-OD-14-124) — controlled-access via a Data Access Committee · RDA-A1.2-01D — 'Data is accessible through an access protocol that supports authentication and · NIH DMS Policy Element 5 (NOT-OD-21-014) — Access, Distribution, or Reuse Considerations (conse
“B2SHARE is the repository service for sharing research data of the EUDAT Data Collaborative Infrastructure (https://eudat.eu/), one of the largest e-infrastructures in Europe offering permanent storage capacity”— not found in the paper; verdict downgraded
The paper states that EUDAT B2SHARE provides permanent storage capacity, implying long-term persistence of the data. [downgraded to 'partial' — no verifiable quote from the paper] [majority verdict 'partial' (2/3 passes agreed)]
NIH DMS Plan Element 4 (NOT-OD-21-014) — Data Preservation, Access, and Associated Timelines · NSTC Desirable Characteristics (2022), Organizational Infrastructure: 'Retention Policy' · RDA-A2-01M — 'Metadata is guaranteed to remain available after data is no longer available'
“the protein sequences as FASTA and SeqXML files, CDS sequences for most proteins as FASTA files, and, for an increasing number of species, genomic locus coordinates are available in the XML format.”— not found in the paper; verdict downgraded
FASTA, XML, and SeqXML are open, non-proprietary formats. [downgraded to 'partial' — no verifiable quote from the paper]
FsF-R1.3-02D — F-UJI: 'Data is available in a file format recommended by the target research co · RDA-R1.3-02D — data is expressed in a machine-understandable community standard · RDA-I1-01D — data uses a knowledge representation expressed in a standardised format
Advisory · not in the published score
“community efforts will be directed into facilitating the adoption of the OrthoXML (37) format for orthogroups or gene tree inference provider as a common format to describe the nature of these relations.”— not found in the paper; verdict downgraded
OrthoXML is a community standard for orthology data, named in the paper. [downgraded to 'partial' — no verifiable quote from the paper] [majority verdict 'partial' (2/3 passes agreed)]
RDA-R1.3-01M — 'Metadata complies with a community standard' (priority Essential) · RDA-R1.3-01D — 'Data complies with a community standard' · RDA-I2-01M — '(Meta)data use vocabularies that follow FAIR principles'
“based on the UniProtKB 2020_04 release”— not found in the paper; verdict downgraded
The paper gives a specific database release identifier (UniProtKB 2020_04) for a resource not produced by this study. [downgraded to 'no' — no verifiable quote from the paper]
RDA-I3-01M — '(meta)data include references to other (meta)data' · RDA-I3-03M — 'metadata includes qualified references to other metadata' · FsF-I3-01M — F-UJI: 'Metadata includes links between the data and its related entities'
No license or terms document is named for the data; the CC-BY license applies only to the article.
RDA-R1.1-01M — 'Metadata includes information about the licence under which the data can be reu · RDA-R1.1-02M — 'Metadata refers to a standard reuse licence' · RDA-R1.1-03M — 'Metadata refers to a machine-understandable reuse licence'
“the latest version (2020) comprises 78 species”
The paper provides a version token ('2020') for the reference proteomes dataset.
DataCite Metadata Schema 4.6 — the 'Version' property · RDA-R1.2-01M — provenance information (which version was used is provenance) · NSTC Desirable Characteristics of Data Repositories (2022) — 'Provenance', 'Retention Policy'
No code repository URL, DOI, or package identifier is given for the study's own code.
NIH DMS Policy Element 2 (NOT-OD-21-014) — 'Related Tools, Software and/or Code' · FAIR4RS Principles v1.0 (Chue Hong et al., 2022; RDA/FORCE11/ReSA) — FAIR Principles for Resear · FORCE11 Software Citation Principles (Smith, Katz & Niemeyer, 2016, PeerJ CS 2:e86)
“National Institutes of Health [U24HG007822 to D.J. and M.J.M., 75N93019C00077 to D.S.R.]”
The paper provides specific grant numbers for named funders. [majority verdict 'yes' (2/3 passes agreed)]
DataCite Metadata Schema 4.6 — 'FundingReference' property (funderName, funderIdentifier, award · Crossref Funder Registry — canonical funder identifiers for funding metadata · RDA-F2-01M — rich metadata provided to allow discovery (funding is part of the descriptive reco
Advisory · not in the published score
“BBH (13) and RSD (14), two naive methods for inferring one-to-one orthologs, were generally outperformed by the publicly available orthology inference algorithms”— not found in the paper; verdict downgraded
The paper names specific methods and tools (BBH, RSD, OMA Groups, etc.) used to produce the data. [downgraded to 'partial' — no verifiable quote from the paper] [majority verdict 'partial' (2/3 passes agreed)]
RDA-R1.2-01M — 'Metadata includes provenance information according to community- specific standa · FsF-R1.2-01M — F-UJI: 'Metadata includes provenance information about data creation or generati · W3C PROV-O (W3C Recommendation, 2013) — the entity/activity/agent model of provenance
“we provide a new STATS file, including a summary of changes to the number of records in the canonical FASTA, additional FASTA and gene symbol to UniProt accession (gene2acc) mapping files, along with report of changes to the source genome assembly for a proteome.”
The STATS file is a documentation object that accompanies the data, defining changes and components.
RDA-R1-01M — '(Meta)data are richly described with a plurality of accurate and relevant attribu · FsF-R1-01MD — F-UJI: 'Metadata specifies the content of the data' · NIH DMS Policy Element 3 (NOT-OD-21-014) — Standards (documentation and metadata to accompany t
Calibrated FAIR score — a parallel quality metric, independent of the DataRank citation score. See the full evaluation →
Base Score Contribution
0.689
From this paper's citation signal
Citation Network Contribution
1.3
From 39 citing papers with measurable signal
Ranked by each citer's contribution to N(p) — log1p(Cq) divided by its reference count — out of 47 citers.
National Institutes of Health
Grant: U24HG007822
National Institutes of Health
Grant: 75N93019C00077
National Human Genome Research Institute
Grant: U24HG003345
JSPS
Grant: 16H06279
JSPS
Grant: 19H05688
JST
Grant: JPMJCR19S2
MEXT
Grant: JPMXD1521474594
Horizon 2020
Grant: 676559
Horizon 2020
Grant: 637765
Wellcome
Grant: 208349/Z/17/Z
National Science Foundation
Grant: 1917302
Wellcome Trust
Grant: WT-218288
Wellcome Trust
Grant: WT-212929
Swiss National Science Foundation
Grant: 186397
Swiss National Science Foundation
Grant: 205085
Wellcome Trust
Grant: 212929
Wellcome Trust
Grant: 218288
Wellcome Trust
ELIXIR
European Molecular Biology Laboratory
FWCI
8.38
Citation Percentile
1.0%
Citation Trend
Fields of Study
MeSH Terms
Keywords
Sustainable Development Goals