Observer: creation of a novel multimodal dataset for outpatient care research is a dataset published in Journal of the American Medical Informatics Association (2025). On theSindex it has a DataRank of 0, placing it in the top 100% of the data-sharing corpus. Its calibrated FAIR score is 50/100.
Ranks in the top 100% for downstream scientific impact
DataRank reads this dataset's downstream impact straight off the citation graph — no black box, no proprietary weighting. How is this computed?
FAIR checklist signals are shown for context only and do not affect DataRank scoring.
Full FAIR picture · advisory
The headline score is computed from the scored criteria — the fact-shaped checks (a repository, an accession, a licence) that two independent models agree on. The advisory criteria below are real FAIR guidance but rest on judgment calls that models read differently, so they inform without moving the number.
“https://observer.med.upenn.edu/”
The dataset is identified by a web URL (not a DOI, Handle, ARK, or repository accession), which is class 2.
RDA-F1-01D — FAIR Data Maturity Model: 'Data is identified by a persistent identifier' (priorit · RDA-F1-02D — FAIR Data Maturity Model: 'Data is identified by a globally unique identifier' · FsF-F1-02D — F-UJI/FAIRsFAIR: 'Data is assigned a persistent identifier'
“All data packages are stored in a secure institutional archive, with download access granted through a verification process modeled after the MIMIC framework.”
The named holder is a 'secure institutional archive' (not a named repository listed in re3data/FAIRsharing), so it is a non-repository host.
RDA-F4-01M — FAIR Data Maturity Model: metadata is offered so it can be harvested and indexed ( · NIH DMS Policy Element 4 (NOT-OD-21-014) — name the repository where data will be archived · NSTC Desirable Characteristics of Data Repositories (2022) — 'Long-Term Sustainability', 'Reten
“The Observer dataset is available at https://observer.med.upenn.edu/ .”
The dataset identifier (URL) appears only in the body text, not as a reference-list entry.
FORCE11 Joint Declaration of Data Citation Principles (2014) — data should be cited as a first- · RDA-F3-01M — metadata clearly and explicitly includes the identifier of the data it describes · FsF-F3-01M — F-UJI: 'Metadata includes the identifier of the data it describes'
Advisory · not in the published score
“The Observer dataset is available at https://observer.med.upenn.edu/ . Requests for access to its data may be made by following the instructions on that website.”
The statement points to a URL (project website), not a repository record with an accession or DOI, so it is a partial Colavizza category 2/3 hybrid but not a repository record.
Colavizza, Hrynaszkiewicz, Staden, Whitaker & McGillivray (2020), 'The citation advantage of li · Springer Nature research data policy — Data Availability Statements: standard statement templat · RDA-F3-01M — metadata clearly and explicitly includes the identifier of the data it describes
“The Observer dataset comprises 110 outpatient primary care visits, each recorded using a standardized protocol. For each visit, Observer includes: Room-view video recordings... Egocentric videos... EHR-derived audit logs... Structured metadata... Survey results... Transcripts... Clinical notes... Vital signs and measurements...”— not found in the paper; verdict downgraded
The paper provides an itemised inventory of the dataset components (bulleted list), which is a class 1 artefact. [downgraded to 'partial' — no verifiable quote from the paper] [majority verdict 'partial' (3/5 passes agreed)]
RDA-F2-01M — 'Rich metadata is provided to allow discovery' (priority Essential) · FsF-F2-01M — F-UJI: 'Metadata includes descriptive core elements to support data findability' · FsF-R1-01MD — F-UJI: 'Metadata specifies the content of the data'
“Requests for access to its data may be made by following the instructions on that website.”
The text includes a defined, followable process (verification procedure) rather than a completely open unconditional access or a discretionary request to a person.
RDA-A1.1-01D — 'Data is accessible through a free access protocol' · FsF-A1-01M — F-UJI: 'Metadata contains access level and access conditions of the data' · NSTC Desirable Characteristics of Data Repositories (2022) — 'Free and Easy Access'
Advisory · not in the published score
“Requests for access to its data may be made by following the instructions on that website.”
The text describes the access process but does not label the access level with a standard vocabulary term like 'restricted' or 'open access'. [majority verdict 'partial' (4/5 passes agreed)]
FsF-A1-01M — F-UJI: 'Metadata contains access level and access conditions of the data' · RDA-A1-01M — metadata contains information to enable the user to get access to the data · COAR Controlled Vocabularies — Access Rights v1.0 (open / embargoed / restricted / metadata-onl
“All data packages are stored in a secure institutional archive, with download access granted through a verification process modeled after the MIMIC framework.”
The data are sensitive (video of clinical encounters) and the gatekeeper is an institutional verification process, not a natural person.
NIH Genomic Data Sharing Policy (NOT-OD-14-124) — controlled-access via a Data Access Committee · RDA-A1.2-01D — 'Data is accessible through an access protocol that supports authentication and · NIH DMS Policy Element 5 (NOT-OD-21-014) — Access, Distribution, or Reuse Considerations (conse
“All data packages are stored in a secure institutional archive, with download access granted through a verification process modeled after the MIMIC framework.”
The text states the data are stored in an institutional archive but does not specify how long they will remain available or make a persistence commitment.
NIH DMS Plan Element 4 (NOT-OD-21-014) — Data Preservation, Access, and Associated Timelines · NSTC Desirable Characteristics (2022), Organizational Infrastructure: 'Retention Policy' · RDA-A2-01M — 'Metadata is guaranteed to remain available after data is no longer available'
“We provide standardized file formats (MP4 for video, CSV for logs and metadata, and JSON for annotations)”
The paper names MP4, CSV, and JSON, all of which are open, non-proprietary formats.
FsF-R1.3-02D — F-UJI: 'Data is available in a file format recommended by the target research co · RDA-R1.3-02D — data is expressed in a machine-understandable community standard · RDA-I1-01D — data uses a knowledge representation expressed in a standardised format
Advisory · not in the published score
“mapping medical data to standard vocabularies using the OMOP table schema for Observer data.”
The paper names OMOP (Observational Medical Outcomes Partnership) common data model, which is a community standard for observational data, registered in FAIRsharing.
RDA-R1.3-01M — 'Metadata complies with a community standard' (priority Essential) · RDA-R1.3-01D — 'Data complies with a community standard' · RDA-I2-01M — '(Meta)data use vocabularies that follow FAIR principles'
No identifier for any external resource (e.g., another dataset, reference genome, code repository) is provided; tools are mentioned only by name. [majority verdict 'no' (3/5 passes agreed)]
RDA-I3-01M — '(meta)data include references to other (meta)data' · RDA-I3-03M — 'metadata includes qualified references to other metadata' · FsF-I3-01M — F-UJI: 'Metadata includes links between the data and its related entities'
“providing clear usage licenses”
No specific license name is given; the text only mentions 'clear usage licenses' without identifying one.
RDA-R1.1-01M — 'Metadata includes information about the licence under which the data can be reu · RDA-R1.1-02M — 'Metadata refers to a standard reuse licence' · RDA-R1.1-03M — 'Metadata refers to a machine-understandable reuse licence'
No version token or date is provided for the dataset; the dataset is referred to as a growing collection without a fixed snapshot identifier.
DataCite Metadata Schema 4.6 — the 'Version' property · RDA-R1.2-01M — provenance information (which version was used is provenance) · NSTC Desirable Characteristics of Data Repositories (2022) — 'Provenance', 'Retention Policy'
“All code related to this project is available on GitHub, at https://github.com/kbjohnson-penn/observer_frontend”
The code is available at a GitHub repository URL, which is a machine-resolvable locator.
NIH DMS Policy Element 2 (NOT-OD-21-014) — 'Related Tools, Software and/or Code' · FAIR4RS Principles v1.0 (Chue Hong et al., 2022; RDA/FORCE11/ReSA) — FAIR Principles for Resear · FORCE11 Software Citation Principles (Smith, Katz & Niemeyer, 2016, PeerJ CS 2:e86)
“This work was supported by the National Library of Medicine and the NIH Office of the Director under project number 5DP1LM014558-03 (Former Number: 1DP1OD035237-01)”
The paper provides both the funder names and the specific award/grant numbers. [majority verdict 'yes' (4/5 passes agreed)]
DataCite Metadata Schema 4.6 — 'FundingReference' property (funderName, funderIdentifier, award · Crossref Funder Registry — canonical funder identifiers for funding metadata · RDA-F2-01M — rich metadata provided to allow discovery (funding is part of the descriptive reco
Advisory · not in the published score
“We selected the following: Room-view camera with a microphone array and a 360-degree room view, connected to a local Zoom session, monitored by a research assistant outside the room. Camera worn on the head at eye level, providing both a microphone and a video from the wearer’s perspective (egocentric view), offered to both the PCP and the patient.”
The text names specific instruments (room-view camera, egocentric camera, Zoom) and software (MedVidDeID, WhisperX, YOLOv11) used to produce the data. [majority verdict 'yes' (3/5 passes agreed)]
RDA-R1.2-01M — 'Metadata includes provenance information according to community- specific standa · FsF-R1.2-01M — F-UJI: 'Metadata includes provenance information about data creation or generati · W3C PROV-O (W3C Recommendation, 2013) — the entity/activity/agent model of provenance
“along with accompanying documentation that describes data provenance, schema definitions, and known quality attributes.”
The paper states that documentation (including schema definitions) is shipped with the data, satisfying the 'shipped with the data' class.
RDA-R1-01M — '(Meta)data are richly described with a plurality of accurate and relevant attribu · FsF-R1-01MD — F-UJI: 'Metadata specifies the content of the data' · NIH DMS Policy Element 3 (NOT-OD-21-014) — Standards (documentation and metadata to accompany t
Calibrated FAIR score — a parallel quality metric, independent of the DataRank citation score. See the full evaluation →