Data Descriptor

This repository describes a dataset developed to measure the impact of archival and data curation decisions on data reuse. The dataset describes 10,605 social science research datasets available through ICSPR, their curation histories, and reuse contexts across 94,755 publications covering 59 years from 1963 to 2022. This dataset provides insights into factors that contribute to long-term data reuse, which can inform the design of evidence-based policies for data curation decisions.

The repository contains: 1) original administrative files (/data_original), 2) pre-curated files combined and published as a replication dataset (/data_transform), and 3) notebooks to prepare data for curation at ICPSR (/notebooks). The final dataset, "Measuring the Impact of Curation Actions: ICPSR Administrative Data, 1984-2021 (ICPSR-192113)," will be available through ICSPR: https://doi.org/10.3886/ICPSR192113.

Sources

• /data_original
  • enriched_bibliography.csv (Dimensions database API search; used to expand ICPSR Bibliography)
  • ICPSR_bib_studies_20211111.xlsx (DBInfo: Study and Bibliography paper metadata; used in JASIST, ASIS&T, QSS analyses)
  • ICPSR_combined_study_usage_20210430_onlyData_noAllREST.xlsx (DBInfo: data file downloads per study; used in regression analysis studing curation level and data reuse for JASIST)
  • jira_curation_level_20210426_by_study.csv (DBInfo: study curation level; used in regression analysis studing curation level and data reuse for JASIST)
  • predicted_curation_by_study.csv (Jira: study level work log sentences - classified; used in eScience analysis of curation effort and activities)
  • variable_counts_by_study.csv (DBInfo: study variables by data files; used in regression analysis studing curation level and data reuse for JASIST)

• /data_transform
  • ICPSR_CURATION_LOGS.csv (each row is one activity classified from a Jira study-level curation work log)
  • ICPSR_PAPERS.csv (each row is one publication in the ICPSR Bibliography that cites one or more studies)
  • ICPSR_STUDIES.csv (each row is one study in the ICPSR catalog and its usage information until pull date)

Outputs

• Bleckley, D., Lafia, S., and Hemphill, L. (2023) Describing Data Transformation Work in a Changing Data Curation Community. Research Data Access and Preservation (RDAP) Summit. Online. March 28.
• Lafia, S., Fan, L., Thomer, A., & Hemphill, L. (2022). Subdivisions and Crossroads: Identifying Hidden Community Structures in a Data Archive’s Citation Network. Quantitative Science Studies (QSS), 3(3), 694-714. doi: 10.1162/qss_a_00209
• Lafia, S., Fan, L., and Hemphill, L. (2022). A Natural Language Processing Pipeline for Detecting Informal Data References in Academic Literature. Proceedings of the Association for Information Science and Technology (ASIS&T), 59(1), 169-178. doi:10.1002/pra2.614
• Hemphill, L., Pienta, A., Lafia, S., Akmon, D., & Bleckley, D. (2022). How do properties of data, their curation, and their funding relate to reuse?. Journal of the Association for Information Science and Technology (JASIST), 73(10), 1432-1444. doi:10.1002/asi.24646
• Lafia, S., Thomer, A., Bleckley, D., Akmon, D., & Hemphill, L. (2021). Leveraging Machine Learning to Detect Data Curation Activities. In 2021 IEEE 17th International Conference on eScience (eScience) (pp. 149-158). IEEE. doi:10.1109/eScience51609.2021.00025

Entity-Relation Diagram

Variables

• /data_transform/ICPSR_CURATION_LOGS.csv
  • STUDY = ICPSR study number
  • ACTION_LABEL = label assigned to work log text ('Metadata-study-level', 'Quality-checks', 'Non-curation', 'Initial-review-and-planning', 'Communication-for-study', 'Transformation-of-data', 'Documentation', 'Other')
  • LOG_HRS = fraction of study work time associated with action label
  • STUDY_HRS = total study work time logged in ticket
• /data_transform/ICPSR_PAPERS.csv (Date papers added: 2000-08-11 to 2021-11-16; Dimensions: 2021-11-09)
  • REF_ID = ICPSR paper number
  • DOI = paper digital object identifier
  • TITLE = official paper title
  • AUTHORS = researchers who authored paper
  • SEC_TITLE = name of publication outlet
  • RIS_TYPE = type of publication ('NEWS', 'JOUR', 'RPRT', 'MGZN', 'ADVS', 'BOOK', 'CHAP', 'CONF', 'ELEC', 'GEN', 'THES')
  • FUNDER = organization names that supported data production and/or archiving
  • YEAR_PUB = year paper added to ICPSR Bibliography
  • DATE_INPUT = year paper was first published
  • SERIES_NUMS = ICPSR series number of studies used in paper
  • STUDY_NUMS = ICPSR study numbers used in paper
  • DIM_ID = Dimensions database identifiers to get enriched metadata
  • DIM_LINKOUT = Dimensions database URL link to full text including abstracts

• /data_transform/ICPSR_STUDIES.csv (Date studies released: 1984-03-18 to 2021-11-16)
  • STUDY = ICPSR study number
  • DOI = ICPSR study digital object identifier
  • NAME = official ICPSR study name
  • SERIES = ICPSR series number
  • SERIES_TITLE = official ICPSR series title
  • PRINCIPAL_INV = authoring entities for the study
  • DESCRIPTION = text abstract of the study's subject matter or intellectual content
  • RELEASE_DATE = m/dd/yyyy date when the data collection was first distributed by ICPSR
  • FUNDING_AGENCY = organizations that supported production and/or archiving of the data
  • GEO = ICPSR defined geographic areas covered in data collection
  • TERMS = ICPSR controlled subject terms covered in data collection
  • OWNER = archive owner for the data ('ICPSR', 'NACJD', 'DSDR', 'RCMD', 'NAHDAP', 'NACDA', 'NADAC', 'HMCA', 'CFDA', 'civicleads', 'AERA', 'METLDB', 'APA', 'UCC', 'ADDEP', 'odf', 'gmsdata', 'pcoridata', 'pcodr', 'DAIRL', 'appfed')
  • CURATION_LEVEL = level specifying the set of curation activities to be performed on a given dataset ('Fast Release', 'Level 0', 'Level 1', 'Level 2', 'Level 3', 'Other')
  • SINGLE_PI = study has one PI entity (0=no, 1=yes)
  • INST_PI = study has one or more institutional PIs (0=no, 1=yes)
  • TOT_PI = total count of PIs for a study
  • TOTAL_VARS = count of variables for all data files per study
  • SDA = study data made available for online analysis (0=no, 1=yes)
  • QTEXT = study question text from surveys made searchable (0=no, 1=yes)
  • SSVD = study variables indexed in social science variable database (0=no, 1=yes)
  • HAS_RESTRICTED = study contains one or more restricted files (0=no, 1=yes)
  • ALL_RESTRICTED = full study is restricted and no download information is available (0=no, 1=yes)
  • USERS_TO_20210511 = count of unique users downloading study data files, codebooks, or other to 2021
  • DATAUSERS_TO_20210511 = count of unique users downloading study data files only to 2021
  • CITATIONS_TO_20211116 = count of unique papers citing study to 2021