Refactor archive clean datasets #3933
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
⌛ Merge Schedule |
|
Quick links (staging server):
Login: chart-diff: ✅No charts for review.data-diff: ❌ Found differences= Dataset garden/oecd/2024-12-30/family_database
= Table family_database
~ Dim country
+ + New values: 66 / 2691 (2.45%)
year country
1919 United States
1920 United States
1938 United States
1949 United States
1957 United States
~ Dim year
+ + New values: 66 / 2691 (2.45%)
country year
United States 1919
United States 1920
United States 1938
United States 1949
United States 1957
~ Column child_poverty_rate (new data)
+ + New values: 66 / 2691 (2.45%)
country year child_poverty_rate
United States 1919 <NA>
United States 1920 <NA>
United States 1938 <NA>
United States 1949 <NA>
United States 1957 <NA>
~ Column crude_divorce_rate__divorces_per_1000_people (changed metadata, new data, changed data)
+ + {}
- - title: Crude divorce rate (divorces per 1,000 people)
- - description_short: Number of divorces during a given year per 1,000 people.
- - description_from_producer: The crude divorce rate is defined as the number of divorces during a given year per 1,000 people.
- - origins:
- - - producer: OECD
- - title: OECD Family Dabatabse
- - description: |-
- - The OECD Family Database provides cross-national indicators on family outcomes and family policies across the OECD countries, its enhanced engagement partners and EU member states. It includes 70 indicators under four main dimensions: (i) structure of families, (ii) labour market position of families, (iii) public policies for families and children and (iv) child outcomes.
- - citation_full: OECD (2024). OECD Family Database.
- - url_main: |-
- - https://data-explorer.oecd.org/vis?tenant=archive&df=DisseminateArchiveDMZ&df=DF_FAMILY&df=OECD&dq=..FAM14%2BFAM13%2BFAM15A%2BFAM15B%2BFAM10C%2BFAM10B%2BFAM10A%2BFAM9C%2BFAM9A%2BFAM9B%2BFAM7%2BFAM17%2BFAM8C%2BFAM8B%2BFAM11D%2BFAM11C%2BFAM11B%2BFAM11A%2BFAM8A%2BFAM5C%2BFAM5B%2BFAM5A%2BFAM4B%2BFAM12A%2BFAM12B%2BFAM4A%2BFAM3&pd=1960%2C2022&to[TIME_PERIOD]=false&vw=tb
- - url_download: |-
- - https://sdmx.oecd.org/archive/rest/data/OECD,DF_FAMILY,/..FAM14+FAM13+FAM15A+FAM15B+FAM10C+FAM10B+FAM10A+FAM9C+FAM9A+FAM9B+FAM7+FAM17+FAM8C+FAM8B+FAM11D+FAM11C+FAM11B+FAM11A+FAM8A+FAM5C+FAM5B+FAM5A+FAM4B+FAM12A+FAM12B+FAM4A+FAM3?startPeriod=1960&endPeriod=2022&dimensionAtObservation=AllDimensions&format=csvfilewithlabels
- - date_accessed: '2024-12-30'
- - date_published: '2024-03-27'
- - license:
- - name: OECD Terms of Conditions
- - url: https://www.oecd.org/en/about/terms-conditions.html
- - unit: per 1,000 people
- - short_unit: per 1,000 people
- - display:
- - numDecimalPlaces: 1
- - presentation:
- - topic_tags:
- - - Marriages & Divorces
+ + New values: 66 / 2691 (2.45%)
country year crude_divorce_rate__divorces_per_1000_people
United States 1919 NaN
United States 1920 NaN
United States 1938 NaN
United States 1949 NaN
United States 1957 NaN
~ Changed values: 2056 / 2691 (76.40%)
country year crude_divorce_rate__divorces_per_1000_people - crude_divorce_rate__divorces_per_1000_people +
Austria 1994 2.1 NaN
Canada 2007 2.2 NaN
Denmark 2019 1.8 NaN
Estonia 1969 3.3 NaN
Greece 2017 1.8 NaN
~ Column crude_marriage_rate__marriages_per_1000_people (changed metadata, new data, changed data)
+ + {}
- - title: Crude marriage rate (marriages per 1,000 people)
- - description_short: Number of marriages during a given year per 1,000 people.
- - description_from_producer: The crude marriage rate is defined as the number of marriages during a given year per 1,000 people.
- - origins:
- - - producer: OECD
- - title: OECD Family Dabatabse
- - description: |-
- - The OECD Family Database provides cross-national indicators on family outcomes and family policies across the OECD countries, its enhanced engagement partners and EU member states. It includes 70 indicators under four main dimensions: (i) structure of families, (ii) labour market position of families, (iii) public policies for families and children and (iv) child outcomes.
- - citation_full: OECD (2024). OECD Family Database.
- - url_main: |-
- - https://data-explorer.oecd.org/vis?tenant=archive&df=DisseminateArchiveDMZ&df=DF_FAMILY&df=OECD&dq=..FAM14%2BFAM13%2BFAM15A%2BFAM15B%2BFAM10C%2BFAM10B%2BFAM10A%2BFAM9C%2BFAM9A%2BFAM9B%2BFAM7%2BFAM17%2BFAM8C%2BFAM8B%2BFAM11D%2BFAM11C%2BFAM11B%2BFAM11A%2BFAM8A%2BFAM5C%2BFAM5B%2BFAM5A%2BFAM4B%2BFAM12A%2BFAM12B%2BFAM4A%2BFAM3&pd=1960%2C2022&to[TIME_PERIOD]=false&vw=tb
- - url_download: |-
- - https://sdmx.oecd.org/archive/rest/data/OECD,DF_FAMILY,/..FAM14+FAM13+FAM15A+FAM15B+FAM10C+FAM10B+FAM10A+FAM9C+FAM9A+FAM9B+FAM7+FAM17+FAM8C+FAM8B+FAM11D+FAM11C+FAM11B+FAM11A+FAM8A+FAM5C+FAM5B+FAM5A+FAM4B+FAM12A+FAM12B+FAM4A+FAM3?startPeriod=1960&endPeriod=2022&dimensionAtObservation=AllDimensions&format=csvfilewithlabels
- - date_accessed: '2024-12-30'
- - date_published: '2024-03-27'
- - license:
- - name: OECD Terms of Conditions
- - url: https://www.oecd.org/en/about/terms-conditions.html
- - unit: per 1,000 people
- - short_unit: ''
- - display:
- - numDecimalPlaces: 1
- - presentation:
- - topic_tags:
- - - Marriages & Divorces
+ + New values: 66 / 2691 (2.45%)
country year crude_marriage_rate__marriages_per_1000_people
United States 1919 NaN
United States 1920 NaN
United States 1938 NaN
United States 1949 NaN
United States 1957 NaN
~ Changed values: 2333 / 2691 (86.70%)
country year crude_marriage_rate__marriages_per_1000_people - crude_marriage_rate__marriages_per_1000_people +
Estonia 2000 3.9 NaN
Greece 2005 5.5 NaN
Italy 2004 4.3 NaN
Malta 1980 8.8 NaN
United States 2012 6.8 NaN
~ Column divorce_rate (changed metadata, new data, changed data)
- - {}
+ + title: Crude divorce rate (divorces per 1,000 people)
+ + description_short: Number of divorces during a given year per 1,000 people.
+ + description_from_producer: The crude divorce rate is defined as the number of divorces during a given year per 1,000 people.
+ + origins:
+ + - producer: OECD
+ + title: OECD Family Dabatabse
+ + description: |-
+ + The OECD Family Database provides cross-national indicators on family outcomes and family policies across the OECD countries, its enhanced engagement partners and EU member states. It includes 70 indicators under four main dimensions: (i) structure of families, (ii) labour market position of families, (iii) public policies for families and children and (iv) child outcomes.
+ + citation_full: OECD (2024). OECD Family Database.
+ + url_main: |-
+ + https://data-explorer.oecd.org/vis?tenant=archive&df=DisseminateArchiveDMZ&df=DF_FAMILY&df=OECD&dq=..FAM14%2BFAM13%2BFAM15A%2BFAM15B%2BFAM10C%2BFAM10B%2BFAM10A%2BFAM9C%2BFAM9A%2BFAM9B%2BFAM7%2BFAM17%2BFAM8C%2BFAM8B%2BFAM11D%2BFAM11C%2BFAM11B%2BFAM11A%2BFAM8A%2BFAM5C%2BFAM5B%2BFAM5A%2BFAM4B%2BFAM12A%2BFAM12B%2BFAM4A%2BFAM3&pd=1960%2C2022&to[TIME_PERIOD]=false&vw=tb
+ + url_download: |-
+ + https://sdmx.oecd.org/archive/rest/data/OECD,DF_FAMILY,/..FAM14+FAM13+FAM15A+FAM15B+FAM10C+FAM10B+FAM10A+FAM9C+FAM9A+FAM9B+FAM7+FAM17+FAM8C+FAM8B+FAM11D+FAM11C+FAM11B+FAM11A+FAM8A+FAM5C+FAM5B+FAM5A+FAM4B+FAM12A+FAM12B+FAM4A+FAM3?startPeriod=1960&endPeriod=2022&dimensionAtObservation=AllDimensions&format=csvfilewithlabels
+ + date_accessed: '2024-12-30'
+ + date_published: '2024-03-27'
+ + license:
+ + name: OECD Terms of Conditions
+ + url: https://www.oecd.org/en/about/terms-conditions.html
+ + unit: per 1,000 people
+ + display:
+ + numDecimalPlaces: 1
+ + presentation:
+ + topic_tags:
+ + - Marriages & Divorces
+ + New values: 66 / 2691 (2.45%)
country year divorce_rate
United States 1919 <NA>
United States 1920 <NA>
United States 1938 <NA>
United States 1949 <NA>
United States 1957 <NA>
~ Changed values: 2056 / 2691 (76.40%)
country year divorce_rate - divorce_rate +
Austria 1994 NaN 2.1
Canada 2007 NaN 2.2
Denmark 2019 NaN 1.8
Estonia 1969 NaN 3.3
Greece 2017 NaN 1.8
~ Column employment_rates__pct__for_all_mothers__15_64_year_olds__with_at_least_one_child_under_15 (new data)
+ + New values: 66 / 2691 (2.45%)
country year employment_rates__pct__for_all_mothers__15_64_year_olds__with_at_least_one_child_under_15
United States 1919 <NA>
United States 1920 <NA>
United States 1938 <NA>
United States 1949 <NA>
United States 1957 <NA>
~ Column employment_rates__pct__for_partnered_mothers__15_64_year_olds__with_at_least_one_child_under_15 (new data)
+ + New values: 66 / 2691 (2.45%)
country year employment_rates__pct__for_partnered_mothers__15_64_year_olds__with_at_least_one_child_under_15
United States 1919 <NA>
United States 1920 <NA>
United States 1938 <NA>
United States 1949 <NA>
United States 1957 <NA>
~ Column employment_rates__pct__for_sole_parent_mothers__15_64_year_olds__with_at_least_one_child_under_15 (new data)
+ + New values: 66 / 2691 (2.45%)
country year employment_rates__pct__for_sole_parent_mothers__15_64_year_olds__with_at_least_one_child_under_15
United States 1919 <NA>
United States 1920 <NA>
United States 1938 <NA>
United States 1949 <NA>
United States 1957 <NA>
~ Column length_of_paid_maternity__parental_and_home_care_leave_available_to_mothers_in_weeks (new data)
+ + New values: 66 / 2691 (2.45%)
country year length_of_paid_maternity__parental_and_home_care_leave_available_to_mothers_in_weeks
United States 1919 <NA>
United States 1920 <NA>
United States 1938 <NA>
United States 1949 <NA>
United States 1957 <NA>
~ Column length_of_paid_paternity_and_parental_leave_reserved_for_fathers_in_weeks (new data)
+ + New values: 66 / 2691 (2.45%)
country year length_of_paid_paternity_and_parental_leave_reserved_for_fathers_in_weeks
United States 1919 <NA>
United States 1920 <NA>
United States 1938 <NA>
United States 1949 <NA>
United States 1957 <NA>
~ Column marriage_rate (changed metadata, new data, changed data)
- - {}
+ + title: Crude marriage rate (marriages per 1,000 people)
+ + description_short: Number of marriages during a given year per 1,000 people.
+ + description_from_producer: The crude marriage rate is defined as the number of marriages during a given year per 1,000 people.
+ + origins:
+ + - producer: Centers for Disease Control and Prevention
+ + title: Marriage Rates in the United States
+ + description: |-
+ + Marriage license data is collected locally and reported to NVSS via the Vital Statistics Cooperative Program. Coverage varies by year and state: Alaska and Hawaii were included from 1959 and 1960, respectively, while California, Louisiana, and Georgia had exclusions in specific years. Population counts for non-reporting states are excluded from rate calculations for those years. Reports and data are available on the CDC and NCHS websites.
+ + citation_full: |-
+ + Curtin, S., & Sutton, P. D. (2020). Marriage rates in the United States, 1900–2018. Centers for Disease Control and Prevention.
+ + attribution_short: CDC
+ + url_main: https://www.cdc.gov/nchs/data/hestat/marriage_rate_2018/marriage_rate_2018.pdf
+ + url_download: https://www.cdc.gov/nchs/data/hestat/marriage_rate_2018/marriage_rate_2018.pdf
+ + date_accessed: '2025-01-22'
+ + date_published: '2020'
+ + license:
+ + name: Public domain
+ + url: https://stacks.cdc.gov/Content%20and%20Copyright
+ + - producer: OECD
+ + title: OECD Family Dabatabse
+ + description: |-
+ + The OECD Family Database provides cross-national indicators on family outcomes and family policies across the OECD countries, its enhanced engagement partners and EU member states. It includes 70 indicators under four main dimensions: (i) structure of families, (ii) labour market position of families, (iii) public policies for families and children and (iv) child outcomes.
+ + citation_full: OECD (2024). OECD Family Database.
+ + url_main: |-
+ + https://data-explorer.oecd.org/vis?tenant=archive&df=DisseminateArchiveDMZ&df=DF_FAMILY&df=OECD&dq=..FAM14%2BFAM13%2BFAM15A%2BFAM15B%2BFAM10C%2BFAM10B%2BFAM10A%2BFAM9C%2BFAM9A%2BFAM9B%2BFAM7%2BFAM17%2BFAM8C%2BFAM8B%2BFAM11D%2BFAM11C%2BFAM11B%2BFAM11A%2BFAM8A%2BFAM5C%2BFAM5B%2BFAM5A%2BFAM4B%2BFAM12A%2BFAM12B%2BFAM4A%2BFAM3&pd=1960%2C2022&to[TIME_PERIOD]=false&vw=tb
+ + url_download: |-
+ + https://sdmx.oecd.org/archive/rest/data/OECD,DF_FAMILY,/..FAM14+FAM13+FAM15A+FAM15B+FAM10C+FAM10B+FAM10A+FAM9C+FAM9A+FAM9B+FAM7+FAM17+FAM8C+FAM8B+FAM11D+FAM11C+FAM11B+FAM11A+FAM8A+FAM5C+FAM5B+FAM5A+FAM4B+FAM12A+FAM12B+FAM4A+FAM3?startPeriod=1960&endPeriod=2022&dimensionAtObservation=AllDimensions&format=csvfilewithlabels
+ + date_accessed: '2024-12-30'
+ + date_published: '2024-03-27'
+ + license:
+ + name: OECD Terms of Conditions
+ + url: https://www.oecd.org/en/about/terms-conditions.html
+ + - producer: US Census Bureau
+ + title: Vital Statistics, Health, and Nutrition Series
+ + description: |-
+ + Vital statistics in the United States, including births, deaths, marriages, and divorces, are compiled nationally by the National Office of Vital Statistics, with data sourced from state and city registration officials.
+ + title_snapshot: Historical data on marriages and divorces in the US (1886 - 1945)
+ + description_snapshot: |-
+ + Marriage and divorce statistics in the United States, compiled primarily by the National Office of Vital Statistics, have been documented in various reports spanning from 1867 to 1946, including earlier analyses by the Bureau of the Census and academic studies.
+ + citation_full: |-
+ + National Office of Vital Statistics, "Marriage and Divorce Statistics: United States, 1946," Vital Statistics-Special. Reports, vol. 27, No. 10.
+ + url_main: https://www.census.gov/library/publications/1949/compendia/hist_stats_1789-1945.html
+ + url_download: https://www2.census.gov/library/publications/1949/compendia/hist_stats_1789-1945/hist_stats_1789-1945-chC.pdf
+ + date_accessed: '2025-01-22'
+ + date_published: '1949'
+ + license:
+ + name: Open Government at the Census Bureau
+ + url: https://www.census.gov/about/policies/open-gov.html
+ + unit: per 1,000 people
+ + display:
+ + numDecimalPlaces: 1
+ + presentation:
+ + topic_tags:
+ + - Marriages & Divorces
+ + description_processing: |-
+ + Marriage rates in the United States between 1886 and 1945 are sourced from the US Census, for years 1945 to 1990 they are sourced from the CDC. Recent data comes from OECD.
+ + New values: 66 / 2691 (2.45%)
country year marriage_rate
United States 1919 11.0
United States 1920 12.0
United States 1938 10.3
United States 1949 10.6
United States 1957 8.9
~ Changed values: 2361 / 2691 (87.74%)
country year marriage_rate - marriage_rate +
Lithuania 2010 NaN 6.0
Norway 1986 NaN 4.9
Portugal 1970 NaN 9.4
South Korea 1973 NaN 7.6
South Korea 1995 NaN 8.7
~ Column proportion__pct__of_children__aged_0_14__that_live_in_households_where_all_adults_are_in_employment__working (new data)
+ + New values: 66 / 2691 (2.45%)
country year proportion__pct__of_children__aged_0_14__that_live_in_households_where_all_adults_are_in_employment__working
United States 1919 <NA>
United States 1920 <NA>
United States 1938 <NA>
United States 1949 <NA>
United States 1957 <NA>
~ Column proportion__pct__of_children__aged_0_17__living_in_other_types_of_household (new data)
+ + New values: 66 / 2691 (2.45%)
country year proportion__pct__of_children__aged_0_17__living_in_other_types_of_household
United States 1919 <NA>
United States 1920 <NA>
United States 1938 <NA>
United States 1949 <NA>
United States 1957 <NA>
~ Column proportion__pct__of_children__aged_0_17__living_with_a_single_parent (new data)
+ + New values: 66 / 2691 (2.45%)
country year proportion__pct__of_children__aged_0_17__living_with_a_single_parent
United States 1919 <NA>
United States 1920 <NA>
United States 1938 <NA>
United States 1949 <NA>
United States 1957 <NA>
~ Column proportion__pct__of_children__aged_0_17__living_with_two_parents (new data)
+ + New values: 66 / 2691 (2.45%)
country year proportion__pct__of_children__aged_0_17__living_with_two_parents
United States 1919 <NA>
United States 1920 <NA>
United States 1938 <NA>
United States 1949 <NA>
United States 1957 <NA>
~ Column proportion__pct__of_children_aged_0_2_enrolled_in_formal_childcare_and_pre_school (new data)
+ + New values: 66 / 2691 (2.45%)
country year proportion__pct__of_children_aged_0_2_enrolled_in_formal_childcare_and_pre_school
United States 1919 <NA>
United States 1920 <NA>
United States 1938 <NA>
United States 1949 <NA>
United States 1957 <NA>
~ Column public_social_expenditure_on_cash_benefits_for_families_as_a_pct_of_gdp (new data)
+ + New values: 66 / 2691 (2.45%)
country year public_social_expenditure_on_cash_benefits_for_families_as_a_pct_of_gdp
United States 1919 <NA>
United States 1920 <NA>
United States 1938 <NA>
United States 1949 <NA>
United States 1957 <NA>
~ Column public_social_expenditure_on_services_and_in_kind_benefits_for_families_as_a_pct_of_gdp (new data)
+ + New values: 66 / 2691 (2.45%)
country year public_social_expenditure_on_services_and_in_kind_benefits_for_families_as_a_pct_of_gdp
United States 1919 <NA>
United States 1920 <NA>
United States 1938 <NA>
United States 1949 <NA>
United States 1957 <NA>
~ Column public_social_expenditure_on_tax_breaks_for_families_as_a_pct_of_gdp (new data)
+ + New values: 66 / 2691 (2.45%)
country year public_social_expenditure_on_tax_breaks_for_families_as_a_pct_of_gdp
United States 1919 <NA>
United States 1920 <NA>
United States 1938 <NA>
United States 1949 <NA>
United States 1957 <NA>
~ Column share_of_births_outside_of_marriage__pct_of_all_births (new data)
+ + New values: 66 / 2691 (2.45%)
country year share_of_births_outside_of_marriage__pct_of_all_births
United States 1919 <NA>
United States 1920 <NA>
United States 1938 <NA>
United States 1949 <NA>
United States 1957 <NA>
~ Column total_public_social_expenditure_on_families_as_a_pct_of_gdp (new data)
+ + New values: 66 / 2691 (2.45%)
country year total_public_social_expenditure_on_families_as_a_pct_of_gdp
United States 1919 <NA>
United States 1920 <NA>
United States 1938 <NA>
United States 1949 <NA>
United States 1957 <NA>
Legend: +New ~Modified -Removed =Identical Details
Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippetAutomatically updated datasets matching weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk are not included Edited: 2025-02-04 15:34:41 UTC |
|
❌ Merge Schedule |
github-actions
bot
added
the
merge-schedule-failed
antea04
pushed a commit
that referenced
this pull request
Feb 5, 2025
* 🔨 archive and clean datasets * add technology dag * archive metaculus * archive datasets
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
/schedule