Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🎉 Admin for related charts #3833

Draft
wants to merge 7 commits into
base: master
Choose a base branch
from
Draft

🎉 Admin for related charts #3833

wants to merge 7 commits into from

Conversation

Marigold
Copy link
Collaborator

@Marigold Marigold commented Jan 13, 2025

Progress (2025-01-17)

  • Enabled user reviews and added a table at the top to display recommendations from various systems.
  • Added a related_charts table to MySQL for storing reviews and related charts to be used later during baking.
  • Incorporated co-views into scoring and introduced them as a separate recommendation system.

Co-views

Co-views turned out to be much better than expected. I reviewed various charts, and the top 5 charts with the most co-views were almost always strong recommendations. This raises the question of whether we should address all issues in the project (such as agreement reviews and performance evaluations) or whether a simpler solution based on co-views might suffice. I believe it could, with a few minor modifications.

Some additional observations:

  • Surprisingly, we often have sufficient data, even for charts with low traffic.
  • Ranking based on co-views naturally favors pages with high pageviews, but the balance is reasonable. High-pageview charts don’t dominate the top 5, and the results are usually well-distributed.
  • For charts with the highest pageviews, co-views tend to recommend other high-pageview charts, which might not always be relevant. For example, Life Expectancy recommends charts about GDP. Is this behavior desirable? It could be, as users visiting such charts might not have specific goals, and recommending other high-viewed charts might make sense. If this behavior is undesirable, we could penalize highly viewed charts (that's possible from Advanced options).
    • There are various ways how to "penalize" charts we don't want to show. First, we should decide whether we prefer showing highly viewed charts or charts with fewer views, but more relevant to the chart. In any way, this would still be a simple formula with just pageviews and coviews.
  • Co-views in production might be self-reinforcing. Is this beneficial or problematic? We should analyze how many co-views result from clicks on related charts versus natural browsing and consider excluding the former if necessary.

Problematic Charts

@owidbot
Copy link
Contributor

owidbot commented Jan 13, 2025

Quick links (staging server):

Site Dev Site Preview Admin Wizard Docs

Login: ssh owid@staging-site-similar-charts-admin

chart-diff: ✅ No charts for review.
data-diff: ❌ Found differences
= Dataset garden/bgs/2024-07-09/world_mineral_statistics
  = Table world_mineral_statistics
    ~ Dim country
+       + New values: 1123 / 91105 (1.23%)
           year commodity sub_commodity    country
           1979  Chromium          Mine       Iran
           1979  Chromium          Mine Madagascar
           2015  Chromium          Mine     Turkey
           1979  Chromium          Mine      World
           2003  Chromium          Mine      World
-       - Removed values: 1123 / 91105 (1.23%)
           year commodity      sub_commodity    country
           1979  Chromium Mine, gross weight       Iran
           1979  Chromium Mine, gross weight Madagascar
           2015  Chromium Mine, gross weight     Turkey
           1979  Chromium Mine, gross weight      World
           2003  Chromium Mine, gross weight      World
    ~ Dim year
+       + New values: 1123 / 91105 (1.23%)
             country commodity sub_commodity  year
                Iran  Chromium          Mine  1979
          Madagascar  Chromium          Mine  1979
              Turkey  Chromium          Mine  2015
               World  Chromium          Mine  1979
               World  Chromium          Mine  2003
-       - Removed values: 1123 / 91105 (1.23%)
             country commodity      sub_commodity  year
                Iran  Chromium Mine, gross weight  1979
          Madagascar  Chromium Mine, gross weight  1979
              Turkey  Chromium Mine, gross weight  2015
               World  Chromium Mine, gross weight  1979
               World  Chromium Mine, gross weight  2003
    ~ Dim commodity
+       + New values: 1123 / 91105 (1.23%)
             country  year sub_commodity commodity
                Iran  1979          Mine  Chromium
          Madagascar  1979          Mine  Chromium
              Turkey  2015          Mine  Chromium
               World  1979          Mine  Chromium
               World  2003          Mine  Chromium
-       - Removed values: 1123 / 91105 (1.23%)
             country  year      sub_commodity commodity
                Iran  1979 Mine, gross weight  Chromium
          Madagascar  1979 Mine, gross weight  Chromium
              Turkey  2015 Mine, gross weight  Chromium
               World  1979 Mine, gross weight  Chromium
               World  2003 Mine, gross weight  Chromium
    ~ Dim sub_commodity
+       + New values: 1123 / 91105 (1.23%)
             country  year commodity sub_commodity
                Iran  1979  Chromium          Mine
          Madagascar  1979  Chromium          Mine
              Turkey  2015  Chromium          Mine
               World  1979  Chromium          Mine
               World  2003  Chromium          Mine
-       - Removed values: 1123 / 91105 (1.23%)
             country  year commodity      sub_commodity
                Iran  1979  Chromium Mine, gross weight
          Madagascar  1979  Chromium Mine, gross weight
              Turkey  2015  Chromium Mine, gross weight
               World  1979  Chromium Mine, gross weight
               World  2003  Chromium Mine, gross weight
    ~ Column notes_production (new data, changed data)
+       + New values: 1123 / 91105 (1.23%)
             country  year commodity sub_commodity                                                                                                                                                                                                                                                                                                                                                                                                                                             notes_production
                Iran  1979  Chromium          Mine                                                                                                                                                                                                      ['Estimate.', 'In addition to the countries listed, Bulgaria, Democratic P.R. of Korea and Thailand are believed to produce chromite (1992 Onwards).', 'In addition to the countries listed, Bulgaria is believed to produce chromite (2000 Onwards).']
          Madagascar  1979  Chromium          Mine                                                                                                                                                                                                  ['Concentrates.', 'In addition to the countries listed, Bulgaria, Democratic P.R. of Korea and Thailand are believed to produce chromite (1992 Onwards).', 'In addition to the countries listed, Bulgaria is believed to produce chromite (2000 Onwards).']
              Turkey  2015  Chromium          Mine                                                                                                                                                                                                                   ['In addition to the countries listed, Bulgaria, Democratic P.R. of Korea and Thailand are believed to produce chromite (1992 Onwards).', 'In addition to the countries listed, Bulgaria is believed to produce chromite (2000 Onwards).']
               World  1979  Chromium          Mine                                                                                        ['Concentrates.', 'In 1980 Rhodesia was renamed Zimbabwe.', 'Estimate.', 'Including beneficiated and direct shipping ore.', 'In addition to the countries listed, Bulgaria, Democratic P.R. of Korea and Thailand are believed to produce chromite (1992 Onwards).', 'In addition to the countries listed, Bulgaria is believed to produce chromite (2000 Onwards).']
               World  2003  Chromium          Mine ['Years ended 31 March following that stated.', 'Including foundry sand and/or lumpy ore.', 'Years ended 20 March following that stated.', 'Estimate.', 'Years ended 30 June of that stated.', 'Break in series.', 'In addition to the countries listed, Bulgaria, Democratic P.R. of Korea and Thailand are believed to produce chromite (1992 Onwards).', 'In addition to the countries listed, Bulgaria is believed to produce chromite (2000 Onwards).']
-       - Removed values: 1123 / 91105 (1.23%)
             country  year commodity      sub_commodity                                                                                                                                                                                                                                                                                                                                                                                                                                             notes_production
                Iran  1979  Chromium Mine, gross weight                                                                                                                                                                                                      ['Estimate.', 'In addition to the countries listed, Bulgaria, Democratic P.R. of Korea and Thailand are believed to produce chromite (1992 Onwards).', 'In addition to the countries listed, Bulgaria is believed to produce chromite (2000 Onwards).']
          Madagascar  1979  Chromium Mine, gross weight                                                                                                                                                                                                  ['Concentrates.', 'In addition to the countries listed, Bulgaria, Democratic P.R. of Korea and Thailand are believed to produce chromite (1992 Onwards).', 'In addition to the countries listed, Bulgaria is believed to produce chromite (2000 Onwards).']
              Turkey  2015  Chromium Mine, gross weight                                                                                                                                                                                                                   ['In addition to the countries listed, Bulgaria, Democratic P.R. of Korea and Thailand are believed to produce chromite (1992 Onwards).', 'In addition to the countries listed, Bulgaria is believed to produce chromite (2000 Onwards).']
               World  1979  Chromium Mine, gross weight                                                                                        ['Concentrates.', 'In 1980 Rhodesia was renamed Zimbabwe.', 'Estimate.', 'Including beneficiated and direct shipping ore.', 'In addition to the countries listed, Bulgaria, Democratic P.R. of Korea and Thailand are believed to produce chromite (1992 Onwards).', 'In addition to the countries listed, Bulgaria is believed to produce chromite (2000 Onwards).']
               World  2003  Chromium Mine, gross weight ['Years ended 31 March following that stated.', 'Including foundry sand and/or lumpy ore.', 'Years ended 20 March following that stated.', 'Estimate.', 'Years ended 30 June of that stated.', 'Break in series.', 'In addition to the countries listed, Bulgaria, Democratic P.R. of Korea and Thailand are believed to produce chromite (1992 Onwards).', 'In addition to the countries listed, Bulgaria is believed to produce chromite (2000 Onwards).']
    ~ Column production (new data, changed data)
+       + New values: 1123 / 91105 (1.23%)
             country  year commodity sub_commodity  production
                Iran  1979  Chromium          Mine    136000.0
          Madagascar  1979  Chromium          Mine    128347.0
              Turkey  2015  Chromium          Mine   2515188.0
               World  1979  Chromium          Mine   9212998.0
               World  2003  Chromium          Mine  16037569.0
-       - Removed values: 1123 / 91105 (1.23%)
             country  year commodity      sub_commodity  production
                Iran  1979  Chromium Mine, gross weight    136000.0
          Madagascar  1979  Chromium Mine, gross weight    128347.0
              Turkey  2015  Chromium Mine, gross weight   2515188.0
               World  1979  Chromium Mine, gross weight   9212998.0
               World  2003  Chromium Mine, gross weight  16037569.0
    ~ Column unit (new data, changed data)
+       + New values: 1123 / 91105 (1.23%)
             country  year commodity sub_commodity   unit
                Iran  1979  Chromium          Mine tonnes
          Madagascar  1979  Chromium          Mine tonnes
              Turkey  2015  Chromium          Mine tonnes
               World  1979  Chromium          Mine tonnes
               World  2003  Chromium          Mine tonnes
-       - Removed values: 1123 / 91105 (1.23%)
             country  year commodity      sub_commodity   unit
                Iran  1979  Chromium Mine, gross weight tonnes
          Madagascar  1979  Chromium Mine, gross weight tonnes
              Turkey  2015  Chromium Mine, gross weight tonnes
               World  1979  Chromium Mine, gross weight tonnes
               World  2003  Chromium Mine, gross weight tonnes
  = Table world_mineral_statistics_flat
-   - Column production_chromium_mine__gross_weight_tonnes
+   + Column production_chromium_mine_tonnes
= Dataset garden/minerals/2024-07-15/minerals
  = Table minerals
-   - Column production_chromium_mine__gross_weight_tonnes
    ~ Column production_chromium_mine_tonnes (changed metadata, changed data)
-       -   Notes found in original USGS historical data:
        ?                               -----------
+       +   Notes found in original USGS data:
-       -   - Note on global production: World production is an estimate of world chromite ore mine production measured in contained chromium. World production reported in gross weight was converted to contained chromium by assuming that its chromic oxide content was the same as that of chromite ore imported into the United States. Before content of chromite ore was reported, a time-averaged value was used.
+       +   - Production in 2020, thousand metric tons, gross weight, of marketable chromite ore.
+       +   - Units are thousand metric tons, gross weight, of marketable chromite ore.
+       +   - Production in 2021, thousand metric tons, gross weight, of marketable chromite ore.
+       +   - Production in 2022, thousand metric tons, gross weight, of marketable chromite ore.
+       + 
+       +   Notes found in original BGS data:
+       +   - In addition to the countries listed, Bulgaria, Democratic P.R. of Korea and Thailand are believed to produce chromite (1992 Onwards).
+       +   - In addition to the countries listed, Bulgaria is believed to produce chromite (2000 Onwards).
+       +   - Estimate.
+       +   - Break in series.
+       +   - Concentrates.
+       +   - Including beneficiated and direct shipping ore.
+       +   - Including foundry sand and/or lumpy ore.
+       +   - Years ended 31 March following that stated.
+       +   - Years ended 20 March following that stated.
+       +   - Exports.
+       +   - Years ended 30 June of that stated.
+       +   - In 1980 Rhodesia was renamed Zimbabwe.
-       -     title: Historical Statistics for Mineral and Material Commodities
+       +     title: Mineral Commodity Summaries
+       +     description: This dataset contains world production statistics for over 88 nonfuel mineral commodities.
+       +     title_snapshot: Mineral Commodity Summaries 2024
+       +     citation_full: |-
+       +       National Minerals Information Center, 2024, U.S. Geological Survey Mineral Commodity Summaries 2024 Data Release (ver. 2.0, March 2024): U.S. Geological Survey data release, https://doi.org/10.5066/P144BA54.
+       +     attribution: USGS - Mineral Commodity Summaries (2024)
+       +     attribution_short: USGS
+       +     url_main: https://doi.org/10.5066/P144BA54
+       +     url_download: |-
+       +       https://www.sciencebase.gov/catalog/file/get/65a6e45fd34e5af967a46749?f=__disk__9c%2F08%2Fa8%2F9c08a8bb0d04a87840f4f7f4ba489adf0d277f32
+       +     date_accessed: '2024-07-17'
+       +     date_published: '2024-01-30'
+       +     license:
+       +       name: CC BY 4.0
+       +       url: https://www.usgs.gov/faqs/what-usgs-products-are-already-publicly-available
+       +   - producer: British Geological Survey
+       +     title: World Mineral Statistics
-       -       Information on mineral commodities, including production and unit value (the real and nominal price in U.S. dollars of a metric ton of apparent consumption). For many of the commodities, data are reported as far back as 1900.
-       -       The data was compiled primarily from publications of the United States Geological Survey (USGS) and the U.S. Bureau of Mines (USBM). The principal references are the annual Minerals Yearbook (MYB) publication and its predecessor, Mineral Resources of the United States (MR). Other USGS and USBM publications used as references included: Statistical Compendium (SC), Metal Prices in the United States Through 1991 (MP91), Metal Prices in the United States Through 1998 (MP98), Metal Prices in the United States Through 2010, MCS and its predecessor Commodity Data Summaries (CDS), Minerals Facts and Problems (MFP), and various USBM Information Circulars. In some cases, USGS mineral commodity specialists added previously unpublished or recently revised data to the historical statistics series.
+       +       The World Mineral Statistics dataset is a compilation of production and trade statistics on a wide range of mineral commodities since 1913.
+       +       However, data prior to 1960 is only available a scanned PDF books, whose content, currently, cannot successfully be extracted programmatically.
+       +     title_snapshot: World Mineral Statistics - 1970 onwards
+       +     description_snapshot: |-
+       +       This is a compilation of all the data that is accessible via the BGS web interface, containing imports, exports and production of minerals by country from 1970 onwards.
-       -       Kelly, T.D., and Matos, G.R., comps., 2014, Historical statistics for mineral and material commodities in the United States (2016 version): U.S. Geological Survey Data Series 140.
-       -     attribution: USGS - Historical Statistics for Mineral and Material Commodities (2023)
+       +       World Mineral Statistics, contributed by permission of the British Geological Survey (BGS). The copyright of all materials derived from the BGS's work is vested in the Natural Environment Research Council (NERC) and/or the authority that commissioned the work.
+       +     attribution: BGS - World Mineral Statistics (2023)
-       -     attribution_short: USGS
        ?                        ^^
+       +     attribution_short: BGS
        ?                        ^
-       -     url_main: https://www.usgs.gov/centers/national-minerals-information-center/historical-statistics-mineral-and-material-commodities
+       +     url_main: https://www.bgs.ac.uk/mineralsuk/statistics/world-mineral-statistics/
-       -     date_accessed: '2024-07-15'
        ?                             ^^
+       +     date_accessed: '2024-07-09'
        ?                             ^^
-       -     date_published: '2023'
+       +     date_published: '2023-01-01'
        ?                          ++++++
-       -       name: Public domain
-       -       url: https://www.usgs.gov/centers/national-minerals-information-center/historical-statistics-mineral-and-material-commodities
+       +       name: © Natural Environment Research Council (NERC) and/or the authority that commissioned the work
+       +       url: https://www.bgs.ac.uk/mineralsuk/statistics/world-mineral-statistics/
-       -     note: Values are reported as tonnes of contained chromium.
+       +     note: |-
+       +       Values are reported in tonnes of gross weight of marketable chromite ore. The sum of all countries may exceed World data on certain years (by up to 10%), due to discrepancies between data sources.

        ~ Changed values: 1196 / 8380 (14.27%)
           country  year  production_chromium_mine_tonnes -  production_chromium_mine_tonnes +
            Greece  1991                               <NA>                              20108
              Oman  2021                               <NA>                             488900
              Oman  2022                               <NA>                             412000
          Pakistan  2004                               <NA>                              29230
             World  1981                            2550000                               <NA>
-   - Column share_of_global_production_chromium_mine__gross_weight_tonnes
    ~ Column share_of_global_production_chromium_mine_tonnes (changed metadata, changed data)
-       -   Notes found in original USGS historical data:
        ?                               -----------
+       +   Notes found in original USGS data:
-       -   - Note on global production: World production is an estimate of world chromite ore mine production measured in contained chromium. World production reported in gross weight was converted to contained chromium by assuming that its chromic oxide content was the same as that of chromite ore imported into the United States. Before content of chromite ore was reported, a time-averaged value was used.
+       +   - Production in 2020, thousand metric tons, gross weight, of marketable chromite ore.
+       +   - Units are thousand metric tons, gross weight, of marketable chromite ore.
+       +   - Production in 2021, thousand metric tons, gross weight, of marketable chromite ore.
+       +   - Production in 2022, thousand metric tons, gross weight, of marketable chromite ore.
+       + 
+       +   Notes found in original BGS data:
+       +   - In addition to the countries listed, Bulgaria, Democratic P.R. of Korea and Thailand are believed to produce chromite (1992 Onwards).
+       +   - In addition to the countries listed, Bulgaria is believed to produce chromite (2000 Onwards).
+       +   - Estimate.
+       +   - Break in series.
+       +   - Concentrates.
+       +   - Including beneficiated and direct shipping ore.
+       +   - Including foundry sand and/or lumpy ore.
+       +   - Years ended 31 March following that stated.
+       +   - Years ended 20 March following that stated.
+       +   - Exports.
+       +   - Years ended 30 June of that stated.
+       +   - In 1980 Rhodesia was renamed Zimbabwe.
-       -     title: Historical Statistics for Mineral and Material Commodities
+       +     title: Mineral Commodity Summaries
+       +     description: This dataset contains world production statistics for over 88 nonfuel mineral commodities.
+       +     title_snapshot: Mineral Commodity Summaries 2024
+       +     citation_full: |-
+       +       National Minerals Information Center, 2024, U.S. Geological Survey Mineral Commodity Summaries 2024 Data Release (ver. 2.0, March 2024): U.S. Geological Survey data release, https://doi.org/10.5066/P144BA54.
+       +     attribution: USGS - Mineral Commodity Summaries (2024)
+       +     attribution_short: USGS
+       +     url_main: https://doi.org/10.5066/P144BA54
+       +     url_download: |-
+       +       https://www.sciencebase.gov/catalog/file/get/65a6e45fd34e5af967a46749?f=__disk__9c%2F08%2Fa8%2F9c08a8bb0d04a87840f4f7f4ba489adf0d277f32
+       +     date_accessed: '2024-07-17'
+       +     date_published: '2024-01-30'
+       +     license:
+       +       name: CC BY 4.0
+       +       url: https://www.usgs.gov/faqs/what-usgs-products-are-already-publicly-available
+       +   - producer: British Geological Survey
+       +     title: World Mineral Statistics
-       -       Information on mineral commodities, including production and unit value (the real and nominal price in U.S. dollars of a metric ton of apparent consumption). For many of the commodities, data are reported as far back as 1900.
-       -       The data was compiled primarily from publications of the United States Geological Survey (USGS) and the U.S. Bureau of Mines (USBM). The principal references are the annual Minerals Yearbook (MYB) publication and its predecessor, Mineral Resources of the United States (MR). Other USGS and USBM publications used as references included: Statistical Compendium (SC), Metal Prices in the United States Through 1991 (MP91), Metal Prices in the United States Through 1998 (MP98), Metal Prices in the United States Through 2010, MCS and its predecessor Commodity Data Summaries (CDS), Minerals Facts and Problems (MFP), and various USBM Information Circulars. In some cases, USGS mineral commodity specialists added previously unpublished or recently revised data to the historical statistics series.
+       +       The World Mineral Statistics dataset is a compilation of production and trade statistics on a wide range of mineral commodities since 1913.
+       +       However, data prior to 1960 is only available a scanned PDF books, whose content, currently, cannot successfully be extracted programmatically.
+       +     title_snapshot: World Mineral Statistics - 1970 onwards
+       +     description_snapshot: |-
+       +       This is a compilation of all the data that is accessible via the BGS web interface, containing imports, exports and production of minerals by country from 1970 onwards.
-       -       Kelly, T.D., and Matos, G.R., comps., 2014, Historical statistics for mineral and material commodities in the United States (2016 version): U.S. Geological Survey Data Series 140.
-       -     attribution: USGS - Historical Statistics for Mineral and Material Commodities (2023)
+       +       World Mineral Statistics, contributed by permission of the British Geological Survey (BGS). The copyright of all materials derived from the BGS's work is vested in the Natural Environment Research Council (NERC) and/or the authority that commissioned the work.
+       +     attribution: BGS - World Mineral Statistics (2023)
-       -     attribution_short: USGS
        ?                        ^^
+       +     attribution_short: BGS
        ?                        ^
-       -     url_main: https://www.usgs.gov/centers/national-minerals-information-center/historical-statistics-mineral-and-material-commodities
+       +     url_main: https://www.bgs.ac.uk/mineralsuk/statistics/world-mineral-statistics/
-       -     date_accessed: '2024-07-15'
        ?                             ^^
+       +     date_accessed: '2024-07-09'
        ?                             ^^
-       -     date_published: '2023'
+       +     date_published: '2023-01-01'
        ?                          ++++++
-       -       name: Public domain
-       -       url: https://www.usgs.gov/centers/national-minerals-information-center/historical-statistics-mineral-and-material-commodities
+       +       name: © Natural Environment Research Council (NERC) and/or the authority that commissioned the work
+       +       url: https://www.bgs.ac.uk/mineralsuk/statistics/world-mineral-statistics/
-       -     note: Values are reported as tonnes of contained chromium.
+       +     note: Values are reported in tonnes of gross weight of marketable chromite ore.

        ~ Changed values: 187 / 8380 (2.23%)
          country  year  share_of_global_production_chromium_mine_tonnes -  share_of_global_production_chromium_mine_tonnes +
           Russia  2020                                               <NA>                                           1.862162
            World  1900                                                100                                               <NA>
            World  1944                                                100                                               <NA>
            World  1959                                                100                                               <NA>
            World  1996                                                100                                               <NA>
-   - Column unit_value_chromium_mine_constant_1998_usd_per_tonne
= Dataset garden/usgs/2024-07-15/historical_statistics_for_mineral_and_material_commodities
  = Table historical_statistics_for_mineral_and_material_commodities_flat
-   - Column production_chromium_mine_tonnes
-   - Column unit_value_chromium_mine_constant_1998_usd_per_tonne
  = Table historical_unit_value
    ~ Dim country
-       - Removed values: 123 / 7065 (1.74%)
           year commodity sub_commodity                        unit country
           1908  Chromium          Mine constant 1998 US$ per tonne   World
           1910  Chromium          Mine constant 1998 US$ per tonne   World
           1971  Chromium          Mine constant 1998 US$ per tonne   World
           1985  Chromium          Mine constant 1998 US$ per tonne   World
           1998  Chromium          Mine constant 1998 US$ per tonne   World
    ~ Dim year
-       - Removed values: 123 / 7065 (1.74%)
          country commodity sub_commodity                        unit  year
            World  Chromium          Mine constant 1998 US$ per tonne  1908
            World  Chromium          Mine constant 1998 US$ per tonne  1910
            World  Chromium          Mine constant 1998 US$ per tonne  1971
            World  Chromium          Mine constant 1998 US$ per tonne  1985
            World  Chromium          Mine constant 1998 US$ per tonne  1998
    ~ Dim commodity
-       - Removed values: 123 / 7065 (1.74%)
          country  year sub_commodity                        unit commodity
            World  1908          Mine constant 1998 US$ per tonne  Chromium
            World  1910          Mine constant 1998 US$ per tonne  Chromium
            World  1971          Mine constant 1998 US$ per tonne  Chromium
            World  1985          Mine constant 1998 US$ per tonne  Chromium
            World  1998          Mine constant 1998 US$ per tonne  Chromium
    ~ Dim sub_commodity
-       - Removed values: 123 / 7065 (1.74%)
          country  year commodity                        unit sub_commodity
            World  1908  Chromium constant 1998 US$ per tonne          Mine
            World  1910  Chromium constant 1998 US$ per tonne          Mine
            World  1971  Chromium constant 1998 US$ per tonne          Mine
            World  1985  Chromium constant 1998 US$ per tonne          Mine
            World  1998  Chromium constant 1998 US$ per tonne          Mine
    ~ Dim unit
-       - Removed values: 123 / 7065 (1.74%)
          country  year commodity sub_commodity                        unit
            World  1908  Chromium          Mine constant 1998 US$ per tonne
            World  1910  Chromium          Mine constant 1998 US$ per tonne
            World  1971  Chromium          Mine constant 1998 US$ per tonne
            World  1985  Chromium          Mine constant 1998 US$ per tonne
            World  1998  Chromium          Mine constant 1998 US$ per tonne
    ~ Column notes_unit_value (changed data)
-       - Removed values: 123 / 7065 (1.74%)
          country  year commodity sub_commodity                        unit notes_unit_value
            World  1908  Chromium          Mine constant 1998 US$ per tonne               []
            World  1910  Chromium          Mine constant 1998 US$ per tonne               []
            World  1971  Chromium          Mine constant 1998 US$ per tonne               []
            World  1985  Chromium          Mine constant 1998 US$ per tonne               []
            World  1998  Chromium          Mine constant 1998 US$ per tonne               []
    ~ Column unit_value (changed data)
-       - Removed values: 123 / 7065 (1.74%)
          country  year commodity sub_commodity                        unit  unit_value
            World  1908  Chromium          Mine constant 1998 US$ per tonne       731.0
            World  1910  Chromium          Mine constant 1998 US$ per tonne       608.0
            World  1971  Chromium          Mine constant 1998 US$ per tonne       755.0
            World  1985  Chromium          Mine constant 1998 US$ per tonne      1160.0
            World  1998  Chromium          Mine constant 1998 US$ per tonne       909.0
= Dataset garden/usgs/2024-07-15/mineral_commodity_summaries
  = Table mineral_commodity_summaries
    ~ Dim country
+       + New values: 32 / 3869 (0.83%)
           year commodity sub_commodity      country
           2022  Chromium          Mine      Finland
           2022  Chromium          Mine   Kazakhstan
           2023  Chromium          Mine   Kazakhstan
           2020  Chromium          Mine South Africa
           2022  Chromium          Mine       Turkey
-       - Removed values: 32 / 3869 (0.83%)
           year commodity      sub_commodity      country
           2022  Chromium Mine, gross weight      Finland
           2022  Chromium Mine, gross weight   Kazakhstan
           2023  Chromium Mine, gross weight   Kazakhstan
           2020  Chromium Mine, gross weight South Africa
           2022  Chromium Mine, gross weight       Turkey
    ~ Dim year
+       + New values: 32 / 3869 (0.83%)
               country commodity sub_commodity  year
               Finland  Chromium          Mine  2022
            Kazakhstan  Chromium          Mine  2022
            Kazakhstan  Chromium          Mine  2023
          South Africa  Chromium          Mine  2020
                Turkey  Chromium          Mine  2022
-       - Removed values: 32 / 3869 (0.83%)
               country commodity      sub_commodity  year
               Finland  Chromium Mine, gross weight  2022
            Kazakhstan  Chromium Mine, gross weight  2022
            Kazakhstan  Chromium Mine, gross weight  2023
          South Africa  Chromium Mine, gross weight  2020
                Turkey  Chromium Mine, gross weight  2022
    ~ Dim commodity
+       + New values: 32 / 3869 (0.83%)
               country  year sub_commodity commodity
               Finland  2022          Mine  Chromium
            Kazakhstan  2022          Mine  Chromium
            Kazakhstan  2023          Mine  Chromium
          South Africa  2020          Mine  Chromium
                Turkey  2022          Mine  Chromium
-       - Removed values: 32 / 3869 (0.83%)
               country  year      sub_commodity commodity
               Finland  2022 Mine, gross weight  Chromium
            Kazakhstan  2022 Mine, gross weight  Chromium
            Kazakhstan  2023 Mine, gross weight  Chromium
          South Africa  2020 Mine, gross weight  Chromium
                Turkey  2022 Mine, gross weight  Chromium
    ~ Dim sub_commodity
+       + New values: 32 / 3869 (0.83%)
               country  year commodity sub_commodity
               Finland  2022  Chromium          Mine
            Kazakhstan  2022  Chromium          Mine
            Kazakhstan  2023  Chromium          Mine
          South Africa  2020  Chromium          Mine
                Turkey  2022  Chromium          Mine
-       - Removed values: 32 / 3869 (0.83%)
               country  year commodity      sub_commodity
               Finland  2022  Chromium Mine, gross weight
            Kazakhstan  2022  Chromium Mine, gross weight
            Kazakhstan  2023  Chromium Mine, gross weight
          South Africa  2020  Chromium Mine, gross weight
                Turkey  2022  Chromium Mine, gross weight
    ~ Column notes_production (new data, changed data)
+       + New values: 32 / 3869 (0.83%)
               country  year commodity sub_commodity                                                                                                                                                     notes_production
               Finland  2022  Chromium          Mine ['Units are thousand metric tons, gross weight, of marketable chromite ore.', 'Production in 2022, thousand metric tons, gross weight, of marketable chromite ore.']
            Kazakhstan  2022  Chromium          Mine ['Units are thousand metric tons, gross weight, of marketable chromite ore.', 'Production in 2022, thousand metric tons, gross weight, of marketable chromite ore.']
            Kazakhstan  2023  Chromium          Mine ['Units are thousand metric tons, gross weight, of marketable chromite ore.', 'Production in 2022, thousand metric tons, gross weight, of marketable chromite ore.']
          South Africa  2020  Chromium          Mine                                                                              ['Production in 2020, thousand metric tons, gross weight, of marketable chromite ore.']
                Turkey  2022  Chromium          Mine ['Units are thousand metric tons, gross weight, of marketable chromite ore.', 'Production in 2022, thousand metric tons, gross weight, of marketable chromite ore.']
-       - Removed values: 32 / 3869 (0.83%)
               country  year commodity      sub_commodity                                                                                                                                                     notes_production
               Finland  2022  Chromium Mine, gross weight ['Units are thousand metric tons, gross weight, of marketable chromite ore.', 'Production in 2022, thousand metric tons, gross weight, of marketable chromite ore.']
            Kazakhstan  2022  Chromium Mine, gross weight ['Units are thousand metric tons, gross weight, of marketable chromite ore.', 'Production in 2022, thousand metric tons, gross weight, of marketable chromite ore.']
            Kazakhstan  2023  Chromium Mine, gross weight ['Units are thousand metric tons, gross weight, of marketable chromite ore.', 'Production in 2022, thousand metric tons, gross weight, of marketable chromite ore.']
          South Africa  2020  Chromium Mine, gross weight                                                                              ['Production in 2020, thousand metric tons, gross weight, of marketable chromite ore.']
                Turkey  2022  Chromium Mine, gross weight ['Units are thousand metric tons, gross weight, of marketable chromite ore.', 'Production in 2022, thousand metric tons, gross weight, of marketable chromite ore.']
    ~ Column notes_reserves (new data, changed data)
+       + New values: 32 / 3869 (0.83%)
               country  year commodity sub_commodity                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    notes_reserves
               Finland  2022  Chromium          Mine ['Units are thousand metric tons of shipping-grade chromite ore, which is deposit quantity and grade normalized to 45% Cr2O3, except for the United States, where grade is normalized to 7% Cr2O3 ,and Finland, where grade is normalized to 26% Cr2O3.', 'Units are thousand metric tons of shipping-grade chromite ore, which is deposit quantity and grade normalized to 45% Cr2O3, except for the United States, where grade is normalized to 7% Cr2O3 ,and Finland, where grade is normalized to 26% Cr2O3. That part of the reserve base that could be economically extracted or produced at the time of determination. The term “reserves” need not signify that extraction facilities are in place and operative. Reserves include only recoverable materials; thus, terms such as “extractable reserves” and “recoverable reserves” are redundant and are not a part of this classification system. Additional information is available in Appendix C of the Mineral Commodity Summaries, included in this data release, for resource and reserve definitions and information concerning data sources.']
            Kazakhstan  2022  Chromium          Mine ['Units are thousand metric tons of shipping-grade chromite ore, which is deposit quantity and grade normalized to 45% Cr2O3, except for the United States, where grade is normalized to 7% Cr2O3 ,and Finland, where grade is normalized to 26% Cr2O3.', 'Units are thousand metric tons of shipping-grade chromite ore, which is deposit quantity and grade normalized to 45% Cr2O3, except for the United States, where grade is normalized to 7% Cr2O3 ,and Finland, where grade is normalized to 26% Cr2O3. That part of the reserve base that could be economically extracted or produced at the time of determination. The term “reserves” need not signify that extraction facilities are in place and operative. Reserves include only recoverable materials; thus, terms such as “extractable reserves” and “recoverable reserves” are redundant and are not a part of this classification system. Additional information is available in Appendix C of the Mineral Commodity Summaries, included in this data release, for resource and reserve definitions and information concerning data sources.']
            Kazakhstan  2023  Chromium          Mine ['Units are thousand metric tons of shipping-grade chromite ore, which is deposit quantity and grade normalized to 45% Cr2O3, except for the United States, where grade is normalized to 7% Cr2O3, and Finland, where grade is normalized to 26% Cr2O3.', 'Units are thousand metric tons of shipping-grade chromite ore, which is deposit quantity and grade normalized to 45% Cr2O3, except for the United States, where grade is normalized to 7% Cr2O3 ,and Finland, where grade is normalized to 26% Cr2O3. That part of the reserve base that could be economically extracted or produced at the time of determination. The term “reserves” need not signify that extraction facilities are in place and operative. Reserves include only recoverable materials; thus, terms such as “extractable reserves” and “recoverable reserves” are redundant and are not a part of this classification system. Additional information is available in Appendix C of the Mineral Commodity Summaries, included in this data release, for resource and reserve definitions and information concerning data sources.']
          South Africa  2020  Chromium          Mine                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                []
                Turkey  2022  Chromium          Mine ['Units are thousand metric tons of shipping-grade chromite ore, which is deposit quantity and grade normalized to 45% Cr2O3, except for the United States, where grade is normalized to 7% Cr2O3 ,and Finland, where grade is normalized to 26% Cr2O3.', 'Units are thousand metric tons of shipping-grade chromite ore, which is deposit quantity and grade normalized to 45% Cr2O3, except for the United States, where grade is normalized to 7% Cr2O3 ,and Finland, where grade is normalized to 26% Cr2O3. That part of the reserve base that could be economically extracted or produced at the time of determination. The term “reserves” need not signify that extraction facilities are in place and operative. Reserves include only recoverable materials; thus, terms such as “extractable reserves” and “recoverable reserves” are redundant and are not a part of this classification system. Additional information is available in Appendix C of the Mineral Commodity Summaries, included in this data release, for resource and reserve definitions and information concerning data sources.']
-       - Removed values: 32 / 3869 (0.83%)
               country  year commodity      sub_commodity                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    notes_reserves
               Finland  2022  Chromium Mine, gross weight ['Units are thousand metric tons of shipping-grade chromite ore, which is deposit quantity and grade normalized to 45% Cr2O3, except for the United States, where grade is normalized to 7% Cr2O3 ,and Finland, where grade is normalized to 26% Cr2O3.', 'Units are thousand metric tons of shipping-grade chromite ore, which is deposit quantity and grade normalized to 45% Cr2O3, except for the United States, where grade is normalized to 7% Cr2O3 ,and Finland, where grade is normalized to 26% Cr2O3. That part of the reserve base that could be economically extracted or produced at the time of determination. The term “reserves” need not signify that extraction facilities are in place and operative. Reserves include only recoverable materials; thus, terms such as “extractable reserves” and “recoverable reserves” are redundant and are not a part of this classification system. Additional information is available in Appendix C of the Mineral Commodity Summaries, included in this data release, for resource and reserve definitions and information concerning data sources.']
            Kazakhstan  2022  Chromium Mine, gross weight ['Units are thousand metric tons of shipping-grade chromite ore, which is deposit quantity and grade normalized to 45% Cr2O3, except for the United States, where grade is normalized to 7% Cr2O3 ,and Finland, where grade is normalized to 26% Cr2O3.', 'Units are thousand metric tons of shipping-grade chromite ore, which is deposit quantity and grade normalized to 45% Cr2O3, except for the United States, where grade is normalized to 7% Cr2O3 ,and Finland, where grade is normalized to 26% Cr2O3. That part of the reserve base that could be economically extracted or produced at the time of determination. The term “reserves” need not signify that extraction facilities are in place and operative. Reserves include only recoverable materials; thus, terms such as “extractable reserves” and “recoverable reserves” are redundant and are not a part of this classification system. Additional information is available in Appendix C of the Mineral Commodity Summaries, included in this data release, for resource and reserve definitions and information concerning data sources.']
            Kazakhstan  2023  Chromium Mine, gross weight ['Units are thousand metric tons of shipping-grade chromite ore, which is deposit quantity and grade normalized to 45% Cr2O3, except for the United States, where grade is normalized to 7% Cr2O3, and Finland, where grade is normalized to 26% Cr2O3.', 'Units are thousand metric tons of shipping-grade chromite ore, which is deposit quantity and grade normalized to 45% Cr2O3, except for the United States, where grade is normalized to 7% Cr2O3 ,and Finland, where grade is normalized to 26% Cr2O3. That part of the reserve base that could be economically extracted or produced at the time of determination. The term “reserves” need not signify that extraction facilities are in place and operative. Reserves include only recoverable materials; thus, terms such as “extractable reserves” and “recoverable reserves” are redundant and are not a part of this classification system. Additional information is available in Appendix C of the Mineral Commodity Summaries, included in this data release, for resource and reserve definitions and information concerning data sources.']
          South Africa  2020  Chromium Mine, gross weight                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                []
                Turkey  2022  Chromium Mine, gross weight ['Units are thousand metric tons of shipping-grade chromite ore, which is deposit quantity and grade normalized to 45% Cr2O3, except for the United States, where grade is normalized to 7% Cr2O3 ,and Finland, where grade is normalized to 26% Cr2O3.', 'Units are thousand metric tons of shipping-grade chromite ore, which is deposit quantity and grade normalized to 45% Cr2O3, except for the United States, where grade is normalized to 7% Cr2O3 ,and Finland, where grade is normalized to 26% Cr2O3. That part of the reserve base that could be economically extracted or produced at the time of determination. The term “reserves” need not signify that extraction facilities are in place and operative. Reserves include only recoverable materials; thus, terms such as “extractable reserves” and “recoverable reserves” are redundant and are not a part of this classification system. Additional information is available in Appendix C of the Mineral Commodity Summaries, included in this data release, for resource and reserve definitions and information concerning data sources.']
    ~ Column production (new data, changed data)
+       + New values: 32 / 3869 (0.83%)
               country  year commodity sub_commodity  production
               Finland  2022  Chromium          Mine   2000000.0
            Kazakhstan  2022  Chromium          Mine   6000000.0
            Kazakhstan  2023  Chromium          Mine   6000000.0
          South Africa  2020  Chromium          Mine  13200000.0
                Turkey  2022  Chromium          Mine   5410000.0
-       - Removed values: 32 / 3869 (0.83%)
               country  year commodity      sub_commodity  production
               Finland  2022  Chromium Mine, gross weight   2000000.0
            Kazakhstan  2022  Chromium Mine, gross weight   6000000.0
            Kazakhstan  2023  Chromium Mine, gross weight   6000000.0
          South Africa  2020  Chromium Mine, gross weight  13200000.0
                Turkey  2022  Chromium Mine, gross weight   5410000.0
    ~ Column reserves (new data, changed data)
+       + New values: 32 / 3869 (0.83%)
               country  year commodity sub_commodity     reserves
               Finland  2022  Chromium          Mine    8300000.0
            Kazakhstan  2022  Chromium          Mine  230000000.0
            Kazakhstan  2023  Chromium          Mine  230000000.0
          South Africa  2020  Chromium          Mine         <NA>
                Turkey  2022  Chromium          Mine   26000000.0
-       - Removed values: 32 / 3869 (0.83%)
               country  year commodity      sub_commodity     reserves
               Finland  2022  Chromium Mine, gross weight    8300000.0
            Kazakhstan  2022  Chromium Mine, gross weight  230000000.0
            Kazakhstan  2023  Chromium Mine, gross weight  230000000.0
          South Africa  2020  Chromium Mine, gross weight         <NA>
                Turkey  2022  Chromium Mine, gross weight   26000000.0
    ~ Column unit (new data, changed data)
+       + New values: 32 / 3869 (0.83%)
               country  year commodity sub_commodity   unit
               Finland  2022  Chromium          Mine tonnes
            Kazakhstan  2022  Chromium          Mine tonnes
            Kazakhstan  2023  Chromium          Mine tonnes
          South Africa  2020  Chromium          Mine tonnes
                Turkey  2022  Chromium          Mine tonnes
-       - Removed values: 32 / 3869 (0.83%)
               country  year commodity      sub_commodity   unit
               Finland  2022  Chromium Mine, gross weight tonnes
            Kazakhstan  2022  Chromium Mine, gross weight tonnes
            Kazakhstan  2023  Chromium Mine, gross weight tonnes
          South Africa  2020  Chromium Mine, gross weight tonnes
                Turkey  2022  Chromium Mine, gross weight tonnes
    ~ Column unit_production (new data, changed data)
+       + New values: 32 / 3869 (0.83%)
               country  year commodity sub_commodity unit_production
               Finland  2022  Chromium          Mine          tonnes
            Kazakhstan  2022  Chromium          Mine          tonnes
            Kazakhstan  2023  Chromium          Mine          tonnes
          South Africa  2020  Chromium          Mine          tonnes
                Turkey  2022  Chromium          Mine          tonnes
-       - Removed values: 32 / 3869 (0.83%)
               country  year commodity      sub_commodity unit_production
               Finland  2022  Chromium Mine, gross weight          tonnes
            Kazakhstan  2022  Chromium Mine, gross weight          tonnes
            Kazakhstan  2023  Chromium Mine, gross weight          tonnes
          South Africa  2020  Chromium Mine, gross weight          tonnes
                Turkey  2022  Chromium Mine, gross weight          tonnes
    ~ Column unit_reserves (new data, changed data)
+       + New values: 32 / 3869 (0.83%)
               country  year commodity sub_commodity unit_reserves
               Finland  2022  Chromium          Mine        tonnes
            Kazakhstan  2022  Chromium          Mine        tonnes
            Kazakhstan  2023  Chromium          Mine        tonnes
          South Africa  2020  Chromium          Mine        tonnes
                Turkey  2022  Chromium          Mine        tonnes
-       - Removed values: 32 / 3869 (0.83%)
               country  year commodity      sub_commodity unit_reserves
               Finland  2022  Chromium Mine, gross weight        tonnes
            Kazakhstan  2022  Chromium Mine, gross weight        tonnes
            Kazakhstan  2023  Chromium Mine, gross weight        tonnes
          South Africa  2020  Chromium Mine, gross weight        tonnes
                Turkey  2022  Chromium Mine, gross weight        tonnes
  = Table mineral_commodity_summaries_flat
-   - Column production_chromium_mine__gross_weight_tonnes
+   + Column production_chromium_mine_tonnes
= Dataset garden/who/latest/monkeypox
  = Table monkeypox
    ~ Dim country
+       + New values: 21 / 101632 (0.02%)
                date   country
          2022-07-13 Guatemala
          2022-07-20 Guatemala
          2022-07-23 Guatemala
          2022-07-25 Guatemala
          2024-07-06    Uganda
-       - Removed values: 4004 / 101632 (3.94%)
                date                  country
          2024-12-17                    Aruba
          2025-01-04 Central African Republic
          2024-12-12                   Latvia
          2024-09-28                 Malaysia
          2024-12-15                 Thailand
    ~ Dim date
+       + New values: 21 / 101632 (0.02%)
            country       date
          Guatemala 2022-07-13
          Guatemala 2022-07-20
          Guatemala 2022-07-23
          Guatemala 2022-07-25
             Uganda 2024-07-06
-       - Removed values: 4004 / 101632 (3.94%)
                           country       date
                             Aruba 2024-12-17
          Central African Republic 2025-01-04
                            Latvia 2024-12-12
                          Malaysia 2024-09-28
                          Thailand 2024-12-15
    ~ Column annotation (new data, changed data)
+       + New values: 21 / 101632 (0.02%)
            country       date annotation
          Guatemala 2022-07-13           
          Guatemala 2022-07-20           
          Guatemala 2022-07-23           
          Guatemala 2022-07-25           
             Uganda 2024-07-06           
-       - Removed values: 4004 / 101632 (3.94%)
                           country       date annotation
                             Aruba 2024-12-17           
          Central African Republic 2025-01-04           
                            Latvia 2024-12-12           
                          Malaysia 2024-09-28           
                          Thailand 2024-12-15
    ~ Column iso_code (new data, changed data)
+       + New values: 21 / 101632 (0.02%)
            country       date iso_code
          Guatemala 2022-07-13      GTM
          Guatemala 2022-07-20      GTM
          Guatemala 2022-07-23      GTM
          Guatemala 2022-07-25      GTM
             Uganda 2024-07-06      UGA
-       - Removed values: 4004 / 101632 (3.94%)
                           country       date iso_code
                             Aruba 2024-12-17      ABW
          Central African Republic 2025-01-04      CAF
                            Latvia 2024-12-12      LVA
                          Malaysia 2024-09-28      MYS
                          Thailand 2024-12-15      THA
        ~ Changed values: 1 / 101632 (0.00%)
                               country       date iso_code - iso_code +
          Democratic Republic of Congo 2024-11-21        COD        NaN
    ~ Column new_cases (new data, changed data)
+       + New values: 21 / 101632 (0.02%)
            country       date  new_cases
          Guatemala 2022-07-13          0
          Guatemala 2022-07-20          0
          Guatemala 2022-07-23          0
          Guatemala 2022-07-25          0
             Uganda 2024-07-06          0
-       - Removed values: 4004 / 101632 (3.94%)
                           country       date  new_cases
                             Aruba 2024-12-17          0
          Central African Republic 2025-01-04          0
                            Latvia 2024-12-12          0
                          Malaysia 2024-09-28          0
                          Thailand 2024-12-15          0
        ~ Changed values: 640 / 101632 (0.63%)
                country       date  new_cases -  new_cases +
                 Canada 2024-04-16            1            3
          United States 2024-11-05           29           23
                  World 2023-01-10          246          243
                  World 2023-04-04           56           62
                  World 2023-11-14          111          112
    ~ Column new_cases_per_million (new data, changed data)
+       + New values: 21 / 101632 (0.02%)
            country       date  new_cases_per_million
          Guatemala 2022-07-13                    0.0
          Guatemala 2022-07-20                    0.0
          Guatemala 2022-07-23                    0.0
          Guatemala 2022-07-25                    0.0
             Uganda 2024-07-06                    0.0
-       - Removed values: 4004 / 101632 (3.94%)
                           country       date  new_cases_per_million
                             Aruba 2024-12-17                    0.0
          Central African Republic 2025-01-04                    0.0
                            Latvia 2024-12-12                    0.0
                          Malaysia 2024-09-28                    0.0
                          Thailand 2024-12-15                    0.0
        ~ Changed values: 582 / 101632 (0.57%)
                country       date  new_cases_per_million -  new_cases_per_million +
                 Brazil 2024-03-26                    0.101                    0.097
            El Salvador 2023-02-14                    0.157                      0.0
          North America 2022-10-04                    1.365                    1.367
          North America 2024-08-20                    0.143                    0.122
                  World 2022-08-09                    0.672                    0.673
    ~ Column new_cases_smoothed (new data, changed data)
+       + New values: 21 / 101632 (0.02%)
            country       date  new_cases_smoothed
          Guatemala 2022-07-13                0.14
          Guatemala 2022-07-20                0.14
          Guatemala 2022-07-23                0.14
          Guatemala 2022-07-25                0.14
             Uganda 2024-07-06                 0.0
-       - Removed values: 4004 / 101632 (3.94%)
                           country       date  new_cases_smoothed
                             Aruba 2024-12-17                 0.0
          Central African Republic 2025-01-04                0.14
                            Latvia 2024-12-12                 0.0
                          Malaysia 2024-09-28                 0.0
                          Thailand 2024-12-15                 0.0
        ~ Changed values: 4048 / 101632 (3.98%)
            country       date  new_cases_smoothed -  new_cases_smoothed +
          Guatemala 2022-08-15                   0.0                  0.29
          Guatemala 2022-10-04                   2.0                  2.57
             Mexico 2022-09-28             35.290001                 35.43
             Mexico 2023-04-28                  0.86                  0.71
              World 2022-12-20             54.139999                 55.43
    ~ Column new_cases_smoothed_per_million (new data, changed data)
+       + New values: 21 / 101632 (0.02%)
            country       date  new_cases_smoothed_per_million
          Guatemala 2022-07-13                           0.008
          Guatemala 2022-07-20                           0.008
          Guatemala 2022-07-23                           0.008
          Guatemala 2022-07-25                           0.008
             Uganda 2024-07-06                             0.0
-       - Removed values: 4004 / 101632 (3.94%)
                           country       date  new_cases_smoothed_per_million
                             Aruba 2024-12-17                             0.0
          Central African Republic 2025-01-04                           0.023
                            Latvia 2024-12-12                             0.0
                          Malaysia 2024-09-28                             0.0
                          Thailand 2024-12-15                             0.0
        ~ Changed values: 2947 / 101632 (2.90%)
                country       date  new_cases_smoothed_per_million -  new_cases_smoothed_per_million +
                 Africa 2024-09-23                             0.045                             0.043
                 Brazil 2024-03-02                             0.018                             0.017
          Cote d'Ivoire 2024-11-13                             0.019                               0.0
              Guatemala 2022-11-11                             0.231                             0.207
                  World 2024-11-23                             0.013                             0.009
    ~ Column new_deaths (new data, changed data)
+       + New values: 21 / 101632 (0.02%)
            country       date  new_deaths
          Guatemala 2022-07-13           0
          Guatemala 2022-07-20           0
          Guatemala 2022-07-23           0
          Guatemala 2022-07-25           0
             Uganda 2024-07-06           0
-       - Removed values: 4004 / 101632 (3.94%)
                           country       date  new_deaths
                             Aruba 2024-12-17           0
          Central African Republic 2025-01-04           0
                            Latvia 2024-12-12           0
                          Malaysia 2024-09-28           0
                          Thailand 2024-12-15           0
        ~ Changed value

...diff too long, truncated...

Automatically updated datasets matching weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk are not included

Edited: 2025-01-23 09:57:48 UTC
Execution time: 24.82 seconds

@Marigold Marigold force-pushed the similar-charts-admin branch 3 times, most recently from 9907952 to bd1e926 Compare January 17, 2025 10:43
@Marigold Marigold force-pushed the similar-charts-admin branch from c8bccec to 4606e95 Compare January 17, 2025 15:25
@Marigold Marigold changed the title 🎉 Enable good/bad labeling of similar charts by users 🎉 Admin for related charts Jan 20, 2025
@larsyencken
Copy link
Collaborator

Thanks for this update Mojmir!

What you're seeing is that major markers of development often are co-viewed with other major markers of development. That's bad if you want "more data like this", but could be good if you want "things I might be interested in".

It sounds like we should do a quality check with Joe around co-views, then consider moving to an initial implementation based on that. Since we like it so much, perhaps we should push co-view data from BigQuery into analytics/DuckDB?

Currently co-view data strips the query string from the URL, so a story based on coviews that includes explorer views and Mdim views might need some collaboration with @bnjmacdonald in order to get a version of co-view data that includes some query parameters.

@Marigold Marigold force-pushed the similar-charts-admin branch 2 times, most recently from 25373c5 to 500237c Compare January 22, 2025 13:37
@Marigold Marigold force-pushed the similar-charts-admin branch from 500237c to 78c84cb Compare January 22, 2025 13:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants