At this time, Gwern has not provided a 2022 update. To get new numbers, I grabbed the 2022 metadata from the BigQuery server. Some numbers thanks to some help from Datasette!
Total rows in Images table: 5,956,691
Total rows in Tags table: 603,987
Top 10 Copyright/Subject Tags:
| Subject | Count |
|---|---|
| original | 830238 |
| touhou | 780377 |
| kantai_collection | 442753 |
| fate_(series) | 264711 |
| fate/grand_order | 187941 |
| idolmaster | 172642 |
| pokemon | 169487 |
| vocaloid | 118108 |
| genshin_impact | 115403 |
| hololive | 115137 |
Top 10 New Copyright tags added 2022:
| Name |
|---|
| pokemon_sv |
| mahou_shoujo_madoka_magica:_hangyaku_no_monogatari |
| lycoris_recoil |
| gundam_suisei_no_majo |
| cyberpunk_(series) |
| cyberpunk_edgerunners |
| xenoblade_chronicles_3 |
| atelier_ryza_1 |
| kemono_friends_v_project |
| air_(visual_novel) |
Top 10 Character tags:
| Name | Count |
|---|---|
| hatsune_miku | 78922 |
| hakurei_reimu | 67874 |
| kirisame_marisa | 62416 |
| remilia_scarlet | 46975 |
| flandre_scarlet | 43534 |
| izayoi_sakuya | 42512 |
| admiral_(kancolle) | 34846 |
| artoria_pendragon_(fate) | 33160 |
| kochiya_sanae | 32563 |
| alice_margatroid | 32547 |
Top 10 New Character tags added 2022:
| Name | Count |
|---|---|
| jeanne_d'arc_alter_(avenger)_(fate) | 6737 |
| yae_miko | 5796 |
| okita_souji_(koha-ace) | 4624 |
| byleth_(female)_(fire_emblem) | 4146 |
| jeanne_d'arc_(ruler)_(fate) | 4093 |
| boo_tao_(genshin_impact) | 3044 |
| asuna_(bunny)_(blue_archive) | 2896 |
| corrin_(female)_(fire_emblem) | 2528 |
| nishikigi_chisato | 2462 |
| yelan_(genshin_impact) | 2415 |
Top 5 Image Pools
| Image Count | Pool Name |
|---|---|
| 18,354 | Disgustingly_Adorable |
| 8,248 | Heart-Warming |
| 6,874 | Juicy_Details |
| 6,037 | Beautiful_Smile |
| 5,684 | Slice_of_Life |
Image Ratings
| Rating | Count | Description |
|---|---|---|
| s | 3,778,887 | Safe |
| g | 838,377 | ? |
| q | 773,854 | Questionable |
| e | 565,573 | Explicit |
Scripts and tools for working with the Danbooru2021 data set.
- database - create a sqlite database from the (old-style) metadata files.
- database2021 - create a sqlite database from the new 2021 metadata files.
- browser - an interactive program to view images from the dataset, filtering by tags or rating.
See: https://www.gwern.net/Danbooru2021
For more details, view the readme file in each folder.
This is partly an exercise to learn more about Tk and sqlite with Python. An anime enthusiast might appreciate using this as a private Danbooru service.
Depending on your application, you may wish to consider removing files from your working dataset. For instance, when performing facial recognition, many of the below categories are likely to be irrelevant.
In the reduce folder are lists of image-ids for the following categories (accurate for Danbooru2020):
| Category | Count | Description |
|---|---|---|
| is_deleted | 234,782 | Files which are marked as 'deleted' on Danbooru |
| no_humans | 56,737 | Images which do not show humans |
| not-image | 14,420 | Files which are not images (rar, zip, swf, mpg, etc) |
| photo | 10,161 | Files which are photographs, not bitmaps |
| text_only_page | 1,865 | Images consisting solely of text |
| duplicates | 20,187 | Duplicated images (1) |
| Total | 338,152 |
(1) Duplicated images have been identified by calculating a 32-bit CRC on the image pixels. Thus any differences based on encoding (e.g. PNG vs JPG) or metadata have been eliminated. Caution is required using both "deleted" and "duplicates" as there currently isn't a clean intersection between the two sets.
Total rows in Images table: 4,878,068
Total rows in Tags table: 498,860
Top 10 Copyright/Subject Tags
| Subject | Count |
|---|---|
| touhou | 697,807 |
| original | 652,817 |
| kantai_collection | 403,165 |
| fate_(series) | 233,412 |
| fate/grand_order | 161,734 |
| idolmaster | 147,841 |
| pokemon | 125,322 |
| vocaloid | 106,815 |
| idolmaster_cinderella_girls | 85,415 |
| azur_lane | 81,223 |
Top 10 Artist Tags
| Artist | Count |
|---|---|
| hammer_(sunset_beach) | 4,894 |
| ebifurya | 4,403 |
| haruyama_kazunori | 4,399 |
| mizuki_hitoshi | 4,210 |
| kouji_(campus_life) | 4,024 |
| itomugi-kun | 3,418 |
| tani_takeshi | 3,410 |
| tony_taka | 2,961 |
| bkub | 2,905 |
| kanon_(kurogane_knights) | 2,867 |
Top 10 Character Tags
| Character | Count |
|---|---|
| hatsune_miku | 70,825 |
| hakurei_reimu | 62,161 |
| kirisame_marisa | 57,803 |
| remilia_scarlet | 43,070 |
| izayoi_sakuya | 40,173 |
| flandre_scarlet | 38,132 |
| admiral_(kancolle) | 32,833 |
| alice_margatroid | 30,696 |
| kochiya_sanae | 30,476 |
| artoria_pendragon_(fate) | 30,437 |
Top 10 Non-Touhou Character Tags
| Character | Count |
|---|---|
| hatsune_miku | 70,825 |
| admiral_(kancolle) | 32,833 |
| artoria_pendragon_(fate) | 30,437 |
| akemi_homura | 22,026 |
| kaname_madoka | 20,808 |
| kaga_(kancolle) | 19,490 |
| saber | 16,214 |
| kagamine_rin | 16,038 |
| jeanne_d'arc_(fate) | 15,992 |
| miki_sayaka | 15,971 |
Charts showing posting by year of various Copyright / Subjects for Danbooru 2020. The Y-axis is per year, 2005-2020.
Top 3 by year
Next Top 5 by year
Top 5 Dwindling Subjects
Sample of some recently rising Subjects
The data used to make these charts can be found in the tags_by_year folder.