Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Warning: One or more mimetype migrations are available #47359

Closed
5 of 8 tasks
Tiller opened this issue Aug 20, 2024 · 17 comments
Closed
5 of 8 tasks

[Bug]: Warning: One or more mimetype migrations are available #47359

Tiller opened this issue Aug 20, 2024 · 17 comments
Assignees
Labels
4. to release Ready to be released and/or waiting for tests to finish 28-feedback 29-feedback bug

Comments

@Tiller
Copy link

Tiller commented Aug 20, 2024

⚠️ This issue respects the following points: ⚠️

Bug description

I just upgraded to nextcloud 29.0.5 from version 29.0.4 via the updater. Then ran the migration through the updater and then ran occ db:add-missing-indices in my shell that added an index on oc_systemtag_object_mapping.

After checking the administrative panel, I have the following warning:

One or more mimetype migrations are available. Occasionally new mimetypes are added to better handle certain file types. Migrating the mimetypes take a long time on larger instances so this is not done automatically during upgrades. Use the command occ maintenance:repair --include-expensive to perform the migrations.

I tried to run the command, that gave the following output:

sudo -u www-data php8.2 /var/www/nextcloud/occ maintenance:repair --include-expensive                                      
 - Repair MySQL collation
     - Not a mysql database -> nothing to do
 - Clean tags and favorites
     - 0 tags of deleted users have been removed.
     - 0 tags for delete files have been removed.
     - 0 tag entries for deleted tags have been removed.
     - 0 tags with no entries have been removed.
 - Repair invalid shares
 - Move .step file of updater to backup location
 - Add move avatar background job
     - Repair step already executed
 - Add preview cleanup background jobs
 - Migrate oauth2_clients table to nextcloud schema
     - Update the oauth2_access_tokens table schema.
     - Update the oauth2_clients table schema.
     - Delete clients (and their related access tokens) with the redirect_uri starting with oc:// or ending with *
 - Fix potential broken mount points
     - No mounts updated
 - Repair language codes
 - Add log rotate job
 - Clear frontend caches
     - Image cache cleared
     - JS cache cleared
 - Clear every generated avatar
 - Add preview background cleanup job
 - Queue a one-time job to cleanup old backups of the updater
 - Cleanup invalid photocache files for carddav
 - Add background job to cleanup login flow v2 tokens
 - Remove potentially over exposing share links
     - No need to remove link shares.
 - Clear access cache of projects
 - Reset generated avatar flag
 - Keep legacy encryption enabled
 - Check encryption key format
 - Remove old dashboard app config data
 - Add job to cleanup the bruteforce entries
 - Queue a one-time job to check for user uploaded certificates
 - Repair DAV shares
 - Add background job to set the lookup server share state for users
 - Add token cleanup job
 - Clean up abandoned apps
 - Add possibly missing system config
 - Add AI tasks cleanup job
 - Queue a job to generate metadata
 - migrate lazy config values
 - Cache logo dimension to fix size in emails on Outlook
     - Theming is not used to provide a logo
 - Remove shares of old group memberships
 - Repair mime types
 - Validate the phone number and store it in a known format for search
 - Handle outdated scheduling events
     - Cleaning up old scheduling events
     - Adding background job to delete old scheduling objects
 - Upgrading Circles App
 - Fix component of birthday calendars
     - 2 birthday calendars updated.
 - Regenerating birthday calendars to use new icons and fix old birthday events without year
     - Repair step already executed
 - Fix broken values of calendar objects
    0 [->--------------------------]
 - Registering building of calendar search index as background job
     - Repair step already executed
 - Register building of social profile search index as background job
 - Registering background jobs to update cache for webcal calendars
     - Added 0 background jobs to update webcal calendars
 - Registering building of calendar reminder index as background job
     - Repair step already executed
 - Clean up orphan event and contact data
     - 0 events without a calendar have been cleaned up
     - 0 properties without an events have been cleaned up
     - 0 changes without a calendar have been cleaned up
     - 0 cached events without a calendar subscription have been cleaned up
     - 0 changes without a calendar subscription have been cleaned up
     - 0 contacts without an addressbook have been cleaned up
     - 0 properties without a contact have been cleaned up
     - 0 changes without an addressbook have been cleaned up
 - Remove activity entries of private events
     - Removed 0 activity entries
 - Clean up old calendar subscriptions from deleted users that were not cleaned-up
    0 [----->----------------------]
     - 0 calendar subscriptions without an user have been cleaned up
 - Remove invalid object properties
     - 0 invalid object properties removed.
 - Fix the share type of guest shares when migrating from ownCloud
 - Copy the share password into the dedicated column
 - Set existing shares as accepted
 - Repair steps for Memories
     - External table schema seem up to date
     - Recreated filecache trigger with: Doctrine\DBAL\Platforms\PostgreSQL100Platform
     - exiftool binary is configured: /var/www/nextcloud/apps/memories/bin-ext/exiftool-amd64-glibc
     - go-vod binary is configured: /var/www/nextcloud/apps/memories/bin-ext/go-vod-amd64
     - ffmpeg binary is configured: /usr/bin/ffmpeg
 - Clean up meta table
 - Show a hint about the new editor to existing users
 - Update OAuth token expiration times
 - init metadata
 - Switches from default updater server to the customer one if a valid subscription is available
     - Repair step already executed
 - Send an admin notification if monthly report is disabled
 - Force-reset all Text document sessions
 - Initialize migration of background images from dashboard to theming app
 - Add background job to check for backup codes
 - Populating added database structures for workflows

But the warning is still present in the administrative console. I then tried to restart apache2 : same.

I tried occ maintenance:mimetype:update-db :

Added mimetype "application/x-7z-compressed" to database
Added mimetype "application/msaccess" to database
Added mimetype "application/vnd.android.package-archive" to database
Added mimetype "image/x-dcraw" to database
Added mimetype "text/x-shellscript" to database
Added mimetype "application/x-msdos-program" to database
Added mimetype "application/x-blender" to database
Added mimetype "image/bpg" to database
Added mimetype "application/x-bzip2" to database
Added mimetype "text/x-c" to database
Added mimetype "text/x-c++src" to database
Added mimetype "application/comicbook+7z" to database
Added mimetype "application/comicbook+ace" to database
Added mimetype "application/comicbook+rar" to database
Added mimetype "application/comicbook+tar" to database
Added mimetype "application/comicbook+truecrypt" to database
Added mimetype "application/comicbook+zip" to database
Added mimetype "application/coreldraw" to database
Added mimetype "application/java" to database
Added mimetype "application/cmd" to database
Added mimetype "application/x-cbr" to database
Added mimetype "application/x-deb" to database
Added mimetype "application/msword" to database
Added mimetype "application/vnd.ms-word.document.macroEnabled.12" to database
Added mimetype "application/vnd.openxmlformats-officedocument.wordprocessingml.template" to database
Added mimetype "video/dv" to database
Added mimetype "application/vnd.ms-fontobject" to database
Added mimetype "application/postscript" to database
Added mimetype "application/epub+zip" to database
Added mimetype "application/x-ms-dos-executable" to database
Added mimetype "application/x-fictionbook+xml" to database
Added mimetype "video/x-flv" to database
Added mimetype "application/gpx+xml" to database
Added mimetype "text/x-h" to database
Added mimetype "text/html" to database
Added mimetype "text/calendar" to database
Added mimetype "image/x-icon" to database
Added mimetype "text/impress" to database
Added mimetype "text/x-java-source" to database
Added mimetype "image/jp2" to database
Added mimetype "application/x-kdbx" to database
Added mimetype "application/x-iwork-keynote-sffkey" to database
Added mimetype "application/km" to database
Added mimetype "application/vnd.google-earth.kml+xml" to database
Added mimetype "application/vnd.google-earth.kmz" to database
Added mimetype "application/x-krita" to database
Added mimetype "text/x-ldif" to database
Added mimetype "application/vnd.lotus-wordpro" to database
Added mimetype "video/mp2t" to database
Added mimetype "audio/mpegurl" to database
Added mimetype "audio/m4b" to database
Added mimetype "application/x-freemind" to database
Added mimetype "application/x-mobipocket-ebook" to database
Added mimetype "application/x-msi" to database
Added mimetype "application/x-iwork-numbers-sffnumbers" to database
Added mimetype "application/vnd.oasis.opendocument.formula" to database
Added mimetype "application/vnd.oasis.opendocument.graphics" to database
Added mimetype "application/msonenote" to database
Added mimetype "application/font-sfnt" to database
Added mimetype "application/x-iwork-pages-sffpages" to database
Added mimetype "application/x-font" to database
Added mimetype "application/x-php" to database
Added mimetype "application/x-perl" to database
Added mimetype "audio/x-scpls" to database
Added mimetype "application/vnd.ms-powerpoint" to database
Added mimetype "application/vnd.ms-powerpoint.template.macroEnabled.12" to database
Added mimetype "application/vnd.openxmlformats-officedocument.presentationml.template" to database
Added mimetype "application/vnd.ms-powerpoint.addin.macroEnabled.12" to database
Added mimetype "application/vnd.ms-powerpoint.slideshow.macroEnabled.12" to database
Added mimetype "application/vnd.openxmlformats-officedocument.presentationml.slideshow" to database
Added mimetype "application/vnd.ms-powerpoint.presentation.macroEnabled.12" to database
Added mimetype "application/vnd.openxmlformats-officedocument.presentationml.presentation" to database
Added mimetype "application/x-photoshop" to database
Added mimetype "text/x-python" to database
Added mimetype "application/x-rar-compressed" to database
Added mimetype "text/reveal" to database
Added mimetype "application/rss+xml" to database
Added mimetype "text/rtf" to database
Added mimetype "application/sgf" to database
Added mimetype "image/sgi" to database
Added mimetype "application/x-shockwave-flash" to database
Added mimetype "application/x-compressed" to database
Updated 1 filecache rows for mimetype "application/x-compressed"
Added mimetype "application/x-tar" to database
Added mimetype "application/vnd.garmin.tcx+xml" to database
Added mimetype "application/x-tex" to database
Added mimetype "image/tga" to database
Added mimetype "application/internet-shortcut" to database
Added mimetype "text/vcard" to database
Added mimetype "video/dvd" to database
Added mimetype "application/vnd.visio" to database
Added mimetype "application/vnd.ms-visio.drawing.macroEnabled.12" to database
Added mimetype "application/vnd.ms-visio.drawing" to database
Added mimetype "application/vnd.ms-visio.stencil.macroEnabled.12" to database
Added mimetype "application/vnd.ms-visio.stencil" to database
Added mimetype "application/vnd.ms-visio.template.macroEnabled.12" to database
Added mimetype "application/vnd.ms-visio.template" to database
Added mimetype "audio/wav" to database
Added mimetype "audio/webm" to database
Added mimetype "application/font-woff" to database
Added mimetype "application/vnd.wordperfect" to database
Added mimetype "application/x-gimp" to database
Added mimetype "application/vnd.ms-excel" to database
Added mimetype "application/vnd.ms-excel.addin.macroEnabled.12" to database
Added mimetype "application/vnd.ms-excel.sheet.binary.macroEnabled.12" to database
Added mimetype "application/vnd.ms-excel.sheet.macroEnabled.12" to database
Added mimetype "application/vnd.openxmlformats-officedocument.spreadsheetml.sheet" to database
Added mimetype "application/vnd.ms-excel.template.macroEnabled.12" to database
Added mimetype "application/vnd.openxmlformats-officedocument.spreadsheetml.template" to database
Added mimetype "application/vnd.xmind.workbook" to database
Added mimetype "application/xml" to database
Added mimetype "application/yaml" to database
Added mimetype "application/zip" to database
Added 112 new mimetypes
Updated 1 filecache rows

Then occ maintenance:mimetype:update-js:

mimetypelist.js is updated

But warning is still present (I retried occ maintenance:repair --include-expensive with no luck)

Steps to reproduce

  1. upgrade to 29.0.5 from 29.0.4
  2. migrate
  3. add index
  4. run repair with expensive included

Expected behavior

Warning should disappear and/or if the given command is not the working command, the warning text should be updated

Installation method

Community Manual installation with Archive

Nextcloud Server version

29

Operating system

Debian/Ubuntu

PHP engine version

PHP 8.2

Web server

Apache (supported)

Database engine version

PostgreSQL

Is this bug present after an update or on a fresh install?

Updated from a MINOR version (ex. 28.0.1 to 28.0.2)

Are you using the Nextcloud Server Encryption module?

None

What user-backends are you using?

  • Default user-backend (database)
  • LDAP/ Active Directory
  • SSO - SAML
  • Other

Configuration report

{
    "system": {
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": [
            "***REMOVED SENSITIVE VALUE***"
        ],
        "trusted_proxies": "***REMOVED SENSITIVE VALUE***",
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "pgsql",
        "version": "29.0.5.1",
        "default_language": "fr",
        "default_locale": "fr_FR",
        "default_phone_region": "FR",
        "overwrite.cli.url": "***REMOVED SENSITIVE VALUE***",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "loglevel": 2,
        "maintenance": false,
        "maintenance_window_start": 1,
        "preview_max_x": 1280,
        "preview_max_y": 1280,
        "preview_max_scale_factor": 1,
        "theme": "",
        "mail_smtpmode": "smtp",
        "mail_smtpsecure": "tls",
        "mail_sendmailmode": "smtp",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpauth": 1,
        "mail_smtpauthtype": "LOGIN",
        "mail_smtphost": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpport": "587",
        "mail_smtpname": "***REMOVED SENSITIVE VALUE***",
        "mail_smtppassword": "***REMOVED SENSITIVE VALUE***",
        "memories.exiftool": "\/var\/www\/nextcloud\/apps\/memories\/bin-ext\/exiftool-amd64-glibc",
        "memories.ffmpeg_path": "\/usr\/bin\/ffmpeg",
        "memories.ffprobe_path": "\/usr\/bin\/ffprobe",
        "memories.transcoder": "\/var\/www\/nextcloud\/apps\/memories\/exiftool-bin\/go-vod-amd64",
        "memories.no_transcode": false,
        "memories.qsv": false,
        "memories.vod.path": "\/var\/www\/nextcloud\/apps\/memories\/bin-ext\/go-vod-amd64",
        "memories.vod.ffmpeg": "\/usr\/bin\/ffmpeg",
        "memories.vod.ffprobe": "\/usr\/bin\/ffprobe",
        "enable_previews": true,
        "enabledPreviewProviders": [
            "OC\\Preview\\Movie",
            "OC\\Preview\\PNG",
            "OC\\Preview\\JPEG",
            "OC\\Preview\\GIF",
            "OC\\Preview\\BMP",
            "OC\\Preview\\XBitmap",
            "OC\\Preview\\MP3",
            "OC\\Preview\\MP4",
            "OC\\Preview\\TXT",
            "OC\\Preview\\MarkDown",
            "OC\\Preview\\PDF"
        ],
        "memories.db.triggers.fcu": true
    }
}

List of activated Apps

Enabled:
  - activity: 2.21.1
  - bruteforcesettings: 2.9.0
  - calendar: 4.7.15
  - circles: 29.0.0-dev
  - cloud_federation_api: 1.12.0
  - comments: 1.19.0
  - contacts: 6.0.0
  - contactsinteraction: 1.10.0
  - dashboard: 7.9.0
  - dav: 1.30.1
  - federatedfilesharing: 1.19.0
  - federation: 1.19.0
  - files: 2.1.1
  - files_downloadlimit: 2.0.0
  - files_external: 1.21.0
  - files_pdfviewer: 2.10.0
  - files_reminders: 1.2.0
  - files_sharing: 1.21.0
  - files_trashbin: 1.19.0
  - files_versions: 1.22.0
  - firstrunwizard: 2.18.0
  - logreader: 2.14.0
  - lookup_server_connector: 1.17.0
  - maps: 1.4.0
  - memories: 7.3.1
  - nextcloud_announcements: 1.18.0
  - notes: 4.10.1
  - notifications: 2.17.0
  - oauth2: 1.17.0
  - password_policy: 1.19.0
  - photos: 2.5.0
  - previewgenerator: 5.6.0
  - privacy: 1.13.0
  - provisioning_api: 1.19.0
  - recommendations: 2.1.0
  - related_resources: 1.4.0
  - serverinfo: 1.19.0
  - settings: 1.12.0
  - sharebymail: 1.19.0
  - support: 1.12.0
  - survey_client: 1.17.0
  - systemtags: 1.19.0
  - text: 3.10.1
  - theming: 2.4.0
  - twofactor_backupcodes: 1.18.0
  - updatenotification: 1.19.1
  - user_status: 1.9.0
  - viewer: 2.3.0
  - weather_status: 1.9.0
  - workflowengine: 2.11.0
Disabled:
  - admin_audit: 1.19.0
  - appointments: 2.1.4 (installed 2.1.4)
  - encryption: 2.17.0
  - facerecognition: 0.9.51 (installed 0.9.51)
  - files_rightclick: 0.15.1 (installed 1.6.0)
  - suspicious_login: 7.0.0
  - twofactor_totp: 11.0.0-dev
  - user_ldap: 1.20.0

Nextcloud Signing status

No response

Nextcloud Logs

No relevant log as far as I can see, will give if prompted

Additional info

No response

@Tiller Tiller added 0. Needs triage Pending check for reproducibility or if it fits our roadmap bug labels Aug 20, 2024
@skjnldsv
Copy link
Member

skjnldsv commented Aug 20, 2024

Hi,

Thank you all for the quick feedback!
Just before we continue, your instance is still up and running, right? Only the persistent warning is causing a moderate annoyance?
I'm trying to gauge the severity

@Tiller
Copy link
Author

Tiller commented Aug 20, 2024

Hi,
Yes, my instance is up and running and I haven't noticed any issue aside this warning. But I haven't used it that much yet

@Morethanevil

This comment has been minimized.

@scontin

This comment has been minimized.

@skjnldsv

This comment has been minimized.

@kesselb
Copy link
Contributor

kesselb commented Aug 20, 2024

  1. Do you also see the warning when running the setup checks via cli (occ setupchecks)?
  2. What's the output of occ config:app:get files mimetype_version?

@Tiller
Copy link
Author

Tiller commented Aug 20, 2024

  1. yes
  2. 29.0.5.1

@solracsf
Copy link
Member

solracsf commented Aug 20, 2024

Affects also v28.0.9 (confirmed) since #45966 has been backported.

@solracsf solracsf added 28-feedback 1. to develop Accepted and waiting to be taken care of and removed 0. Needs triage Pending check for reproducibility or if it fits our roadmap labels Aug 20, 2024
@solracsf solracsf pinned this issue Aug 20, 2024
@janusn

This comment was marked as spam.

@bbx-github

This comment was marked as spam.

@tigernero79

This comment has been minimized.

@ncheng89

This comment has been minimized.

@flatterrich

This comment has been minimized.

@Tiller

This comment has been minimized.

@nextcloud nextcloud locked as off-topic and limited conversation to collaborators Aug 21, 2024
@nickvergessen
Copy link
Member

Having it on my private instance as well.
The actual issue is

if (version_compare($mimeTypeVersion, '30.0.0.0', '<') && $this->introduceExcalidrawType()) {

It basically on the backport it was not updated to the 29 version and still yields when below 30:
https://github.com/nextcloud/server/blob/stable29/lib/private/Repair/RepairMimeTypes.php#L427

@nickvergessen

This comment has been minimized.

@solracsf solracsf added 4. to release Ready to be released and/or waiting for tests to finish and removed 1. to develop Accepted and waiting to be taken care of labels Aug 21, 2024
@solracsf solracsf changed the title [Bug]: One or more mimetype migrations are available [Bug]: Warning: One or more mimetype migrations are available Aug 22, 2024
@solracsf solracsf unpinned this issue Sep 12, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
4. to release Ready to be released and/or waiting for tests to finish 28-feedback 29-feedback bug
Projects
None yet
Development

No branches or pull requests