[package] qt/5.15.2: Plugins not deployed on MacOS #5487

MartinDelille · 2021-05-09T11:57:04Z

I’m trying to use the conan version of Qt with the following conanfile.txt:

[requires]
qt/5.15.2

[options]
qt:shared=True
qt:qttools=True

[generators]
qt
virtualrunenv

When create a bundle application it crash on startup. I realized it was due to the missing plugins as you can see on this terminal output:

$ export QT_DEBUG_PLUGINS=1
$ ./test.app/Contents/MacOS/test
QFactoryLoader::QFactoryLoader() checking directory path "/Users/martin/Downloads/conan.app/Contents/MacOS/platforms" ...
qt.qpa.plugin: Could not find the Qt platform plugin "cocoa" in ""
This application failed to start because no Qt platform plugin could be initialized. Reinstalling the application may fix this problem.

The problem seems to come from the plugins folder location in the package subfolder (bin/archdatadir ).
The conan recipe offer the possibility to generate a qt.conf file containing information that should help my build chain to work properly:

[Paths]
Prefix = /Users/martin/.conan/data/qt/5.15.2/_/_/package/0af6aa42f3ece12447af62252e18e9680ffa1200
ArchData = bin/archdatadir
HostData = bin/archdatadir
Data = bin/datadir
Sysconf = bin/sysconfdir
LibraryExecutables = bin/archdatadir/bin
Plugins = bin/archdatadir/plugins
Imports = bin/archdatadir/imports
Qml2Imports = bin/archdatadir/qml
Translations = bin/datadir/translations
Documentation = bin/datadir/doc
Examples = bin/datadir/examples

For example, if I copy this file in the test.app/Contents/Resources folder, it works.
I also manage to make it work by manually moving the plugins folder from the bin/archdatadir package subfolder to the package folder (/Users/martin/.conan/data/qt/5.15.2///package/0af6aa42f3ece12447af62252e18e9680ffa1200).
What is the clean way to handle this issue ?

Package and Environment Details (include every applicable attribute)

Package Name/Version: qt/5.15.2
Operating System+version: MacOS 10.15.7
Compiler+version: apple-clang 12.0
Docker image: N/A
Conan version: conan 1.36.0
Python version: Python 3.9.5

Conan profile (output of `conan profile show default` or `conan profile show <profile>` if custom profile is in use)

Configuration for profile default:

[settings]
os=Macos
os_build=Macos
arch=x86_64
arch_build=x86_64
compiler=apple-clang
compiler.version=12.0
compiler.libcxx=libc++
build_type=Release
[options]
[build_requires]
[env]

Steps to reproduce (Include if Applicable)

mkdir build && cd build
conan install ..
source activate_run.sh
qmake ../test.pro
make
macdeployqt test.app -verbose=2

Logs (Include/Attach if Applicable)

Click to expand log

$ conan install ..
Configuration:
[settings]
arch=x86_64
arch_build=x86_64
build_type=Release
compiler=apple-clang
compiler.libcxx=libc++
compiler.version=12.0
os=Macos
os_build=Macos
[options]
[build_requires]
[env]

conanfile.txt: Installing package
Requirements
    brotli/1.0.9 from 'conan-center' - Cache
    bzip2/1.0.8 from 'conan-center' - Cache
    double-conversion/3.1.5 from 'conan-center' - Cache
    freetype/2.10.4 from 'conan-center' - Cache
    libiconv/1.16 from 'conan-center' - Cache
    libjpeg/9d from 'conan-center' - Cache
    libmysqlclient/8.0.17 from 'conan-center' - Cache
    libpng/1.6.37 from 'conan-center' - Cache
    libpq/12.2 from 'conan-center' - Cache
    odbc/2.3.7 from 'conan-center' - Cache
    opengl/system from 'conan-center' - Cache
    openssl/1.1.1j from 'conan-center' - Cache
    pcre2/10.35 from 'conan-center' - Cache
    qt/5.15.2 from 'conan-center' - Cache
    sqlite3/3.33.0 from 'conan-center' - Cache
    zlib/1.2.11 from 'conan-center' - Cache
    zstd/1.4.8 from 'conan-center' - Cache
Packages
    brotli/1.0.9:647afeb69d3b0a2d3d316e80b24d38c714cc6900 - Cache
    bzip2/1.0.8:75fe66fbfe61230e9fcbb361f13b6b3baa483e0a - Cache
    double-conversion/3.1.5:6a83d7f783e7ee89a83cf2fe72b5f5f67538e2a6 - Cache
    freetype/2.10.4:f4924bd3b94e155cbf790d74ba3a3c29ccc81e89 - Cache
    libiconv/1.16:647afeb69d3b0a2d3d316e80b24d38c714cc6900 - Cache
    libjpeg/9d:647afeb69d3b0a2d3d316e80b24d38c714cc6900 - Cache
    libmysqlclient/8.0.17:12e80b538837eca6e02ef1a3eed67aa25cf3423c - Cache
    libpng/1.6.37:88955cec2844f731470e07bd44ce5a3a24ec88b7 - Cache
    libpq/12.2:6615b55b95ff43a02a83c3955d071acd71dad079 - Cache
    odbc/2.3.7:5f4c4ed8ddf27bb70b22f93ac66b6827fc5411d1 - Cache
    opengl/system:5ab84d6acfe1f23c4fae0ab88f26e3a396351ac9 - Cache
    openssl/1.1.1j:647afeb69d3b0a2d3d316e80b24d38c714cc6900 - Cache
    pcre2/10.35:2d8245d819a6b7543095d62df5d99244060071ba - Cache
    qt/5.15.2:0af6aa42f3ece12447af62252e18e9680ffa1200 - Cache
    sqlite3/3.33.0:8ff459f4b248c0e0564ec4e80e52b8d1aca419ce - Cache
    zlib/1.2.11:647afeb69d3b0a2d3d316e80b24d38c714cc6900 - Cache
    zstd/1.4.8:647afeb69d3b0a2d3d316e80b24d38c714cc6900 - Cache

Installing (downloading, building) binaries...
brotli/1.0.9: Already installed!
bzip2/1.0.8: Already installed!
bzip2/1.0.8: Appending PATH environment variable: /Users/martin/.conan/data/bzip2/1.0.8/_/_/package/75fe66fbfe61230e9fcbb361f13b6b3baa483e0a/bin
double-conversion/3.1.5: Already installed!
libiconv/1.16: Already installed!
libiconv/1.16: Appending PATH environment var: /Users/martin/.conan/data/libiconv/1.16/_/_/package/647afeb69d3b0a2d3d316e80b24d38c714cc6900/bin
libjpeg/9d: Already installed!
opengl/system: Already installed!
openssl/1.1.1j: Already installed!
sqlite3/3.33.0: Already installed!
sqlite3/3.33.0: Appending PATH env var with : /Users/martin/.conan/data/sqlite3/3.33.0/_/_/package/8ff459f4b248c0e0564ec4e80e52b8d1aca419ce/bin
zlib/1.2.11: Already installed!
zstd/1.4.8: Already installed!
libmysqlclient/8.0.17: Already installed!
libpng/1.6.37: Already installed!
libpq/12.2: Already installed!
odbc/2.3.7: Already installed!
odbc/2.3.7: Appending PATH environment variable: /Users/martin/.conan/data/odbc/2.3.7/_/_/package/5f4c4ed8ddf27bb70b22f93ac66b6827fc5411d1/bin
pcre2/10.35: Already installed!
pcre2/10.35: Appending PATH environment variable: /Users/martin/.conan/data/pcre2/10.35/_/_/package/2d8245d819a6b7543095d62df5d99244060071ba/bin
freetype/2.10.4: Already installed!
qt/5.15.2: Already installed!
conanfile.txt: Generator virtualrunenv created activate_run.ps1
conanfile.txt: Generator virtualrunenv created deactivate_run.ps1
conanfile.txt: Generator virtualrunenv created environment_run.ps1.env
conanfile.txt: Generator virtualrunenv created activate_run.sh
conanfile.txt: Generator virtualrunenv created deactivate_run.sh
conanfile.txt: Generator virtualrunenv created environment_run.sh.env
conanfile.txt: Generator qt created qt.conf
conanfile.txt: Generator txt created conanbuildinfo.txt
conanfile.txt: Generated conaninfo.txt
conanfile.txt: Generated graphinfo
$ source activate_run.sh
$ qmake ../test.pro
Info: creating stash file /Users/martin/dev/phonations/Bacasable/build/.qmake.stash
$ make
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/clang++ -c -pipe -stdlib=libc++ -O2 -std=gnu++11  -arch x86_64 -isysroot /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX11.1.sdk -mmacosx-version-min=10.13 -Wall -Wextra -fPIC -DQT_NO_DEBUG -DQT_WIDGETS_LIB -DQT_GUI_LIB -DQT_CORE_LIB -I../../Bacasable -I. -I../../../../.conan/data/qt/5.15.2/_/_/package/0af6aa42f3ece12447af62252e18e9680ffa1200/include -I../../../../.conan/data/qt/5.15.2/_/_/package/0af6aa42f3ece12447af62252e18e9680ffa1200/include/QtWidgets -I../../../../.conan/data/qt/5.15.2/_/_/package/0af6aa42f3ece12447af62252e18e9680ffa1200/include/QtGui -I../../../../.conan/data/qt/5.15.2/_/_/package/0af6aa42f3ece12447af62252e18e9680ffa1200/include/QtCore -I. -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX11.1.sdk/System/Library/Frameworks/OpenGL.framework/Headers -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX11.1.sdk/System/Library/Frameworks/AGL.framework/Headers -I../../../../.conan/data/qt/5.15.2/_/_/package/0af6aa42f3ece12447af62252e18e9680ffa1200/bin/archdatadir/mkspecs/macx-clang -o main.o ../main.cpp
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/clang++ -stdlib=libc++ -headerpad_max_install_names  -arch x86_64 -isysroot /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX11.1.sdk -mmacosx-version-min=10.13 -Wl,-rpath,@executable_path/../Frameworks -Wl,-rpath,/Users/martin/.conan/data/qt/5.15.2/_/_/package/0af6aa42f3ece12447af62252e18e9680ffa1200/lib -o test.app/Contents/MacOS/test main.o   /Users/martin/.conan/data/qt/5.15.2/_/_/package/0af6aa42f3ece12447af62252e18e9680ffa1200/lib/libQt5Widgets.dylib /Users/martin/.conan/data/qt/5.15.2/_/_/package/0af6aa42f3ece12447af62252e18e9680ffa1200/lib/libQt5Gui.dylib /Users/martin/.conan/data/qt/5.15.2/_/_/package/0af6aa42f3ece12447af62252e18e9680ffa1200/lib/libQt5Core.dylib -framework OpenGL -framework AGL
$ macdeployqt test.app -verbose=2
Log:
Log: Deploying Qt frameworks found inside: ("/Users/martin/dev/phonations/Bacasable/build/test.app/Contents/MacOS/test")
Log:  copied: "/Users/martin/.conan/data/qt/5.15.2/_/_/package/0af6aa42f3ece12447af62252e18e9680ffa1200/lib/libQt5Widgets.5.dylib"
Log:  to "test.app/Contents/Frameworks//libQt5Widgets.5.dylib"
Log:  copied: "/Users/martin/.conan/data/qt/5.15.2/_/_/package/0af6aa42f3ece12447af62252e18e9680ffa1200/lib/libQt5Gui.5.dylib"
Log:  to "test.app/Contents/Frameworks//libQt5Gui.5.dylib"
Log:  copied: "/Users/martin/.conan/data/qt/5.15.2/_/_/package/0af6aa42f3ece12447af62252e18e9680ffa1200/lib/libQt5Core.5.dylib"
Log:  to "test.app/Contents/Frameworks//libQt5Core.5.dylib"
Log:
Log: Deploying plugins from "/Users/martin/.conan/data/qt/5.15.2/_/_/package/0af6aa42f3ece12447af62252e18e9680ffa1200/plugins"
Log: Created configuration file: "test.app/Contents/Resources/qt.conf"
Log: This file sets the plugin search path to "test.app/Contents/PlugIns"

The text was updated successfully, but these errors were encountered:

MartinDelille · 2021-05-09T12:07:48Z

Maybe @ericLemanissier and @Minimonium (after reading #5129) might help on this issue ?

MartinDelille · 2021-05-09T12:13:43Z

I dig into macdeployqt source code and don't understand how it can resolve the bin/archdatadir/plugins path.

Minimonium · 2021-05-09T12:26:08Z

It uses the QLibraryInfo which can be overridden by the qt.conf. Can you verify that there is a correct qt.conf with correct pathes alongside the macdeployqt binary? It should be there for tools to work.

MartinDelille · 2021-05-09T12:52:27Z

Yes I checked and I have the following qt.conf file in /Users/martin/.conan/data/qt/5.15.2/_/_/package/0af6aa42f3ece12447af62252e18e9680ffa1200/bin:

[Paths]
Prefix = ..
ArchData = bin/archdatadir
HostData = bin/archdatadir
Data = bin/datadir
Sysconf = bin/sysconfdir
LibraryExecutables = bin/archdatadir/bin
Plugins = bin/archdatadir/plugins
Imports = bin/archdatadir/imports
Qml2Imports = bin/archdatadir/qml
Translations = bin/datadir/translations
Documentation = bin/datadir/doc
Examples = bin/datadir/examples

MartinDelille · 2021-05-09T12:57:17Z

Shouldn't Prefix be bin/archdatadir then ?

Minimonium · 2021-05-09T13:00:20Z

Ah, I see the issue now. The macdeployqt explicitly assumes that the Plugins value is /plugins, which looks like a bug.

MartinDelille · 2021-05-09T13:03:30Z

Yes. Should we move the plugins folder to the package root ?

Minimonium · 2021-05-09T13:05:43Z

Here:
https://github.com/qt/qttools/blob/5.15.2/src/macdeployqt/shared/shared.cpp#L977

deploymentInfo.qtPath = QLibraryInfo::location(QLibraryInfo::PrefixPath);

And here is the bug:

deploymentInfo.pluginPath = deploymentInfo.qtPath + "/plugins";

It should be

deploymentInfo.pluginPath = QLibraryInfo::location(QLibraryInfo::PluginsPath);

Or something like that. It's rather unfortunate that Qt doesn't do tests.

I'm not sure what was the motivation regarding the subdirectory, probably related to the CCI's convention about top-level directories. Could be either that or patching Qt to do support its own config file.

MartinDelille · 2021-05-09T13:09:59Z

Yes I agree. I will submit the patch for the conan recipe and try to submit it to the upstream repo too.

Thanks for your help!

MartinDelille · 2021-05-09T13:32:02Z

The patch works locally! 🎉

prince-chrismc · 2021-05-09T13:40:10Z

Please link the PR 🙏

* Patch macdeployqt fix #5487 * Update recipes/qt/5.x.x/patches/fix-macdeployqt.diff Co-authored-by: ericLemanissier <ericLemanissier@users.noreply.github.com> * QLibraryInfo::path => location Co-authored-by: ericLemanissier <ericLemanissier@users.noreply.github.com>

* Patch macdeployqt fix conan-io#5487 * Update recipes/qt/5.x.x/patches/fix-macdeployqt.diff Co-authored-by: ericLemanissier <ericLemanissier@users.noreply.github.com> * QLibraryInfo::path => location Co-authored-by: ericLemanissier <ericLemanissier@users.noreply.github.com>

MartinDelille added the bug Something isn't working label May 9, 2021

MartinDelille mentioned this issue May 9, 2021

Add Qt integration to sentry #5440

Merged

4 tasks

MartinDelille added a commit to MartinDelille/conan-center-index that referenced this issue May 9, 2021

Patch macdeployqt fix conan-io#5487

7e599d6

MartinDelille mentioned this issue May 9, 2021

Patch macdeployqt #5488

Merged

4 tasks

ericLemanissier mentioned this issue May 18, 2021

[question] qt macdeployqt can not find any external Qt frameworks #5555

Closed

conan-center-bot closed this as completed in #5488 Jun 1, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[package] qt/5.15.2: Plugins not deployed on MacOS #5487

[package] qt/5.15.2: Plugins not deployed on MacOS #5487

MartinDelille commented May 9, 2021

MartinDelille commented May 9, 2021

MartinDelille commented May 9, 2021

Minimonium commented May 9, 2021

MartinDelille commented May 9, 2021

MartinDelille commented May 9, 2021

Minimonium commented May 9, 2021

MartinDelille commented May 9, 2021

Minimonium commented May 9, 2021 •

edited

Loading

MartinDelille commented May 9, 2021

MartinDelille commented May 9, 2021

prince-chrismc commented May 9, 2021

[package] qt/5.15.2: Plugins not deployed on MacOS #5487

[package] qt/5.15.2: Plugins not deployed on MacOS #5487

Comments

MartinDelille commented May 9, 2021

Package and Environment Details (include every applicable attribute)

Conan profile (output of conan profile show default or conan profile show <profile> if custom profile is in use)

Steps to reproduce (Include if Applicable)

Logs (Include/Attach if Applicable)

MartinDelille commented May 9, 2021

MartinDelille commented May 9, 2021

Minimonium commented May 9, 2021

MartinDelille commented May 9, 2021

MartinDelille commented May 9, 2021

Minimonium commented May 9, 2021

MartinDelille commented May 9, 2021

Minimonium commented May 9, 2021 • edited Loading

MartinDelille commented May 9, 2021

MartinDelille commented May 9, 2021

prince-chrismc commented May 9, 2021

Conan profile (output of `conan profile show default` or `conan profile show <profile>` if custom profile is in use)

Minimonium commented May 9, 2021 •

edited

Loading