fix mac_setup w/ tools+plotjuggler

[tecandrew]

Description: tools/lib/robust_logreader.py would error out when attempting to use URLFile which attempted to reference the wrong curl/openssl backend on macOS. compile flags and curl itself needed to be updated in order to properly use latest pycurl version

Verification: re-ran ./tools/mac_setup.sh and ran ./plotjugger --demo

misc: make setup script look nicer

🎯 #23458

[adeebshihadeh]

Still getting a pycurl error on my M1 MBP

macbookpro:openpilot adeeb$ pipenv shell
Loading .env environment variables...
Launching subshell in virtual environment...
bash-3.2$  . /Users/adeeb/.local/share/virtualenvs/openpilot-3HmyGjEJ/bin/activate
((openpilot) ) bash-3.2$ cd tools/plotjuggler/
((openpilot) ) bash-3.2$ ls
README.md               juggle.py               layouts                 test_plotjuggler.py
((openpilot) ) bash-3.2$ ./juggle.py --install
Traceback (most recent call last):
  File "./juggle.py", line 14, in <module>
    from selfdrive.test.process_replay.compare_logs import save_log
  File "/Users/adeeb/openpilot/selfdrive/test/process_replay/compare_logs.py", line 16, in <module>
    from tools.lib.logreader import LogReader
  File "/Users/adeeb/openpilot/tools/lib/logreader.py", line 8, in <module>
    from tools.lib.filereader import FileReader
  File "/Users/adeeb/openpilot/tools/lib/filereader.py", line 2, in <module>
    from tools.lib.url_file import URLFile
  File "/Users/adeeb/openpilot/tools/lib/url_file.py", line 8, in <module>
    import pycurl
ImportError: pycurl: libcurl link-time version (7.64.1) is older than compile-time version (7.81.0)

[adeebshihadeh]

Still getting a pycurl error on my M1 MBP

macbookpro:openpilot adeeb$ pipenv shell
Loading .env environment variables...
Launching subshell in virtual environment...
bash-3.2$  . /Users/adeeb/.local/share/virtualenvs/openpilot-3HmyGjEJ/bin/activate
((openpilot) ) bash-3.2$ cd tools/plotjuggler/
((openpilot) ) bash-3.2$ ls
README.md               juggle.py               layouts                 test_plotjuggler.py
((openpilot) ) bash-3.2$ ./juggle.py --install
Traceback (most recent call last):
  File "./juggle.py", line 14, in <module>
    from selfdrive.test.process_replay.compare_logs import save_log
  File "/Users/adeeb/openpilot/selfdrive/test/process_replay/compare_logs.py", line 16, in <module>
    from tools.lib.logreader import LogReader
  File "/Users/adeeb/openpilot/tools/lib/logreader.py", line 8, in <module>
    from tools.lib.filereader import FileReader
  File "/Users/adeeb/openpilot/tools/lib/filereader.py", line 2, in <module>
    from tools.lib.url_file import URLFile
  File "/Users/adeeb/openpilot/tools/lib/url_file.py", line 8, in <module>
    import pycurl
ImportError: pycurl: libcurl link-time version (7.64.1) is older than compile-time version (7.81.0)

[tecandrew]

that's weird. just did a fresh pull of OP and full reinstall of brew and encountered no issues. might be that OP is still referencing the xcode sdk version of curl? (outdated from the perspective of the newer pip pycurl).

could I get the output of the following while in pipenv shell?
which -a curl
which -a curl-config
curl-config --version
which -a openssl
python -c "from curl import pycurl; print(pycurl.version);"
locate libcurl | grep dylib

current working config seems to be PycURL/7.44.1 libcurl/7.81.0 (SecureTransport) OpenSSL/1.1.1m zlib/1.2.11 brotli/1.0.9 zstd/1.5.2 libidn2/2.3.2 libssh2/1.10.0 nghttp2/1.46.0 librtmp/2.3 OpenLDAP/2.6.1

[pd0wm]

I had to set export PYCURL_SSL_LIBRARY=openssl before installing pycurl. Does that help in your case?

[tecandrew]

export CURL_SSL_BACKEND=secure-transport

is what I used. another user on #dev-openpilot mentioned this worked

[pd0wm]

Getting a similar error as @adeebshihadeh ImportError: pycurl: libcurl link-time version (7.77.0) is older than compile-time version (7.81.0).

Looks like installation happens against the brew version, but runtime it uses the system one.

[pd0wm]

Using system curl, but openssl from homebrew fixes things for me. Let me know if this causes issues on non-M1 machines.