-
Notifications
You must be signed in to change notification settings - Fork 14
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Cannot build xeus-python-demo #39
Comments
Thanks @martinRenou I tried adding name: build-env
channels:
- conda-forge
dependencies:
- python
- micromamba
- pip
- jupyter_server
- jupyterlite-core >=0.3.0,<0.4.0
- jupyterlite-xeus>=0.1.2,<0.2 But still no change. Did I interpret jupyterlite/xeus#100 correctly? |
ah you also need to use |
Thanks again @martinRenou. I am still running into the same problem :( Here is the exact procedure followed for my most recent attempt:
Here are the contents of my name: build-env
channels:
- conda-forge
dependencies:
- python
- micromamba
- pip
- jupyter_server
- jupyterlite-core >=0.3.0,<0.4.0
- jupyterlite-xeus==0.2.0a0 And here are the contents of my name: xeus-lite-wasm
channels:
- https://repo.mamba.pm/emscripten-forge
- conda-forge
dependencies:
- xeus-python
- numpy Is anything jumping out at you as blatantly incorrect? Thank you for any time you are able to spend reviewing this. Much appreciated. trace log(jupyterlite) connorferster@pop-os ~/code/jupyterlite-xeus jupyter lite build --XeusAddon.environment=environment.yml [LiteBuildApp] WARNING | Config option `environment` not recognized by `XeusAddon`. Did you mean `environment_file`? static:jupyter-lite.json . pre_status:static:jupyter-lite.json tarball: jupyterlite-app-0.3.0.tgz 13MB output: /home/connorferster/code/jupyterlite-xeus/_output lite dir: /home/connorferster/code/jupyterlite-xeus apps: sourcemaps: True unused packages: True archive:archive contents:contents icons:icons lite:jupyter-lite.json mimetypes:jupyter-lite.json serve:contents settings:overrides translation:translation . status:archive:archive [LiteBuildApp] No archive (yet): jupyterlite-xeus-jupyterlite.tgz . status:contents:contents contents: 0 files . status:icons:icons favicon files: 0 files . status:lite:jupyter-lite.json [LiteBuildApp] jupyter-lite.(json|ipynb): 0 files . status:mimetypes:jupyter-lite.json filetypes: 26 . status:serve:contents url: http://127.0.0.1:8000/ server: stdlib headers: . status:settings:overrides overrides.json: 0 . status:translation:translation translation files: 0 files static:output_dir -- pre_init:static:output_dir static:unpack . init:static:unpack /home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_core/addons/base.py:294: UserWarning: install libarchive-c for better performance when working with archives: No module named 'libarchive' return has_optional_dependency( federated_extensions:copy:ext:@jupyterlite/xeus . pre_build:federated_extensions:copy:ext:@jupyterlite/xeus /home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_core/addons/icons.py:43: UserWarning: [lite] [icons] install `jupyter_server` to copy notebook favicons: No module named 'jupyter_server' if not self.is_sys_prefix_ignored() and has_optional_dependency( /home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_core/addons/translation.py:88: UserWarning: [lite] [translation] install `jupyterlab_server` to load translations: No module named 'jupyterlab_server' if not self.is_sys_prefix_ignored() and has_optional_dependency( translation:copy . build:translation:copy federated_extensions:patch federated_extensions:settings
Package Version Build Channel Size
Summary: Install: 29 packages Total download: 33MB ────────────────────────────────────────────────────────────────────────────────────────────────── six 14.3kB @ 42.8kB/s 0.3s >>>>>>>>>>>>>>>>>>>>>> ERROR REPORT <<<<<<<<<<<<<<<<<<<<<<
environment variables:
populated config files : /home/connorferster/miniforge3/.condarc An unexpected error has occurred. Conda has prepared the above report. Example: conda --no-plugins install Alternatively, you can set the CONDA_NO_PLUGINS environment variable on Example: CONDA_NO_PLUGINS=true conda install [LiteBuildApp] ERROR | [lite] [post_build] [jupyterlite-xeus] [ERR] Command '['/home/connorferster/miniforge3/condabin/mamba', 'install', '--yes', '--prefix', PosixPath('/tmp/tmpey81lpqk/env/envs/xeus-lite-wasm'), '-c', 'https://repo.mamba.pm/emscripten-forge', '-c', 'conda-forge', 'xeus-python', 'numpy']' returned non-zero exit status 1. |
Not sure the - pip:
- jupyterlite-xeus==0.2.0a0 |
FYI @connorferster this seems to be doing the trick: #40 Even with
|
Thank you @jtpio and @martinRenou, I really appreciate your assistance. The issue is conda. Even though I am including Solution:
When I completely omit conda from the process then everything goes smoothly (as advertised). However, because I would prefer to use conda in my local environment, it seems I will have run the build process on a separate server (GitHub Actions, or otherwise) as you have demonstrated. I have raised this issue on the conda repo but have heard nothing back. So, if anyone is encountering this same issue and reading this, then you will need to create a computing environment where conda is completely absent in order to make the build work. |
Also, I just want to say: Jupyterlite, especially with the xeus kernel, is a game-changer for folks who cannot install Python on their work computers for various reasons. Thank you all so much for this incredible effort. I will be deploying a Jupyterlite site for people in my industry and I expect it to be popular. Thank you thank you thank you! |
Thanks @connorferster!
Which issue is it? There is also conda/conda#13962 which would likely fix this. |
I got hit by the same problem. I confirm that upgrading to conda 2.7.1 which contains conda/conda#13962 resolved the issue!
Now we just have to wait for that version of conda to spread, including in miniconda/... distributions. |
@connorferster would you be able to try with the latest version of the template to see if #40 fixes the issue? |
Description
I am trying to build the xeus-python-demo locally but I am getting this strange error (extracted from much larger traceback, included below).
I tried building it last night with the same result. And, after I hit this error, whenever I ran other commands in conda, e.g.
conda create -n myenvname python=3.12
, the commands would not run and I would get the same error! (Weird, yeah?)Because it seemed like my miniconda3 installation was now broken, I completely removed conda (and all of my many environments), and re-installed conda anew from miniforge3 (which I had been meaning to do that anyway).
I just tried cloning the repo again fresh and installing it locally into a fresh conda environment. As before, the kernel did not install after running
jupyter lite build
. So I executedconda install xeus-python
to install the xeus kernel into my conda environment. When I then ranjupyter lite build
again, a completely different series of screens flashed by and then I got the same error as shown above (full stack trace below).Get this! Now, again, my conda installation seems to be broken because I can no longer run
conda create -n myenvname python=3.12
without it ending in the same error.The conda-breaking part of this is probably an upstream issue as well but I could really use some guidance on what is happening here. How can I fix this? Are there any build steps I am missing?
Reproduce
conda create -n jupyterlite python=3.12
conda activate jupyterlite
git clone https://github.com/jupyterlite/xeus-python-demo.git
cd xeus-python-demo
conda install jupyterlite-core
jupyter lite build
-> Successfully builds Jupyterlite but without kernelsconda install xeus-python
jupyter lite build
CRASH
(See traceback below)
Expected behavior
Jupyterlite builds with xeus-python kernel and I am enjoying an excellent piece of new technology running in my browser! (Wow)
Context
0.3.0
Traceback
Package Version Build Channel Size
──────────────────────────────────────────────────────────────────────────────────────────────────
Install:
──────────────────────────────────────────────────────────────────────────────────────────────────
Summary:
Install: 36 packages
Total download: 33MB
──────────────────────────────────────────────────────────────────────────────────────────────────
backcall 13.7kB @ 169.7kB/s 0.1s
widgetsnbextension 1.1MB @ 5.1MB/s 0.1s
emscripten-abi 10.9kB @ 7.2kB/s 1.5s
forallpeople 35.9kB @ 21.5kB/s 0.2s
pyjs 4.0MB @ 1.3MB/s 3.1s
jupyterlab_widgets 186.5kB @ 56.9kB/s 0.1s
ipycanvas 57.1kB @ 17.1kB/s 0.1s
xeus-python-shell 6.7kB @ 2.0kB/s 0.1s
numpy 7.5MB @ 1.9MB/s 3.7s
xeus-python-shell-raw 11.7kB @ 3.0kB/s 0.1s
ipywidgets 113.8kB @ 28.4kB/s 0.1s
pillow 1.1MB @ 242.3kB/s 4.7s
python 13.2MB @ 2.5MB/s 5.3s
ipython 1.6MB @ 292.3kB/s 2.1s
xeus-python 3.8MB @ 319.8kB/s 10.3s
'emscripten' is not a valid Platform
>>>>>>>>>>>>>>>>>>>>>> ERROR REPORT <<<<<<<<<<<<<<<<<<<<<<
$ /home/connorferster/miniforge3/condabin/mamba install --yes --prefix /tmp/tmpwsk5p5rz/env/envs/xeus-python-kernel -c https://repo.mamba.pm/emscripten-forge -c conda-forge xeus-python forallpeople ipycanvas
environment variables:
CIO_TEST=
CONDARC=/tmp/tmpwsk5p5rz/env/envs/xeus-python-kernel/.condarc
CONDA_DEFAULT_ENV=jupyterlite
CONDA_EXE=/home/connorferster/miniforge3/bin/conda
CONDA_PREFIX=/home/connorferster/miniforge3/envs/jupyterlite
CONDA_PREFIX_1=/home/connorferster/miniforge3
CONDA_PROMPT_MODIFIER=(jupyterlite)
CONDA_PYTHON_EXE=/home/connorferster/miniforge3/bin/python
CONDA_ROOT=/home/connorferster/miniforge3
CONDA_SHLVL=2
CURL_CA_BUNDLE=
DEFAULTS_PATH=/usr/share/gconf/pop.default.path
LD_PRELOAD=
MANDATORY_PATH=/usr/share/gconf/pop.mandatory.path
PATH=/home/connorferster/miniforge3/envs/jupyterlite/bin:/home/connorferste
r/miniforge3/condabin:/home/connorferster/.nvm/versions/node/v22.2.0/b
in:/home/connorferster/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/
sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/lo
cal/go/bin:/home/connorferster/.repobee/bin:/opt/ParaView-
5.11/bin:/usr/local/go/bin
REQUESTS_CA_BUNDLE=
SSL_CERT_FILE=
WINDOWPATH=2
populated config files : /home/connorferster/miniforge3/.condarc
/tmp/tmpwsk5p5rz/env/envs/xeus-python-kernel/.condarc
conda version : 24.3.0
conda-build version : not installed
python version : 3.10.14.final.0
solver : libmamba (default)
virtual packages : __conda=24.3.0=0
base environment : /home/connorferster/miniforge3 (writable)
conda av data dir : /home/connorferster/miniforge3/etc/conda
conda av metadata url : None
channel URLs : https://repo.mamba.pm/emscripten-forge/emscripten-wasm32
https://repo.mamba.pm/emscripten-forge/noarch
https://conda.anaconda.org/conda-forge/emscripten-wasm32
https://conda.anaconda.org/conda-forge/noarch
package cache : /home/connorferster/miniforge3/pkgs
/home/connorferster/.conda/pkgs
envs directories : /home/connorferster/miniforge3/envs
/home/connorferster/.conda/envs
platform : emscripten-wasm32
user-agent : conda/24.3.0 requests/2.31.0 CPython/3.10.14 Linux/6.4.6-76060406-generic pop/22.04 glibc/2.35 solver/libmamba conda-libmamba-solver/24.1.0 libmambapy/1.5.8
UID:GID : 1000:1000
netrc file : /home/connorferster/.netrc
offline mode : False
An unexpected error has occurred. Conda has prepared the above report.
If you suspect this error is being caused by a malfunctioning plugin,
consider using the --no-plugins option to turn off plugins.
Example: conda --no-plugins install
Alternatively, you can set the CONDA_NO_PLUGINS environment variable on
the command line to run the command without plugins enabled.
Example: CONDA_NO_PLUGINS=true conda install
[LiteBuildApp] ERROR | [lite] [post_build] [jupyterlite-xeus] [ERR] Command '['/home/connorferster/miniforge3/condabin/mamba', 'install', '--yes', '--prefix', PosixPath('/tmp/tmpwsk5p5rz/env/envs/xeus-python-kernel'), '-c', 'https://repo.mamba.pm/emscripten-forge', '-c', 'conda-forge', 'xeus-python', 'forallpeople', 'ipycanvas']' returned non-zero exit status 1.
Traceback (most recent call last):
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/doit_cmd.py", line 294, in run
return command.parse_execute(args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/cmd_base.py", line 150, in parse_execute
return self.execute(params, args)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/cmd_base.py", line 570, in execute
return self._execute(**exec_params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/cmd_run.py", line 265, in _execute
return runner.run_all(self.control.task_dispatcher())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/runner.py", line 254, in run_all
self.run_tasks(task_dispatcher)
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/runner.py", line 213, in run_tasks
node = task_dispatcher.generator.send(node)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/control.py", line 629, in _dispatcher_generator
next_step = node.step()
^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/control.py", line 336, in step
return next(self.generator)
^^^^^^^^^^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/control.py", line 345, in _func
for value in decorated(*args, **kwargs):
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/control.py", line 473, in _add_task
new_tasks = generate_tasks(to_load, task_gen, ref.doc)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/loader.py", line 390, in generate_tasks
for task_dict, x_doc in flat_generator(gen_result, gen_doc):
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/loader.py", line 27, in flat_generator
for item in gen:
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_core/manager.py", line 138, in _delayed_gather
yield from _gather()
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_core/manager.py", line 131, in _gather
raise error
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_core/manager.py", line 123, in _gather
for task in getattr(addon, attr)(self):
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_xeus/add_on.py", line 124, in post_build
self.create_prefix()
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_xeus/add_on.py", line 148, in create_prefix
create_conda_env_from_env_file(root_prefix, yaml_content, env_file.parent)
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_xeus/create_conda_env.py", line 53, in create_conda_env_from_env_file
create_conda_env_from_specs(
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_xeus/create_conda_env.py", line 69, in create_conda_env_from_specs
_create_conda_env_from_specs_impl(
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_xeus/create_conda_env.py", line 126, in _create_conda_env_from_specs_impl
return _create_env_with_config(MAMBA_COMMAND, prefix_path, specs, channels_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_xeus/create_conda_env.py", line 144, in _create_env_with_config
subprocess_run(
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/home/connorferster/miniforge3/condabin/mamba', 'install', '--yes', '--prefix', PosixPath('/tmp/tmpwsk5p5rz/env/envs/xeus-python-kernel'), '-c', 'https://repo.mamba.pm/emscripten-forge', '-c', 'conda-forge', 'xeus-python', 'forallpeople', 'ipycanvas']' returned non-zero exit status 1.
The text was updated successfully, but these errors were encountered: