zstd not found by superset_node during docker compose up dev mode

[MialLewis]

Bug description

When running webpack I get the following error on master:

superset_node         | [webpack-cli] Failed to load '/app/superset-frontend/webpack.config.js' config
superset_node         | [webpack-cli] Error: Can not access zstd! Is it installed?

Related conversation in PR, where I mention a hacky solution: #30034 (comment)

Raising this to increase visibility in case anyone else encounters.

How to reproduce the bug

docker compose up on master branch.

Screenshots/recordings

No response

Superset version

master / latest-dev

Python version

3.9

Node version

16

Browser

Chrome

Additional context

No response

Checklist

• I have searched Superset docs and Slack and didn't find a solution to my problem.
• I have searched the GitHub issue tracker and didn't find a similar bug report.
• I have checked Superset's logs for errors and if I found a relevant Python stacktrace, I included it here as text in the "additional context" section.

[dosubot]

I found a similar closed issue, docker build failed, which was last updated on December 21, 2022. The suggested solution was to ensure that the zstd package is installed in the Dockerfile. Here’s how you can resolve the "zstd not found" error:

1. Ensure zstd is installed in the Dockerfile:
   The Dockerfile should include the installation of zstd:

   # Somehow we need python3 + build-essential on this side of the house to install node-gyp
   RUN apt-get update -qq \
       && apt-get install \
           -yqq --no-install-recommends \
           build-essential \
           python3 \
           zstd

2. Rebuild the Docker image without using the cache:
   If you are still encountering the error, it might be due to a caching issue or an incomplete build. Try rebuilding the Docker image without using the cache:

   docker compose build --no-cache
   docker compose up

3. Ensure simple-zstd is included in package.json:
   Make sure that the simple-zstd package is included in your package.json and properly installed, as it is required by webpack.proxy-config.js for handling zstd compression:

   "dependencies": {
     "simple-zstd": "^1.0.0"
   }

   Run the following command to install the necessary npm packages:

   npm install

This should help resolve the error you are encountering ^[1][2].

To continue talking to Dosu, mention @dosu.

[birkskyum]

I hit this error too, on macos arm64 .

superset_node         | > webpack --mode=development --color --watch
superset_node         | 
superset_node         | [webpack-cli] Failed to load '/app/superset-frontend/webpack.config.js' config
superset_node         | [webpack-cli] Error: Can not access zstd! Is it installed?

[victorfonseca]

Same here, anyone found how to workaround this issue?

[MialLewis]

Same here, anyone found how to workaround this issue?

If you read the PR linked in the description there’s a hacky solution to get things moving.

[riekusr]

some issue here on ubuntu