Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make components cloud agnostic #281

Merged
merged 5 commits into from
Jul 10, 2023
Merged

Conversation

PhilippeMoussalli
Copy link
Contributor

@PhilippeMoussalli PhilippeMoussalli commented Jul 6, 2023

fixes #210

Pyarrow was also removed from many of the components' requirements since it is a Fondant dependency

@PhilippeMoussalli PhilippeMoussalli self-assigned this Jul 6, 2023
@PhilippeMoussalli PhilippeMoussalli added the Components Implementation of components label Jul 6, 2023
@PhilippeMoussalli PhilippeMoussalli added this to the 0.2.0 milestone Jul 6, 2023
@PhilippeMoussalli PhilippeMoussalli changed the title make components cloud agnostic Make components cloud agnostic Jul 6, 2023
@@ -12,7 +12,7 @@ RUN pip3 install --no-cache-dir -r requirements.txt
# Install Fondant
# This is split from other requirements to leverage caching
ARG FONDANT_VERSION=main
RUN pip3 install git+https://github.com/ml6team/fondant@${FONDANT_VERSION}
RUN pip3 install git+https://github.com/ml6team/fondant@${FONDANT_VERSION}#egg=fondant[aws, azure, gcp]
Copy link
Member

@RobbeSneyders RobbeSneyders Jul 10, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @PhilippeMoussalli

In the pip documentation (example 7), they use the following format:

pip install fondant[aws,azure,gcp] @ git+https://github.com/ml6team/fondant@${FONDANT_VERSION}

Which I think is a bit more readable and more future-proof, as eggs have been deprecated as far as I'm aware.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oh good to know. I was not aware. I'll change them

@RobbeSneyders RobbeSneyders merged commit a105281 into main Jul 10, 2023
@RobbeSneyders RobbeSneyders deleted the make-components-cloud-agnostic branch July 10, 2023 09:23
Hakimovich99 pushed a commit that referenced this pull request Oct 16, 2023
fixes #210 

Pyarrow was also removed from many of the components' requirements since
it is a Fondant dependency
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Components Implementation of components
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Make components cloud agnostic
2 participants