Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Adding docker containers in Gensim. Fix #497 #1121

Closed
wants to merge 17 commits into from
Closed

[WIP] Adding docker containers in Gensim. Fix #497 #1121

wants to merge 17 commits into from

Conversation

danielbdias
Copy link

I am adding a docker image to run gensim tutorials.

In this PR I created a Dockerfile with Ubuntu 16.04, Python 3 and gensim dependencies and a docker-compose.yml to run the jupyter notebooks.

@tmylk tmylk changed the title Adding docker containers in Gensim Adding docker containers in Gensim. Fix #497 Jan 29, 2017
@tmylk tmylk changed the title Adding docker containers in Gensim. Fix #497 [WIP] Adding docker containers in Gensim. Fix #497 Jan 31, 2017
@tmylk
Copy link
Contributor

tmylk commented Jan 31, 2017

Thanks for the contribution.
Remaining steps:

  • docker hub upload
  • transfer credentials for docker hub container

@danielbdias
Copy link
Author

Hi guys !

I updated the PR with the check in the FAST_VERSION and a README.md to pull this image in docker hub.

Now I need to fix some problems when we are pushing this image directly from docker hub. (Running the image gives a container_linux.go:247: starting container process caused "exec: \"-p\": executable file not found in $PATH" error)

After that, we need to create an official image we will need to create a PR to https://github.com/docker-library/official-images and https://github.com/docker-library/docs

@danielbdias
Copy link
Author

danielbdias commented Feb 4, 2017

Another update: I fixed the problem with docker hub, but now we need to refer to a fixed version of gensim.

For now I created an image called danielbdias/gensim in docker hub to test the environment.

Can you check if all the setup in the Dockerfile is ok? With docker file ok, I will start to apply the missing guidelines to start the PR in docker-library/official-images and build the official container.

@canktech
Copy link

consider including binaries for wordrank and fasttext

@tmylk
Copy link
Contributor

tmylk commented Feb 20, 2017

And varembed, mallet, dtm

@danielbdias
Copy link
Author

Hi guys,

I've found the installation commands for mallet and fasttext (through pip). How can I install the other packages (wordrank, varembed and dtm)?

@tmylk
Copy link
Contributor

tmylk commented Feb 21, 2017

@tmylk
Copy link
Contributor

tmylk commented Feb 21, 2017

Mallet is actually a java package so it can't be installed through pip
http://mallet.cs.umass.edu/

@danielbdias
Copy link
Author

Hi guys !

Giving some updates on this issue after a while: I've updated the dockerfile to support WordRank, MorphologicalPriorsForWordEmbeddings, DTM and Mallet.

Is there a issue yet with the FAST_VERSION... some dependency broke the version.

Fixing this problem, I'll be able to upload a version to docker hub and create a gensim user there.

Thanks !

@tmylk
Copy link
Contributor

tmylk commented May 2, 2017

Thanks @danielbdias What is the exact error with FAST_VERSION? Does the new version of the C compiler not work?

@tmylk
Copy link
Contributor

tmylk commented May 12, 2017

This docker will be really useful for testing the wrappers during releases.

@danielbdias
Copy link
Author

Hi @tmylk ! I'm receiving FAST_VERSION = -5 when I'm building the docker. I think that the reason is the dependencies that I installed for WordRank, MorphologicalPriorsForWordEmbeddings.

I will check this weekend on a way to solve this.

@menshikh-iv
Copy link
Contributor

It's a nice PR, I would like use this for full test run (with all wrappers)

@tmylk
Copy link
Contributor

tmylk commented May 15, 2017

This container will be part of our release infrastructure as we need to run all the wrapper tests every release and they are not part of the usual Github commit CI run.

@menshikh-iv
Copy link
Contributor

Continues in #1368

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants