Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[KED-1456] Provide docker container for kedro developer environment #268

Closed
wants to merge 5 commits into from
Closed

[KED-1456] Provide docker container for kedro developer environment #268

wants to merge 5 commits into from

Conversation

neomatrix369
Copy link
Contributor

Description

Related to the issue #265 - given everyone has disparate python environments on our own favourite platforms, everything works fine till we introduce a new project, that's where docker can come in to rescue us!

Development notes

Added two shell scripts and Dockerfile, no code changes made - isolated from the code base logic as such.

Adds to the setup and infra aspects of the project so developers can quickly get onboard with the project and not have to tackle development environment issues.

Pre-requisite:

  • require Docker installed,
  • internet (to build the image, one off)
  • enough storage space for the creation of a new docker image

Checklist

  • Read the contributing guidelines
  • Opened this PR as a 'Draft Pull Request' if it is work-in-progress
  • Updated the documentation to reflect the code changes
  • Added a description of this change and added my name to the list of supporting contributions in the RELEASE.md file
  • Added tests to cover my changes

Notice

  • I acknowledge and agree that, by checking this box and clicking "Submit Pull Request":

  • I submit this contribution under the Apache 2.0 license and represent that I am entitled to do so on behalf of myself, my employer, or relevant third parties, as applicable.

  • I certify that (a) this contribution is my original creation and / or (b) to the extent it is not my original creation, I am authorised to submit this contribution on behalf of the original creator(s) or their licensees.

  • I certify that the use of this contribution as authorised by the Apache 2.0 license does not violate the intellectual property rights of anyone else.

@neomatrix369 neomatrix369 force-pushed the provide-docker-container-for-kedro branch from d553b7d to 4e927cd Compare February 28, 2020 15:45
@neomatrix369
Copy link
Contributor Author

Please let me know what doc files you would like me to amend, in addition to the ones I have amended in this PR - in order to make sure users know they can run the shell scripts to build and run the docker container.

@neomatrix369
Copy link
Contributor Author

I'm also happy and open to feedback on how you think the end-users should use these scripts - atm it's simple and basic, which I think should be a good start and we can build on top of it.

@neomatrix369 neomatrix369 force-pushed the provide-docker-container-for-kedro branch 2 times, most recently from 7d31289 to dbc9ce1 Compare February 28, 2020 16:05
neomatrix369 added a commit to neomatrix369/kedro that referenced this pull request Feb 28, 2020
@neomatrix369
Docs: corrected previous release notes entry (via PR kedro-org#266, r…
2c90807 
…elated to issue kedro-org#256. Added new release notes entry for PR kedro-org#268, related to issue kedro-org#265
neomatrix369 added a commit to neomatrix369/kedro that referenced this pull request Feb 28, 2020
@neomatrix369
Docs: corrected previous release notes entry (via PR kedro-org#266, r…
14ba923 
…elated to issue kedro-org#256. Added new release notes entry for PR kedro-org#268, related to issue kedro-org#265

[skip ci]
@neomatrix369 neomatrix369 force-pushed the provide-docker-container-for-kedro branch from 2c90807 to 14ba923 Compare February 28, 2020 16:23
@neomatrix369 neomatrix369 mentioned this pull request Mar 2, 2020
Closed
neomatrix369 added a commit to neomatrix369/kedro that referenced this pull request Mar 2, 2020
@neomatrix369
Docs: corrected previous release notes entry (via PR kedro-org#266, r…
acd51fc 
…elated to issue kedro-org#256. Added new release notes entry for PR kedro-org#268, related to issue kedro-org#265

[skip ci]
@neomatrix369 neomatrix369 force-pushed the provide-docker-container-for-kedro branch from 4d6ccb4 to acd51fc Compare March 2, 2020 15:51
neomatrix369 added a commit to neomatrix369/kedro that referenced this pull request Mar 9, 2020
@neomatrix369
Docs: corrected previous release notes entry (via PR kedro-org#266, r…
123c4b5 
…elated to issue kedro-org#256. Added new release notes entry for PR kedro-org#268, related to issue kedro-org#265

[skip ci]
@neomatrix369 neomatrix369 force-pushed the provide-docker-container-for-kedro branch from acd51fc to 123c4b5 Compare March 9, 2020 11:16
@neomatrix369
Copy link
Contributor Author

Happy to discuss this further, if any doubts or suggestions.
(conflicts occurring on this PR is due to PR #270)

neomatrix369 added a commit to neomatrix369/kedro that referenced this pull request Mar 10, 2020
@neomatrix369
Docs: corrected previous release notes entry (via PR kedro-org#266, r…
e85a46b 
…elated to issue kedro-org#256. Added new release notes entry for PR kedro-org#268, related to issue kedro-org#265

[skip ci]
@neomatrix369 neomatrix369 force-pushed the provide-docker-container-for-kedro branch from 123c4b5 to e85a46b Compare March 10, 2020 16:26
@neomatrix369 neomatrix369 mentioned this pull request Mar 12, 2020
Closed
@neomatrix369
Docker: adding Dockerfile and supporting shell scripts i.e. build ima…
be1fadd 
…ge and run container scripts
@neomatrix369
Docker: give meaningful names to the shells scripts. Related to issue k…
12989dd 
…edro-org#265
@neomatrix369
Docker: adding the missing Dockerfile, also making it possible to bui…
e63b750 
…ld the image and run the container via ./docs/build-docs.sh

Obtaining file:///Users/swami/git-repos/hands-on-workshops/kedro/kedro
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Requirement already satisfied: anyconfig<1.0,>=0.9.7 in /Users/swami/.local/lib/python3.7/site-packages (from kedro==0.15.7) (0.9.10)
Requirement already satisfied: xlrd<2.0,>=1.0.0 in /anaconda3/lib/python3.7/site-packages (from kedro==0.15.7) (1.2.0)
Requirement already satisfied: fsspec<1.0,>=0.5.1 in /Users/swami/.local/lib/python3.7/site-packages (from kedro==0.15.7) (0.6.2)
Requirement already satisfied: PyYAML<6.0,>=4.2 in /Users/swami/.local/lib/python3.7/site-packages (from kedro==0.15.7) (5.3)
Requirement already satisfied: s3fs<1.0,>=0.3.0 in /Users/swami/.local/lib/python3.7/site-packages (from kedro==0.15.7) (0.4.0)
Requirement already satisfied: tables<3.6,>=3.4.4 in /anaconda3/lib/python3.7/site-packages (from kedro==0.15.7) (3.4.4)
Requirement already satisfied: pandas<1.0,>=0.24.0 in /Users/swami/.local/lib/python3.7/site-packages (from kedro==0.15.7) (0.25.3)
Requirement already satisfied: cookiecutter<2.0,>=1.6.0 in /Users/swami/.local/lib/python3.7/site-packages (from kedro==0.15.7) (1.7.0)
Requirement already satisfied: pip-tools<5.0.0,>=4.0.0 in /Users/swami/.local/lib/python3.7/site-packages (from kedro==0.15.7) (4.5.0)
Requirement already satisfied: click<8.0 in /anaconda3/lib/python3.7/site-packages (from kedro==0.15.7) (7.0)
Requirement already satisfied: xlsxwriter<2.0,>=1.0.0 in /anaconda3/lib/python3.7/site-packages (from kedro==0.15.7) (1.1.5)
Requirement already satisfied: SQLAlchemy<2.0,>=1.2.0 in /anaconda3/lib/python3.7/site-packages (from kedro==0.15.7) (1.2.18)
Requirement already satisfied: toposort<2.0,>=1.5 in /Users/swami/.local/lib/python3.7/site-packages (from kedro==0.15.7) (1.5)
Requirement already satisfied: pyarrow<1.0.0,>=0.12.0 in /Users/swami/.local/lib/python3.7/site-packages (from kedro==0.15.7) (0.16.0)
Requirement already satisfied: requests<3.0,>=2.20.0 in /Users/swami/.local/lib/python3.7/site-packages (from kedro==0.15.7) (2.20.0)
Requirement already satisfied: python-json-logger<1.0,>=0.1.9 in /Users/swami/.local/lib/python3.7/site-packages (from kedro==0.15.7) (0.1.11)
Requirement already satisfied: nbstripout==0.3.3; extra == "docs" in /anaconda3/lib/python3.7/site-packages (from kedro==0.15.7) (0.3.3)
Requirement already satisfied: ipykernel<5.0,>=4.8.1; extra == "docs" in /anaconda3/lib/python3.7/site-packages (from kedro==0.15.7) (4.10.1)
Requirement already satisfied: jupyter-client<6.0,>=5.1.0; extra == "docs" in /Users/swami/.local/lib/python3.7/site-packages (from kedro==0.15.7) (5.3.4)
Requirement already satisfied: sphinx<2.0,>=1.8.4; extra == "docs" in /anaconda3/lib/python3.7/site-packages (from kedro==0.15.7) (1.8.5)
Requirement already satisfied: sphinx-rtd-theme==0.4.3; extra == "docs" in /anaconda3/lib/python3.7/site-packages (from kedro==0.15.7) (0.4.3)
Requirement already satisfied: sphinx-autodoc-typehints==1.6.0; extra == "docs" in /anaconda3/lib/python3.7/site-packages (from kedro==0.15.7) (1.6.0)
Requirement already satisfied: recommonmark==0.5.0; extra == "docs" in /anaconda3/lib/python3.7/site-packages (from kedro==0.15.7) (0.5.0)
Requirement already satisfied: sphinx-copybutton==0.2.5; extra == "docs" in /anaconda3/lib/python3.7/site-packages (from kedro==0.15.7) (0.2.5)
Requirement already satisfied: nbsphinx==0.4.2; extra == "docs" in /anaconda3/lib/python3.7/site-packages (from kedro==0.15.7) (0.4.2)
Requirement already satisfied: tornado<6.0,>=4.2; extra == "docs" in /anaconda3/lib/python3.7/site-packages (from kedro==0.15.7) (5.1.1)
Requirement already satisfied: setuptools in /anaconda3/lib/python3.7/site-packages (from anyconfig<1.0,>=0.9.7->kedro==0.15.7) (40.8.0)
Requirement already satisfied: botocore>=1.12.91 in /anaconda3/lib/python3.7/site-packages (from s3fs<1.0,>=0.3.0->kedro==0.15.7) (1.12.108)
Requirement already satisfied: boto3>=1.9.91 in /anaconda3/lib/python3.7/site-packages (from s3fs<1.0,>=0.3.0->kedro==0.15.7) (1.9.108)
Requirement already satisfied: numpy>=1.8.0 in /anaconda3/lib/python3.7/site-packages (from tables<3.6,>=3.4.4->kedro==0.15.7) (1.16.2)
Requirement already satisfied: numexpr>=2.5.2 in /anaconda3/lib/python3.7/site-packages (from tables<3.6,>=3.4.4->kedro==0.15.7) (2.6.9)
Requirement already satisfied: six>=1.9.0 in /Users/swami/.local/lib/python3.7/site-packages (from tables<3.6,>=3.4.4->kedro==0.15.7) (1.11.0)
Requirement already satisfied: python-dateutil>=2.6.1 in /Users/swami/.local/lib/python3.7/site-packages (from pandas<1.0,>=0.24.0->kedro==0.15.7) (2.8.0)
Requirement already satisfied: pytz>=2017.2 in /anaconda3/lib/python3.7/site-packages (from pandas<1.0,>=0.24.0->kedro==0.15.7) (2018.9)
Requirement already satisfied: jinja2>=2.7 in /anaconda3/lib/python3.7/site-packages (from cookiecutter<2.0,>=1.6.0->kedro==0.15.7) (2.10)
Requirement already satisfied: binaryornot>=0.2.0 in /Users/swami/.local/lib/python3.7/site-packages (from cookiecutter<2.0,>=1.6.0->kedro==0.15.7) (0.4.4)
Requirement already satisfied: jinja2-time>=0.1.0 in /Users/swami/.local/lib/python3.7/site-packages (from cookiecutter<2.0,>=1.6.0->kedro==0.15.7) (0.2.0)
Requirement already satisfied: whichcraft>=0.4.0 in /Users/swami/.local/lib/python3.7/site-packages (from cookiecutter<2.0,>=1.6.0->kedro==0.15.7) (0.6.1)
Requirement already satisfied: poyo>=0.1.0 in /Users/swami/.local/lib/python3.7/site-packages (from cookiecutter<2.0,>=1.6.0->kedro==0.15.7) (0.5.0)
Requirement already satisfied: future>=0.15.2 in /anaconda3/lib/python3.7/site-packages (from cookiecutter<2.0,>=1.6.0->kedro==0.15.7) (0.17.1)
Requirement already satisfied: urllib3<1.25,>=1.21.1 in /Users/swami/.local/lib/python3.7/site-packages (from requests<3.0,>=2.20.0->kedro==0.15.7) (1.24.2)
Requirement already satisfied: idna<2.8,>=2.5 in /Users/swami/.local/lib/python3.7/site-packages (from requests<3.0,>=2.20.0->kedro==0.15.7) (2.7)
Requirement already satisfied: certifi>=2017.4.17 in /Users/swami/.local/lib/python3.7/site-packages (from requests<3.0,>=2.20.0->kedro==0.15.7) (2018.10.15)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /anaconda3/lib/python3.7/site-packages (from requests<3.0,>=2.20.0->kedro==0.15.7) (3.0.4)
Requirement already satisfied: nbformat in /anaconda3/lib/python3.7/site-packages (from nbstripout==0.3.3; extra == "docs"->kedro==0.15.7) (4.4.0)
Requirement already satisfied: ipython>=4.0.0 in /Users/swami/.local/lib/python3.7/site-packages (from ipykernel<5.0,>=4.8.1; extra == "docs"->kedro==0.15.7) (7.12.0)
Requirement already satisfied: traitlets>=4.1.0 in /anaconda3/lib/python3.7/site-packages (from ipykernel<5.0,>=4.8.1; extra == "docs"->kedro==0.15.7) (4.3.2)
Requirement already satisfied: pyzmq>=13 in /anaconda3/lib/python3.7/site-packages (from jupyter-client<6.0,>=5.1.0; extra == "docs"->kedro==0.15.7) (17.1.2)
Requirement already satisfied: jupyter-core>=4.6.0 in /Users/swami/.local/lib/python3.7/site-packages (from jupyter-client<6.0,>=5.1.0; extra == "docs"->kedro==0.15.7) (4.6.1)
Requirement already satisfied: imagesize in /anaconda3/lib/python3.7/site-packages (from sphinx<2.0,>=1.8.4; extra == "docs"->kedro==0.15.7) (1.1.0)
Requirement already satisfied: packaging in /anaconda3/lib/python3.7/site-packages (from sphinx<2.0,>=1.8.4; extra == "docs"->kedro==0.15.7) (19.0)
Requirement already satisfied: snowballstemmer>=1.1 in /anaconda3/lib/python3.7/site-packages (from sphinx<2.0,>=1.8.4; extra == "docs"->kedro==0.15.7) (1.2.1)
Requirement already satisfied: sphinxcontrib-websupport in /anaconda3/lib/python3.7/site-packages (from sphinx<2.0,>=1.8.4; extra == "docs"->kedro==0.15.7) (1.1.0)
Requirement already satisfied: Pygments>=2.0 in /anaconda3/lib/python3.7/site-packages (from sphinx<2.0,>=1.8.4; extra == "docs"->kedro==0.15.7) (2.3.1)
Requirement already satisfied: docutils>=0.11 in /anaconda3/lib/python3.7/site-packages (from sphinx<2.0,>=1.8.4; extra == "docs"->kedro==0.15.7) (0.14)
Requirement already satisfied: alabaster<0.8,>=0.7 in /anaconda3/lib/python3.7/site-packages (from sphinx<2.0,>=1.8.4; extra == "docs"->kedro==0.15.7) (0.7.12)
Requirement already satisfied: babel!=2.0,>=1.3 in /anaconda3/lib/python3.7/site-packages (from sphinx<2.0,>=1.8.4; extra == "docs"->kedro==0.15.7) (2.6.0)
Requirement already satisfied: commonmark>=0.7.3 in /anaconda3/lib/python3.7/site-packages (from recommonmark==0.5.0; extra == "docs"->kedro==0.15.7) (0.9.1)
Requirement already satisfied: nbconvert!=5.4 in /anaconda3/lib/python3.7/site-packages (from nbsphinx==0.4.2; extra == "docs"->kedro==0.15.7) (5.4.1)
Requirement already satisfied: jmespath<1.0.0,>=0.7.1 in /anaconda3/lib/python3.7/site-packages (from botocore>=1.12.91->s3fs<1.0,>=0.3.0->kedro==0.15.7) (0.9.4)
Requirement already satisfied: s3transfer<0.3.0,>=0.2.0 in /anaconda3/lib/python3.7/site-packages (from boto3>=1.9.91->s3fs<1.0,>=0.3.0->kedro==0.15.7) (0.2.0)
Requirement already satisfied: MarkupSafe>=0.23 in /anaconda3/lib/python3.7/site-packages (from jinja2>=2.7->cookiecutter<2.0,>=1.6.0->kedro==0.15.7) (1.1.1)
Requirement already satisfied: arrow in /Users/swami/.local/lib/python3.7/site-packages (from jinja2-time>=0.1.0->cookiecutter<2.0,>=1.6.0->kedro==0.15.7) (0.15.5)
Requirement already satisfied: ipython-genutils in /anaconda3/lib/python3.7/site-packages (from nbformat->nbstripout==0.3.3; extra == "docs"->kedro==0.15.7) (0.2.0)
Requirement already satisfied: jsonschema!=2.5.0,>=2.4 in /anaconda3/lib/python3.7/site-packages (from nbformat->nbstripout==0.3.3; extra == "docs"->kedro==0.15.7) (2.6.0)
Requirement already satisfied: pexpect; sys_platform != "win32" in /anaconda3/lib/python3.7/site-packages (from ipython>=4.0.0->ipykernel<5.0,>=4.8.1; extra == "docs"->kedro==0.15.7) (4.6.0)
Requirement already satisfied: backcall in /anaconda3/lib/python3.7/site-packages (from ipython>=4.0.0->ipykernel<5.0,>=4.8.1; extra == "docs"->kedro==0.15.7) (0.1.0)
Requirement already satisfied: decorator in /anaconda3/lib/python3.7/site-packages (from ipython>=4.0.0->ipykernel<5.0,>=4.8.1; extra == "docs"->kedro==0.15.7) (4.3.2)
Requirement already satisfied: prompt-toolkit!=3.0.0,!=3.0.1,<3.1.0,>=2.0.0 in /Users/swami/.local/lib/python3.7/site-packages (from ipython>=4.0.0->ipykernel<5.0,>=4.8.1; extra == "docs"->kedro==0.15.7) (3.0.3)
Requirement already satisfied: pickleshare in /anaconda3/lib/python3.7/site-packages (from ipython>=4.0.0->ipykernel<5.0,>=4.8.1; extra == "docs"->kedro==0.15.7) (0.7.5)
Requirement already satisfied: appnope; sys_platform == "darwin" in /anaconda3/lib/python3.7/site-packages (from ipython>=4.0.0->ipykernel<5.0,>=4.8.1; extra == "docs"->kedro==0.15.7) (0.1.0)
Requirement already satisfied: jedi>=0.10 in /anaconda3/lib/python3.7/site-packages (from ipython>=4.0.0->ipykernel<5.0,>=4.8.1; extra == "docs"->kedro==0.15.7) (0.13.3)
Requirement already satisfied: pyparsing>=2.0.2 in /anaconda3/lib/python3.7/site-packages (from packaging->sphinx<2.0,>=1.8.4; extra == "docs"->kedro==0.15.7) (2.3.1)
Requirement already satisfied: mistune>=0.8.1 in /anaconda3/lib/python3.7/site-packages (from nbconvert!=5.4->nbsphinx==0.4.2; extra == "docs"->kedro==0.15.7) (0.8.4)
Requirement already satisfied: entrypoints>=0.2.2 in /anaconda3/lib/python3.7/site-packages (from nbconvert!=5.4->nbsphinx==0.4.2; extra == "docs"->kedro==0.15.7) (0.3)
Requirement already satisfied: bleach in /anaconda3/lib/python3.7/site-packages (from nbconvert!=5.4->nbsphinx==0.4.2; extra == "docs"->kedro==0.15.7) (3.1.0)
Requirement already satisfied: pandocfilters>=1.4.1 in /anaconda3/lib/python3.7/site-packages (from nbconvert!=5.4->nbsphinx==0.4.2; extra == "docs"->kedro==0.15.7) (1.4.2)
Requirement already satisfied: testpath in /anaconda3/lib/python3.7/site-packages (from nbconvert!=5.4->nbsphinx==0.4.2; extra == "docs"->kedro==0.15.7) (0.4.2)
Requirement already satisfied: defusedxml in /anaconda3/lib/python3.7/site-packages (from nbconvert!=5.4->nbsphinx==0.4.2; extra == "docs"->kedro==0.15.7) (0.5.0)
Requirement already satisfied: ptyprocess>=0.5 in /anaconda3/lib/python3.7/site-packages (from pexpect; sys_platform != "win32"->ipython>=4.0.0->ipykernel<5.0,>=4.8.1; extra == "docs"->kedro==0.15.7) (0.6.0)
Requirement already satisfied: wcwidth in /anaconda3/lib/python3.7/site-packages (from prompt-toolkit!=3.0.0,!=3.0.1,<3.1.0,>=2.0.0->ipython>=4.0.0->ipykernel<5.0,>=4.8.1; extra == "docs"->kedro==0.15.7) (0.1.7)
Requirement already satisfied: parso>=0.3.0 in /Users/swami/.local/lib/python3.7/site-packages (from jedi>=0.10->ipython>=4.0.0->ipykernel<5.0,>=4.8.1; extra == "docs"->kedro==0.15.7) (0.5.2)
Requirement already satisfied: webencodings in /anaconda3/lib/python3.7/site-packages (from bleach->nbconvert!=5.4->nbsphinx==0.4.2; extra == "docs"->kedro==0.15.7) (0.5.1)
Installing collected packages: kedro
  Attempting uninstall: kedro
    Found existing installation: kedro 0.15.7
    Uninstalling kedro-0.15.7:
      Successfully uninstalled kedro-0.15.7
  Running setup.py develop for kedro
Successfully installed kedro
Requirement already satisfied: anyconfig<1.0,>=0.9.7 in /Users/swami/.local/lib/python3.7/site-packages (from -r requirements.txt (line 1)) (0.9.10)
Requirement already satisfied: click<8.0 in /anaconda3/lib/python3.7/site-packages (from -r requirements.txt (line 2)) (7.0)
Requirement already satisfied: cookiecutter<2.0,>=1.6.0 in /Users/swami/.local/lib/python3.7/site-packages (from -r requirements.txt (line 3)) (1.7.0)
Requirement already satisfied: fsspec<1.0,>=0.5.1 in /Users/swami/.local/lib/python3.7/site-packages (from -r requirements.txt (line 4)) (0.6.2)
Requirement already satisfied: pandas<1.0,>=0.24.0 in /Users/swami/.local/lib/python3.7/site-packages (from -r requirements.txt (line 5)) (0.25.3)
Requirement already satisfied: pip-tools<5.0.0,>=4.0.0 in /Users/swami/.local/lib/python3.7/site-packages (from -r requirements.txt (line 6)) (4.5.0)
Requirement already satisfied: pyarrow<1.0.0,>=0.12.0 in /Users/swami/.local/lib/python3.7/site-packages (from -r requirements.txt (line 7)) (0.16.0)
Requirement already satisfied: python-json-logger<1.0,>=0.1.9 in /Users/swami/.local/lib/python3.7/site-packages (from -r requirements.txt (line 8)) (0.1.11)
Requirement already satisfied: PyYAML<6.0,>=4.2 in /Users/swami/.local/lib/python3.7/site-packages (from -r requirements.txt (line 9)) (5.3)
Requirement already satisfied: requests<3.0,>=2.20.0 in /Users/swami/.local/lib/python3.7/site-packages (from -r requirements.txt (line 10)) (2.20.0)
Requirement already satisfied: s3fs<1.0,>=0.3.0 in /Users/swami/.local/lib/python3.7/site-packages (from -r requirements.txt (line 11)) (0.4.0)
Requirement already satisfied: SQLAlchemy<2.0,>=1.2.0 in /anaconda3/lib/python3.7/site-packages (from -r requirements.txt (line 12)) (1.2.18)
Requirement already satisfied: tables<3.6,>=3.4.4 in /anaconda3/lib/python3.7/site-packages (from -r requirements.txt (line 13)) (3.4.4)
Requirement already satisfied: toposort<2.0,>=1.5 in /Users/swami/.local/lib/python3.7/site-packages (from -r requirements.txt (line 14)) (1.5)
Requirement already satisfied: xlrd<2.0,>=1.0.0 in /anaconda3/lib/python3.7/site-packages (from -r requirements.txt (line 15)) (1.2.0)
Requirement already satisfied: xlsxwriter<2.0,>=1.0.0 in /anaconda3/lib/python3.7/site-packages (from -r requirements.txt (line 16)) (1.1.5)
Requirement already satisfied: azure-storage-blob<2.0,>=1.1.0 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 2)) (1.5.0)
Requirement already satisfied: azure-storage-file<2.0,>=1.1.0 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 3)) (1.4.0)
Requirement already satisfied: azure-storage-queue<2.0,>=1.1.0 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 4)) (1.4.0)
Requirement already satisfied: behave==1.2.6 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 5)) (1.2.6)
Requirement already satisfied: biopython<2.0,>=1.73 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 6)) (1.76)
Requirement already satisfied: black==v19.10.b0 in /Users/swami/.local/lib/python3.7/site-packages (from -r test_requirements.txt (line 7)) (19.10b0)
Requirement already satisfied: dask[complete]<3.0,>=2.6.0 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 8)) (2.9.1)
Requirement already satisfied: flake8<4.0,>=3.5 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 9)) (3.7.8)
Requirement already satisfied: gcsfs<1.0,>=0.3.0 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 10)) (0.6.0)
Requirement already satisfied: gitdb2==3.0.0 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 11)) (3.0.0)
Requirement already satisfied: hdfs<3.0,>=2.5.8 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 12)) (2.5.8)
Requirement already satisfied: import-linter==1.0 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 13)) (1.0)
Requirement already satisfied: joblib==0.12.3 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 14)) (0.12.3)
Requirement already satisfied: jupyter_client<6.0,>=5.1.0 in /Users/swami/.local/lib/python3.7/site-packages (from -r test_requirements.txt (line 15)) (5.3.4)
Requirement already satisfied: matplotlib<4.0,>=3.0.3 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 16)) (3.0.3)
Requirement already satisfied: memory_profiler<1.0,>=0.50.0 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 17)) (0.57.0)
Requirement already satisfied: moto==1.3.7 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 18)) (1.3.7)
Requirement already satisfied: mypy<=1.0 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 19)) (0.761)
Requirement already satisfied: nbconvert<6.0,>=5.3.1 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 20)) (5.4.1)
Requirement already satisfied: nbformat<5.0,>=4.4.0 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 21)) (4.4.0)
Requirement already satisfied: networkx<3.0,>=2.4 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 22)) (2.4)
Requirement already satisfied: pandas-gbq<1.0,>=0.12.0 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 23)) (0.13.1)
Requirement already satisfied: pre-commit<2.0.0,>=1.17.0 in /Users/swami/.local/lib/python3.7/site-packages (from -r test_requirements.txt (line 24)) (1.21.0)
Requirement already satisfied: psutil==5.4.7 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 25)) (5.4.7)
Requirement already satisfied: pylint<3.0,>=2.4.4 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 26)) (2.4.4)
Requirement already satisfied: pyspark<3.0,>=2.2.0 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 27)) (2.4.5)
Requirement already satisfied: pytest-cov<3.0,>=2.5 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 28)) (2.8.1)
Requirement already satisfied: pytest-mock<2.0,>=1.7.1 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 29)) (1.13.0)
Requirement already satisfied: pytest<4.0,>=3.9 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 30)) (3.10.1)
Requirement already satisfied: requests-mock<2.0.0,>=1.6.0 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 31)) (1.7.0)
Requirement already satisfied: trufflehog>=2.0.99 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 32)) (2.1.11)
Requirement already satisfied: wheel==0.32.2 in /anaconda3/lib/python3.7/site-packages (from -r test_requirements.txt (line 33)) (0.32.2)
Requirement already satisfied: setuptools in /anaconda3/lib/python3.7/site-packages (from anyconfig<1.0,>=0.9.7->-r requirements.txt (line 1)) (40.8.0)
Requirement already satisfied: whichcraft>=0.4.0 in /Users/swami/.local/lib/python3.7/site-packages (from cookiecutter<2.0,>=1.6.0->-r requirements.txt (line 3)) (0.6.1)
Requirement already satisfied: future>=0.15.2 in /anaconda3/lib/python3.7/site-packages (from cookiecutter<2.0,>=1.6.0->-r requirements.txt (line 3)) (0.17.1)
Requirement already satisfied: binaryornot>=0.2.0 in /Users/swami/.local/lib/python3.7/site-packages (from cookiecutter<2.0,>=1.6.0->-r requirements.txt (line 3)) (0.4.4)
Requirement already satisfied: poyo>=0.1.0 in /Users/swami/.local/lib/python3.7/site-packages (from cookiecutter<2.0,>=1.6.0->-r requirements.txt (line 3)) (0.5.0)
Requirement already satisfied: jinja2>=2.7 in /anaconda3/lib/python3.7/site-packages (from cookiecutter<2.0,>=1.6.0->-r requirements.txt (line 3)) (2.10)
Requirement already satisfied: jinja2-time>=0.1.0 in /Users/swami/.local/lib/python3.7/site-packages (from cookiecutter<2.0,>=1.6.0->-r requirements.txt (line 3)) (0.2.0)
Requirement already satisfied: numpy>=1.13.3 in /anaconda3/lib/python3.7/site-packages (from pandas<1.0,>=0.24.0->-r requirements.txt (line 5)) (1.16.2)
Requirement already satisfied: pytz>=2017.2 in /anaconda3/lib/python3.7/site-packages (from pandas<1.0,>=0.24.0->-r requirements.txt (line 5)) (2018.9)
Requirement already satisfied: python-dateutil>=2.6.1 in /Users/swami/.local/lib/python3.7/site-packages (from pandas<1.0,>=0.24.0->-r requirements.txt (line 5)) (2.8.0)
Requirement already satisfied: six in /Users/swami/.local/lib/python3.7/site-packages (from pip-tools<5.0.0,>=4.0.0->-r requirements.txt (line 6)) (1.11.0)
Requirement already satisfied: idna<2.8,>=2.5 in /Users/swami/.local/lib/python3.7/site-packages (from requests<3.0,>=2.20.0->-r requirements.txt (line 10)) (2.7)
Requirement already satisfied: urllib3<1.25,>=1.21.1 in /Users/swami/.local/lib/python3.7/site-packages (from requests<3.0,>=2.20.0->-r requirements.txt (line 10)) (1.24.2)
Requirement already satisfied: certifi>=2017.4.17 in /Users/swami/.local/lib/python3.7/site-packages (from requests<3.0,>=2.20.0->-r requirements.txt (line 10)) (2018.10.15)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /anaconda3/lib/python3.7/site-packages (from requests<3.0,>=2.20.0->-r requirements.txt (line 10)) (3.0.4)
Requirement already satisfied: boto3>=1.9.91 in /anaconda3/lib/python3.7/site-packages (from s3fs<1.0,>=0.3.0->-r requirements.txt (line 11)) (1.9.108)
Requirement already satisfied: botocore>=1.12.91 in /anaconda3/lib/python3.7/site-packages (from s3fs<1.0,>=0.3.0->-r requirements.txt (line 11)) (1.12.108)
Requirement already satisfied: numexpr>=2.5.2 in /anaconda3/lib/python3.7/site-packages (from tables<3.6,>=3.4.4->-r requirements.txt (line 13)) (2.6.9)
Requirement already satisfied: azure-common>=1.1.5 in /anaconda3/lib/python3.7/site-packages (from azure-storage-blob<2.0,>=1.1.0->-r test_requirements.txt (line 2)) (1.1.24)
Requirement already satisfied: azure-storage-common~=1.4 in /anaconda3/lib/python3.7/site-packages (from azure-storage-blob<2.0,>=1.1.0->-r test_requirements.txt (line 2)) (1.4.2)
Requirement already satisfied: parse>=1.8.2 in /anaconda3/lib/python3.7/site-packages (from behave==1.2.6->-r test_requirements.txt (line 5)) (1.11.1)
Requirement already satisfied: parse-type>=0.4.2 in /anaconda3/lib/python3.7/site-packages (from behave==1.2.6->-r test_requirements.txt (line 5)) (0.4.2)
Requirement already satisfied: pathspec<1,>=0.6 in /Users/swami/.local/lib/python3.7/site-packages (from black==v19.10.b0->-r test_requirements.txt (line 7)) (0.7.0)
Requirement already satisfied: toml>=0.9.4 in /anaconda3/lib/python3.7/site-packages (from black==v19.10.b0->-r test_requirements.txt (line 7)) (0.10.0)
Requirement already satisfied: attrs>=18.1.0 in /anaconda3/lib/python3.7/site-packages (from black==v19.10.b0->-r test_requirements.txt (line 7)) (18.2.0)
Requirement already satisfied: typed-ast>=1.4.0 in /Users/swami/.local/lib/python3.7/site-packages (from black==v19.10.b0->-r test_requirements.txt (line 7)) (1.4.1)
Requirement already satisfied: regex in /anaconda3/lib/python3.7/site-packages (from black==v19.10.b0->-r test_requirements.txt (line 7)) (2018.1.10)
Requirement already satisfied: appdirs in /Users/swami/.local/lib/python3.7/site-packages (from black==v19.10.b0->-r test_requirements.txt (line 7)) (1.4.3)
Requirement already satisfied: bokeh>=1.0.0; extra == "complete" in /anaconda3/lib/python3.7/site-packages (from dask[complete]<3.0,>=2.6.0->-r test_requirements.txt (line 8)) (1.0.4)
Requirement already satisfied: partd>=0.3.10; extra == "complete" in /Users/swami/.local/lib/python3.7/site-packages (from dask[complete]<3.0,>=2.6.0->-r test_requirements.txt (line 8)) (1.1.0)
Requirement already satisfied: cloudpickle>=0.2.1; extra == "complete" in /anaconda3/lib/python3.7/site-packages (from dask[complete]<3.0,>=2.6.0->-r test_requirements.txt (line 8)) (0.8.0)
Requirement already satisfied: toolz>=0.7.3; extra == "complete" in /anaconda3/lib/python3.7/site-packages (from dask[complete]<3.0,>=2.6.0->-r test_requirements.txt (line 8)) (0.9.0)
Requirement already satisfied: distributed>=2.0; extra == "complete" in /Users/swami/.local/lib/python3.7/site-packages (from dask[complete]<3.0,>=2.6.0->-r test_requirements.txt (line 8)) (2.9.1)
Requirement already satisfied: pycodestyle<2.6.0,>=2.5.0 in /anaconda3/lib/python3.7/site-packages (from flake8<4.0,>=3.5->-r test_requirements.txt (line 9)) (2.5.0)
Requirement already satisfied: entrypoints<0.4.0,>=0.3.0 in /anaconda3/lib/python3.7/site-packages (from flake8<4.0,>=3.5->-r test_requirements.txt (line 9)) (0.3)
Requirement already satisfied: pyflakes<2.2.0,>=2.1.0 in /anaconda3/lib/python3.7/site-packages (from flake8<4.0,>=3.5->-r test_requirements.txt (line 9)) (2.1.0)
Requirement already satisfied: mccabe<0.7.0,>=0.6.0 in /anaconda3/lib/python3.7/site-packages (from flake8<4.0,>=3.5->-r test_requirements.txt (line 9)) (0.6.1)
Requirement already satisfied: google-auth>=1.2 in /anaconda3/lib/python3.7/site-packages (from gcsfs<1.0,>=0.3.0->-r test_requirements.txt (line 10)) (1.11.2)
Requirement already satisfied: decorator in /anaconda3/lib/python3.7/site-packages (from gcsfs<1.0,>=0.3.0->-r test_requirements.txt (line 10)) (4.3.2)
Requirement already satisfied: google-auth-oauthlib in /anaconda3/lib/python3.7/site-packages (from gcsfs<1.0,>=0.3.0->-r test_requirements.txt (line 10)) (0.4.1)
Requirement already satisfied: smmap2>=2.0.0 in /anaconda3/lib/python3.7/site-packages (from gitdb2==3.0.0->-r test_requirements.txt (line 11)) (2.0.5)
Requirement already satisfied: docopt in /anaconda3/lib/python3.7/site-packages (from hdfs<3.0,>=2.5.8->-r test_requirements.txt (line 12)) (0.6.2)
Requirement already satisfied: grimp<2,>=1 in /anaconda3/lib/python3.7/site-packages (from import-linter==1.0->-r test_requirements.txt (line 13)) (1.2)
Requirement already satisfied: traitlets in /anaconda3/lib/python3.7/site-packages (from jupyter_client<6.0,>=5.1.0->-r test_requirements.txt (line 15)) (4.3.2)
Requirement already satisfied: pyzmq>=13 in /anaconda3/lib/python3.7/site-packages (from jupyter_client<6.0,>=5.1.0->-r test_requirements.txt (line 15)) (17.1.2)
Requirement already satisfied: jupyter-core>=4.6.0 in /Users/swami/.local/lib/python3.7/site-packages (from jupyter_client<6.0,>=5.1.0->-r test_requirements.txt (line 15)) (4.6.1)
Requirement already satisfied: tornado>=4.1 in /anaconda3/lib/python3.7/site-packages (from jupyter_client<6.0,>=5.1.0->-r test_requirements.txt (line 15)) (5.1.1)
Requirement already satisfied: cycler>=0.10 in /anaconda3/lib/python3.7/site-packages (from matplotlib<4.0,>=3.0.3->-r test_requirements.txt (line 16)) (0.10.0)
Requirement already satisfied: pyparsing!=2.0.4,!=2.1.2,!=2.1.6,>=2.0.1 in /anaconda3/lib/python3.7/site-packages (from matplotlib<4.0,>=3.0.3->-r test_requirements.txt (line 16)) (2.3.1)
Requirement already satisfied: kiwisolver>=1.0.1 in /anaconda3/lib/python3.7/site-packages (from matplotlib<4.0,>=3.0.3->-r test_requirements.txt (line 16)) (1.0.1)
Requirement already satisfied: mock in /anaconda3/lib/python3.7/site-packages (from moto==1.3.7->-r test_requirements.txt (line 18)) (2.0.0)
Requirement already satisfied: responses>=0.9.0 in /anaconda3/lib/python3.7/site-packages (from moto==1.3.7->-r test_requirements.txt (line 18)) (0.10.11)
Requirement already satisfied: xmltodict in /anaconda3/lib/python3.7/site-packages (from moto==1.3.7->-r test_requirements.txt (line 18)) (0.12.0)
Requirement already satisfied: docker>=2.5.1 in /anaconda3/lib/python3.7/site-packages (from moto==1.3.7->-r test_requirements.txt (line 18)) (4.2.0)
Requirement already satisfied: python-jose<3.0.0 in /anaconda3/lib/python3.7/site-packages (from moto==1.3.7->-r test_requirements.txt (line 18)) (2.0.2)
Requirement already satisfied: cryptography>=2.3.0 in /anaconda3/lib/python3.7/site-packages (from moto==1.3.7->-r test_requirements.txt (line 18)) (2.5)
Requirement already satisfied: jsondiff==1.1.1 in /anaconda3/lib/python3.7/site-packages (from moto==1.3.7->-r test_requirements.txt (line 18)) (1.1.1)
Requirement already satisfied: aws-xray-sdk<0.96,>=0.93 in /anaconda3/lib/python3.7/site-packages (from moto==1.3.7->-r test_requirements.txt (line 18)) (0.95)
Requirement already satisfied: boto>=2.36.0 in /anaconda3/lib/python3.7/site-packages (from moto==1.3.7->-r test_requirements.txt (line 18)) (2.49.0)
Requirement already satisfied: werkzeug in /anaconda3/lib/python3.7/site-packages (from moto==1.3.7->-r test_requirements.txt (line 18)) (0.14.1)
Requirement already satisfied: pyaml in /anaconda3/lib/python3.7/site-packages (from moto==1.3.7->-r test_requirements.txt (line 18)) (19.12.0)
Requirement already satisfied: typing-extensions>=3.7.4 in /anaconda3/lib/python3.7/site-packages (from mypy<=1.0->-r test_requirements.txt (line 19)) (3.7.4.1)
Requirement already satisfied: mypy-extensions<0.5.0,>=0.4.3 in /anaconda3/lib/python3.7/site-packages (from mypy<=1.0->-r test_requirements.txt (line 19)) (0.4.3)
Requirement already satisfied: mistune>=0.8.1 in /anaconda3/lib/python3.7/site-packages (from nbconvert<6.0,>=5.3.1->-r test_requirements.txt (line 20)) (0.8.4)
Requirement already satisfied: pygments in /anaconda3/lib/python3.7/site-packages (from nbconvert<6.0,>=5.3.1->-r test_requirements.txt (line 20)) (2.3.1)
Requirement already satisfied: bleach in /anaconda3/lib/python3.7/site-packages (from nbconvert<6.0,>=5.3.1->-r test_requirements.txt (line 20)) (3.1.0)
Requirement already satisfied: pandocfilters>=1.4.1 in /anaconda3/lib/python3.7/site-packages (from nbconvert<6.0,>=5.3.1->-r test_requirements.txt (line 20)) (1.4.2)
Requirement already satisfied: testpath in /anaconda3/lib/python3.7/site-packages (from nbconvert<6.0,>=5.3.1->-r test_requirements.txt (line 20)) (0.4.2)
Requirement already satisfied: defusedxml in /anaconda3/lib/python3.7/site-packages (from nbconvert<6.0,>=5.3.1->-r test_requirements.txt (line 20)) (0.5.0)
Requirement already satisfied: jsonschema!=2.5.0,>=2.4 in /anaconda3/lib/python3.7/site-packages (from nbformat<5.0,>=4.4.0->-r test_requirements.txt (line 21)) (2.6.0)
Requirement already satisfied: ipython-genutils in /anaconda3/lib/python3.7/site-packages (from nbformat<5.0,>=4.4.0->-r test_requirements.txt (line 21)) (0.2.0)
Requirement already satisfied: google-cloud-bigquery>=1.11.1 in /anaconda3/lib/python3.7/site-packages (from pandas-gbq<1.0,>=0.12.0->-r test_requirements.txt (line 23)) (1.24.0)
Requirement already satisfied: pydata-google-auth in /anaconda3/lib/python3.7/site-packages (from pandas-gbq<1.0,>=0.12.0->-r test_requirements.txt (line 23)) (0.3.0)
Requirement already satisfied: identify>=1.0.0 in /Users/swami/.local/lib/python3.7/site-packages (from pre-commit<2.0.0,>=1.17.0->-r test_requirements.txt (line 24)) (1.4.10)
Requirement already satisfied: aspy.yaml in /Users/swami/.local/lib/python3.7/site-packages (from pre-commit<2.0.0,>=1.17.0->-r test_requirements.txt (line 24)) (1.3.0)
Requirement already satisfied: importlib-metadata; python_version < "3.8" in /anaconda3/lib/python3.7/site-packages (from pre-commit<2.0.0,>=1.17.0->-r test_requirements.txt (line 24)) (0.23)
Requirement already satisfied: nodeenv>=0.11.1 in /Users/swami/.local/lib/python3.7/site-packages (from pre-commit<2.0.0,>=1.17.0->-r test_requirements.txt (line 24)) (1.3.4)
Requirement already satisfied: virtualenv>=15.2 in /anaconda3/lib/python3.7/site-packages (from pre-commit<2.0.0,>=1.17.0->-r test_requirements.txt (line 24)) (16.7.5)
Requirement already satisfied: cfgv>=2.0.0 in /Users/swami/.local/lib/python3.7/site-packages (from pre-commit<2.0.0,>=1.17.0->-r test_requirements.txt (line 24)) (2.0.1)
Requirement already satisfied: isort<5,>=4.2.5 in /anaconda3/lib/python3.7/site-packages (from pylint<3.0,>=2.4.4->-r test_requirements.txt (line 26)) (4.3.8)
Requirement already satisfied: astroid<2.4,>=2.3.0 in /anaconda3/lib/python3.7/site-packages (from pylint<3.0,>=2.4.4->-r test_requirements.txt (line 26)) (2.3.3)
Requirement already satisfied: py4j==0.10.7 in /anaconda3/lib/python3.7/site-packages (from pyspark<3.0,>=2.2.0->-r test_requirements.txt (line 27)) (0.10.7)
Requirement already satisfied: coverage>=4.4 in /anaconda3/lib/python3.7/site-packages (from pytest-cov<3.0,>=2.5->-r test_requirements.txt (line 28)) (4.5.3)
Requirement already satisfied: atomicwrites>=1.0 in /anaconda3/lib/python3.7/site-packages (from pytest<4.0,>=3.9->-r test_requirements.txt (line 30)) (1.3.0)
Requirement already satisfied: pluggy>=0.7 in /anaconda3/lib/python3.7/site-packages (from pytest<4.0,>=3.9->-r test_requirements.txt (line 30)) (0.13.0)
Requirement already satisfied: more-itertools>=4.0.0 in /anaconda3/lib/python3.7/site-packages (from pytest<4.0,>=3.9->-r test_requirements.txt (line 30)) (5.0.0)
Requirement already satisfied: py>=1.5.0 in /anaconda3/lib/python3.7/site-packages (from pytest<4.0,>=3.9->-r test_requirements.txt (line 30)) (1.8.0)
Requirement already satisfied: GitPython==3.0.6 in /anaconda3/lib/python3.7/site-packages (from trufflehog>=2.0.99->-r test_requirements.txt (line 32)) (3.0.6)
Requirement already satisfied: truffleHogRegexes==0.0.7 in /anaconda3/lib/python3.7/site-packages (from trufflehog>=2.0.99->-r test_requirements.txt (line 32)) (0.0.7)
Requirement already satisfied: MarkupSafe>=0.23 in /anaconda3/lib/python3.7/site-packages (from jinja2>=2.7->cookiecutter<2.0,>=1.6.0->-r requirements.txt (line 3)) (1.1.1)
Requirement already satisfied: arrow in /Users/swami/.local/lib/python3.7/site-packages (from jinja2-time>=0.1.0->cookiecutter<2.0,>=1.6.0->-r requirements.txt (line 3)) (0.15.5)
Requirement already satisfied: s3transfer<0.3.0,>=0.2.0 in /anaconda3/lib/python3.7/site-packages (from boto3>=1.9.91->s3fs<1.0,>=0.3.0->-r requirements.txt (line 11)) (0.2.0)
Requirement already satisfied: jmespath<1.0.0,>=0.7.1 in /anaconda3/lib/python3.7/site-packages (from boto3>=1.9.91->s3fs<1.0,>=0.3.0->-r requirements.txt (line 11)) (0.9.4)
Requirement already satisfied: docutils>=0.10 in /anaconda3/lib/python3.7/site-packages (from botocore>=1.12.91->s3fs<1.0,>=0.3.0->-r requirements.txt (line 11)) (0.14)
Requirement already satisfied: packaging>=16.8 in /anaconda3/lib/python3.7/site-packages (from bokeh>=1.0.0; extra == "complete"->dask[complete]<3.0,>=2.6.0->-r test_requirements.txt (line 8)) (19.0)
Requirement already satisfied: pillow>=4.0 in /Users/swami/.local/lib/python3.7/site-packages (from bokeh>=1.0.0; extra == "complete"->dask[complete]<3.0,>=2.6.0->-r test_requirements.txt (line 8)) (6.2.1)
Requirement already satisfied: locket in /anaconda3/lib/python3.7/site-packages (from partd>=0.3.10; extra == "complete"->dask[complete]<3.0,>=2.6.0->-r test_requirements.txt (line 8)) (0.2.0)
Requirement already satisfied: msgpack in /anaconda3/lib/python3.7/site-packages (from distributed>=2.0; extra == "complete"->dask[complete]<3.0,>=2.6.0->-r test_requirements.txt (line 8)) (0.5.6)
Requirement already satisfied: zict>=0.1.3 in /anaconda3/lib/python3.7/site-packages (from distributed>=2.0; extra == "complete"->dask[complete]<3.0,>=2.6.0->-r test_requirements.txt (line 8)) (0.1.3)
Requirement already satisfied: tblib in /anaconda3/lib/python3.7/site-packages (from distributed>=2.0; extra == "complete"->dask[complete]<3.0,>=2.6.0->-r test_requirements.txt (line 8)) (1.3.2)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /anaconda3/lib/python3.7/site-packages (from distributed>=2.0; extra == "complete"->dask[complete]<3.0,>=2.6.0->-r test_requirements.txt (line 8)) (2.1.0)
Requirement already satisfied: cachetools<5.0,>=2.0.0 in /anaconda3/lib/python3.7/site-packages (from google-auth>=1.2->gcsfs<1.0,>=0.3.0->-r test_requirements.txt (line 10)) (3.1.0)
Requirement already satisfied: pyasn1-modules>=0.2.1 in /anaconda3/lib/python3.7/site-packages (from google-auth>=1.2->gcsfs<1.0,>=0.3.0->-r test_requirements.txt (line 10)) (0.2.8)
Requirement already satisfied: rsa<4.1,>=3.1.4 in /anaconda3/lib/python3.7/site-packages (from google-auth>=1.2->gcsfs<1.0,>=0.3.0->-r test_requirements.txt (line 10)) (4.0)
Requirement already satisfied: requests-oauthlib>=0.7.0 in /anaconda3/lib/python3.7/site-packages (from google-auth-oauthlib->gcsfs<1.0,>=0.3.0->-r test_requirements.txt (line 10)) (1.3.0)
Requirement already satisfied: pbr>=0.11 in /anaconda3/lib/python3.7/site-packages (from mock->moto==1.3.7->-r test_requirements.txt (line 18)) (5.1.3)
Requirement already satisfied: websocket-client>=0.32.0 in /anaconda3/lib/python3.7/site-packages (from docker>=2.5.1->moto==1.3.7->-r test_requirements.txt (line 18)) (0.57.0)
Requirement already satisfied: ecdsa<1.0 in /anaconda3/lib/python3.7/site-packages (from python-jose<3.0.0->moto==1.3.7->-r test_requirements.txt (line 18)) (0.15)
Requirement already satisfied: pycryptodome<4.0.0,>=3.3.1 in /anaconda3/lib/python3.7/site-packages (from python-jose<3.0.0->moto==1.3.7->-r test_requirements.txt (line 18)) (3.9.7)
Requirement already satisfied: asn1crypto>=0.21.0 in /anaconda3/lib/python3.7/site-packages (from cryptography>=2.3.0->moto==1.3.7->-r test_requirements.txt (line 18)) (0.24.0)
Requirement already satisfied: cffi!=1.11.3,>=1.8 in /anaconda3/lib/python3.7/site-packages (from cryptography>=2.3.0->moto==1.3.7->-r test_requirements.txt (line 18)) (1.12.1)
Requirement already satisfied: jsonpickle in /anaconda3/lib/python3.7/site-packages (from aws-xray-sdk<0.96,>=0.93->moto==1.3.7->-r test_requirements.txt (line 18)) (1.3)
Requirement already satisfied: wrapt in /anaconda3/lib/python3.7/site-packages (from aws-xray-sdk<0.96,>=0.93->moto==1.3.7->-r test_requirements.txt (line 18)) (1.10.11)
Requirement already satisfied: webencodings in /anaconda3/lib/python3.7/site-packages (from bleach->nbconvert<6.0,>=5.3.1->-r test_requirements.txt (line 20)) (0.5.1)
Requirement already satisfied: protobuf>=3.6.0 in /Users/swami/.local/lib/python3.7/site-packages (from google-cloud-bigquery>=1.11.1->pandas-gbq<1.0,>=0.12.0->-r test_requirements.txt (line 23)) (3.11.3)
Requirement already satisfied: google-cloud-core<2.0dev,>=1.1.0 in /anaconda3/lib/python3.7/site-packages (from google-cloud-bigquery>=1.11.1->pandas-gbq<1.0,>=0.12.0->-r test_requirements.txt (line 23)) (1.3.0)
Requirement already satisfied: google-api-core<2.0dev,>=1.15.0 in /anaconda3/lib/python3.7/site-packages (from google-cloud-bigquery>=1.11.1->pandas-gbq<1.0,>=0.12.0->-r test_requirements.txt (line 23)) (1.16.0)
Requirement already satisfied: google-resumable-media<0.6dev,>=0.5.0 in /anaconda3/lib/python3.7/site-packages (from google-cloud-bigquery>=1.11.1->pandas-gbq<1.0,>=0.12.0->-r test_requirements.txt (line 23)) (0.5.0)
Requirement already satisfied: zipp>=0.5 in /anaconda3/lib/python3.7/site-packages (from importlib-metadata; python_version < "3.8"->pre-commit<2.0.0,>=1.17.0->-r test_requirements.txt (line 24)) (0.6.0)
Requirement already satisfied: lazy-object-proxy==1.4.* in /anaconda3/lib/python3.7/site-packages (from astroid<2.4,>=2.3.0->pylint<3.0,>=2.4.4->-r test_requirements.txt (line 26)) (1.4.3)
Requirement already satisfied: heapdict in /anaconda3/lib/python3.7/site-packages (from zict>=0.1.3->distributed>=2.0; extra == "complete"->dask[complete]<3.0,>=2.6.0->-r test_requirements.txt (line 8)) (1.0.0)
Requirement already satisfied: pyasn1<0.5.0,>=0.4.6 in /anaconda3/lib/python3.7/site-packages (from pyasn1-modules>=0.2.1->google-auth>=1.2->gcsfs<1.0,>=0.3.0->-r test_requirements.txt (line 10)) (0.4.8)
Requirement already satisfied: oauthlib>=3.0.0 in /anaconda3/lib/python3.7/site-packages (from requests-oauthlib>=0.7.0->google-auth-oauthlib->gcsfs<1.0,>=0.3.0->-r test_requirements.txt (line 10)) (3.1.0)
Requirement already satisfied: pycparser in /anaconda3/lib/python3.7/site-packages (from cffi!=1.11.3,>=1.8->cryptography>=2.3.0->moto==1.3.7->-r test_requirements.txt (line 18)) (2.19)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.6.0 in /anaconda3/lib/python3.7/site-packages (from google-api-core<2.0dev,>=1.15.0->google-cloud-bigquery>=1.11.1->pandas-gbq<1.0,>=0.12.0->-r test_requirements.txt (line 23)) (1.51.0)
Installed kernelspec kedro in /Users/swami/Library/Jupyter/kernels/kedro
Running Sphinx v1.8.5
loading translations [en]... done
Adding copy buttons to code blocks...
making output directory...
[autosummary] generating autosummary for: 01_introduction/01_introduction.md, 02_getting_started/01_prerequisites.md, 02_getting_started/02_install.md, 02_getting_started/03_new_project.md, 02_getting_started/04_hello_world.md, 03_tutorial/01_workflow.md, 03_tutorial/02_tutorial_template.md, 03_tutorial/03_set_up_data.md, 03_tutorial/04_create_pipelines.md, 03_tutorial/05_package_a_project.md, ..., kedro.contrib.rst, kedro.extras.datasets.rst, kedro.extras.decorators.rst, kedro.extras.logging.rst, kedro.extras.transformers.rst, kedro.io.rst, kedro.pipeline.rst, kedro.rst, kedro.runner.rst, kedro.versioning.rst commands
@neomatrix369
Docs: added instructions in the CONTRIBUTING.md to show how to run th…
d0bef17 
…e make commands to build a docker image and run a docker container related to the Kedro development environment
@neomatrix369
Docs: corrected previous release notes entry (via PR kedro-org#266, r…
b2bf2d1 
…elated to issue kedro-org#256. Added new release notes entry for PR kedro-org#268, related to issue kedro-org#265

[skip ci]
@neomatrix369 neomatrix369 force-pushed the provide-docker-container-for-kedro branch from e85a46b to b2bf2d1 Compare March 15, 2020 14:02
@yetudada yetudada changed the title Provide docker container for kedro developer environment [KED-1456] Provide docker container for kedro developer environment May 18, 2020
@mzjp2
Copy link
Contributor

mzjp2 commented May 18, 2020

Hey!

Thanks for raising this PR and sorry for the delay in getting back to you. We've had an internal discussion about this and decided that we'd instead focus on making the development requirements more minimal, rather than introducing a docker image. You can now run tests and get started on contributing without Spark installed, which was a major impediment before.

I'll go ahead and close this, but thank you again for the PR and discussion. :)

@mzjp2 mzjp2 closed this May 18, 2020
@mzjp2 mzjp2 mentioned this pull request May 18, 2020
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@idanov idanov Awaiting requested review from idanov

@tsanikgr tsanikgr Awaiting requested review from tsanikgr

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@neomatrix369 @mzjp2