Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Launching docker container for each dataset #47

Open
titansmc opened this issue May 10, 2021 · 1 comment
Open

Launching docker container for each dataset #47

titansmc opened this issue May 10, 2021 · 1 comment
Labels
enhancement New feature or request

Comments

@titansmc
Copy link

Hi,
We would like to have it running in our k8s cluster, is it possible that we spin up a new container for each dataset?
Thanks.
@alokito
Copy link
Member

alokito commented May 10, 2021 •
edited
Loading

HI @titansmc ! This is a feature that I would like to enable, but it hasn't been prioritized by my company, and I don't really have the time or k8s expertise to do it on my own (though I am working on the latter part!). I will leave this ticket open in hopes that I or someone else gets to it. With the "ItemSource" interface we now have flexible data item sources, allowing both filesystem and S3 locations. Ideally we would implement a similar kind of flexible compute.

@alokito alokito added the enhancement New feature or request label May 10, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@alokito @titansmc