Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support SGE #10

Open
BTopcuoglu opened this issue Aug 19, 2021 · 4 comments
Open

Support SGE #10

BTopcuoglu opened this issue Aug 19, 2021 · 4 comments
Assignees
Labels
feature A new feature request or enhancement

Comments

@BTopcuoglu
Copy link

We have a working solution locally as well as Slurm. Let's get it running on SGE as well.

@BTopcuoglu BTopcuoglu added the feature A new feature request or enhancement label Aug 19, 2021
@BTopcuoglu BTopcuoglu self-assigned this Aug 19, 2021
@kelly-sovacool
Copy link
Member

SGE the job scheduler, right? You'll probably just need to create a profile in config/sge/config.yaml, add an example submission script in code/submit_sge.sh, and maybe edit config/cluster.json if needed.

@BTopcuoglu
Copy link
Author

Yes, SGE the scheduler - @ykefella and I are working on this and will update y'all on the progress.

@kelly-sovacool
Copy link
Member

kelly-sovacool commented Aug 23, 2021

@BTopcuoglu You might find it helpful to fork & modify this to get a simpler Snakemake workflow running with SGE, before testing it out with this heavier workflow.

@ykefella
Copy link

@kelly-sovacool thank you for the helpful link. @BTopcuoglu and I have a working qsub command to run Snakemake workflow on SGE. This is the command :
snakemake --latency-wait 90 --jobs 100 --cluster "qsub -cwd -V -pe threads 4 -N {rule}.{wildcards} -l mem_reserve=10G -l mem_free=10G -l h_vmem=10G -P vlong -o log/hpc/{rule}.{wildcards}.out -e log/hpc/{rule}.{wildcards}.err"
We have yet to modify config/cluster.json and code/submit_sge.sh and run it using submission script.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature A new feature request or enhancement
Projects
None yet
Development

No branches or pull requests

3 participants