Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhancer plot #8

Open
wants to merge 33 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
9658c0b
gitignore __pycache__
katosh Jun 17, 2023
af4db89
make utility code structure with enhancer_plot code
katosh Jun 17, 2023
4f72ec6
enhancer_plot notebook
katosh Jun 17, 2023
c9089b7
intermediate commit
jordanc17 Jun 20, 2023
bc835cd
update dag for #10
jordanc17 Jun 29, 2023
d7cf307
gitignore __pycache__
katosh Jun 17, 2023
2b651e7
make utility code structure with enhancer_plot code
katosh Jun 17, 2023
1f967b3
enhancer_plot notebook
katosh Jun 17, 2023
6212962
intermediate commit
jordanc17 Jun 20, 2023
dff6ba2
Merge branch 'enhancer_plot' of github.com:settylab/geneTF into enhan…
jordanc17 Jul 6, 2023
d4ba231
Remove references to gene-TF in README
jordanc17 Jul 7, 2023
65ffb51
add python input, fix continuous colors
jordanc17 Jul 10, 2023
b6cdf56
remove unnecessary int cast in line 432
jordanc17 Jul 11, 2023
e7a46d1
update continuous color plotting
jordanc17 Jul 11, 2023
8b4d668
remove int casts in enhancer_plot.py
jordanc17 Jul 11, 2023
e60f32a
add get_peak_deltas to enhancer_plot.py
jordanc17 Jul 12, 2023
f740fd1
update with mellon data, explanation
jordanc17 Jul 12, 2023
0db952a
gitignore .h5ad files in data/
jordanc17 Jul 12, 2023
9c72f75
Merge pull request #12 from settylab/main
jordanc17 Jul 12, 2023
5bc49f9
document get_peak_deltas
jordanc17 Jul 12, 2023
25dd278
Merge branch 'enhancer_plot' of github.com:settylab/atac_metacell_uti…
jordanc17 Jul 12, 2023
b0915d8
Merge branch 'enhancer_plot' of github.com:settylab/atac_metacell_uti…
jordanc17 Jul 12, 2023
7b6afc3
Merge branch 'enhancer_plot' of github.com:settylab/atac_metacell_uti…
jordanc17 Jul 12, 2023
b03e049
Update README.md with Mellon citation
ManuSetty Jul 12, 2023
fb15eed
Merge branch 'enhancer_plot' of github.com:settylab/atac_metacell_uti…
jordanc17 Jul 12, 2023
faac164
Update README.md with Mellon citation
ManuSetty Jul 12, 2023
04cb4a8
remove unnecessary merge commits
jordanc17 Jul 12, 2023
2c8ba06
Merge branch 'repo-update-ms' into repo-update
jordanc17 Aug 29, 2023
e7c187f
track logs and test config
jordanc17 Aug 29, 2023
b18753e
track .Rprofile for reproducibility
jordanc17 Aug 29, 2023
9f028c4
gitignore large files
jordanc17 Aug 29, 2023
d2f2ac2
Merge branch 'main' into repo-update to bring dev branch up to date
jordanc17 Aug 29, 2023
6d842ee
update branch to repo-update
jordanc17 Aug 29, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .Rprofile
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
source("renv/activate.R")
8 changes: 5 additions & 3 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -2,15 +2,17 @@
.snakemake
._dag.png
.DS_Store
<<<<<<< HEAD
**/__pycache__/
*.py[cod]
=======
*/__pycache__/
>>>>>>> 1384bcec7fd21b92b2dd6e3203d5fc38ff522141
renv/cellar/
renv/library/
renv/local/
renv/lock/
renv/python/
renv/staging/
<<<<<<< HEAD
**/*.h5ad
*data/
*results/

6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ This repository contains a [`snakemake`](https://snakemake.readthedocs.io/en/sta

## Overview:

Below is a DAG showing the rule dependencies in the `snakemake` pipeline. View the [`Snakefile`](https://github.com/settylab/geneTF/blob/main/workflow/Snakefile) to see details on each rule.
Below is a DAG showing the rule dependencies in the `snakemake` pipeline. View the [`Snakefile`](https://github.com/settylab/atac-metacell-utilites/blob/main/workflow/Snakefile) to see details on each rule.

![DAG of workflow](./dag.png)

Expand Down Expand Up @@ -244,9 +244,9 @@ For example, the following will run/re-run the `chromvar` rule and any of the al
```
snakemake --cores 1 chromvar --allowed_rules peak_tf compute_ins_chip prep_chromvar
```
When running this pipeline on an HPC system which uses `lmod` to load software, do not load snakemake as a module - this can cause conflicts where the Python version used by `snakemake` is the one provided by the module, not the `gene-TF` conda environment.
When running this pipeline on an HPC system which uses `lmod` to load software, do not load snakemake as a module - this can cause conflicts where the Python version used by `snakemake` is the one provided by the module, not the `atac-metacell-utils` conda environment.

To run using the snakemake version installed with `gene-TF`, make sure the `gene-TF` environment is active, then run the pipeline as follows:
To run using the snakemake version installed with `atac-metacell-utils`, make sure the `atac-metacell-utils` environment is active, then run the pipeline as follows:

```
python -m snakemake --cores 1 name-of-rule
Expand Down
49 changes: 49 additions & 0 deletions config/full-test-config.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,49 @@
scripts: "workflow/scripts/"
output: "full-test-results/"
logs: "full-test-logs/"
interactive_clean: True

renv_loc: "/home/cjordan2/R/x86_64-pc-linux-gnu-library/4.1.0" # <path/to/user/R/library>

anndata:
atac: "/fh/fast/setty_m/user/cjordan2/repositories/density-analysis/data/bm_atac_meta_ad.h5ad" #"/fh/fast/setty_m/user/cjordan2/repositories/geneTF/data/test_atac_meta_ad.h5ad" #<<path/to/SEACell/ATAC/AnnData/here>
rna: "/fh/fast/setty_m/user/cjordan2/repositories/density-analysis/data/bm_rna_meta_ad.h5ad" #tcell_dep_rna_w_SEACells_meta.h5ad" #"/fh/fast/setty_m/user/cjordan2/repositories/geneTF/data/test_rna_meta_ad.h5ad" #<path/to/SEACell/RNA/AnnData/here>
sc_atac: "/fh/fast/setty_m/user/cjordan2/repositories/density-analysis/data/snapshot_ads/bm_atac_ad.h5ad" #"/fh/fast/setty_m/user/cjordan2/repositories/geneTF/data/test_atac_ad.h5ad"
sc_rna: "/fh/fast/setty_m/user/cjordan2/repositories/density-analysis/data/snapshot_ads/bm_rna_ad.h5ad" #"/fh/fast/setty_m/user/cjordan2/repositories/geneTF/data/test_rna_ad.h5ad"
# documenting what label was used to create the SEACells AnnData - also used for differential accessibility
SEACell_label: "SEACell"
peaks:
width: 150
genome: "hg38"
meme_file: "data/cis-bp-tf-information.meme"

ins_chip:
# set verbose to "--verbose" for True
verbose: ""
min_chip_score: 0.15
min_peak_hits: 30

gene_peak_corr_config:
# set test_set to "--test_set" for True
n_jobs: 1
test_set: ""
n_genes: 20

gene_peak_corr_cutoffs:
min_corr: 0.0
max_pval: 0.1
min_peaks: 2

diff_acc:
to_compare: "EryPre1,proB/Mono,proB/EryPre1,HSC/Mono,HSC"
group_variable: "celltype_combined"

peak_selection:
target: ["Bcells","proB"]
start: "HSC"
reference:
Ery: "EryPre1"
Mono: "Mono"
min_logFC: -0.25
max_logFC: 0.25

Loading