Skip to content
This repository has been archived by the owner on Nov 16, 2023. It is now read-only.

select contiguous data splits for val and train #200

Merged
merged 25 commits into from
Feb 18, 2020
Merged

select contiguous data splits for val and train #200

Show file tree
Hide file tree
Changes from 22 commits
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
5f7d1aa
select contiguous data splits for test and train
Feb 12, 2020
9ca474a
Merge branch 'contrib' into select_data_test_train
squassina Feb 12, 2020
85ed0b1
revert changes to split_alaudah_et_al_19 method
Feb 12, 2020
51e6c67
changed data-dir to data_dir as arg to prepare_dutchf3.py
Feb 12, 2020
4929dd0
revert changes to split_alaudah_et_al_19 method
Feb 12, 2020
a81ab3b
changed data-dir to data_dir as arg to prepare_dutchf3.py
Feb 12, 2020
a737374
fix merge errors
Feb 12, 2020
da97842
fix merge errors - files not related to change
Feb 13, 2020
123db24
fix merge errors - other diff - files not related to change
Feb 13, 2020
e88b5b6
fix merge errors - other diff - files not related to change
Feb 13, 2020
66ce29e
fix merge errors - other diff - files not related to change
Feb 13, 2020
a9176e0
fix merge errors - other diff - files not related to change
Feb 13, 2020
91c49e9
fix merge errors - other diff - files not related to change
Feb 13, 2020
0da3ab4
update script with new required parameter label_file
Feb 13, 2020
909c3d8
ignoring split_alaudah_et_al_19 as it is not updated
Feb 13, 2020
ecac9e8
updated arguments used
Feb 13, 2020
22817f6
fix commnad line arguments
Feb 13, 2020
5fa33be
Merge branch 'contrib' into select_data_test_train
squassina Feb 13, 2020
5a88ad0
changed TEST to VALIDATION for clarity in the code
Feb 13, 2020
6bebb14
Merge branch 'select_data_test_train' of https://github.com/olgaliak/…
Feb 13, 2020
9f8c023
included job to run scripts unit test
Feb 13, 2020
ca81270
fix train_val_split that was changed by error
Feb 13, 2020
753e1ee
Fix val/train split and add tests
Feb 14, 2020
de2b86b
adjust to consider the whole horz_lines
Feb 17, 2020
0565856
update environment - gitpython version
Feb 17, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -142,11 +142,12 @@ To prepare the data for the experiments (e.g. split into train/val/test), please
cd scripts

# For section-based experiments
python prepare_dutchf3.py split_train_val section --data-dir=${data_dir}/data
python prepare_dutchf3.py split_train_val section --data_dir=${data_dir} --label_file=train/train_labels.npy --output_dir=splits


# For patch-based experiments
python prepare_dutchf3.py split_train_val patch --data-dir=${data_dir}/data --stride=50 --patch=100
python prepare_dutchf3.py split_train_val patch --data_dir=${data_dir} --label_file=train/train_labels.npy --output_dir=splits \
--stride=50 --patch_size=100

# go back to repo root
cd ..
Expand Down Expand Up @@ -413,4 +414,3 @@ which will indicate that anaconda folder is __/anaconda__. We'll refer to this l




8 changes: 4 additions & 4 deletions contrib/scripts/ablation.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,22 +3,22 @@
source activate seismic-interpretation

# Patch_Size 100: Patch vs Section Depth
python scripts/prepare_dutchf3.py split_train_val patch --data-dir=/mnt/dutch --stride=50 --patch_size=100
python scripts/prepare_dutchf3.py split_train_val patch --data_dir=/mnt/dutch --stride=50 --patch_size=100
python train.py OUTPUT_DIR /data/output/hrnet_patch TRAIN.DEPTH patch TRAIN.PATCH_SIZE 100 --cfg 'configs/hrnet.yaml'
python train.py OUTPUT_DIR /data/output/hrnet_section TRAIN.DEPTH section TRAIN.PATCH_SIZE 100 --cfg 'configs/hrnet.yaml'

# Patch_Size 150: Patch vs Section Depth
python scripts/prepare_dutchf3.py split_train_val patch --data-dir=/mnt/dutch --stride=50 --patch_size=150
python scripts/prepare_dutchf3.py split_train_val patch --data_dir=/mnt/dutch --stride=50 --patch_size=150
python train.py OUTPUT_DIR /data/output/hrnet_patch TRAIN.DEPTH patch TRAIN.PATCH_SIZE 150 --cfg 'configs/hrnet.yaml'
python train.py OUTPUT_DIR /data/output/hrnet_section TRAIN.DEPTH section TRAIN.PATCH_SIZE 150 --cfg 'configs/hrnet.yaml'

# Patch_Size 200: Patch vs Section Depth
python scripts/prepare_dutchf3.py split_train_val patch --data-dir=/mnt/dutch --stride=50 --patch_size=200
python scripts/prepare_dutchf3.py split_train_val patch --data_dir=/mnt/dutch --stride=50 --patch_size=200
python train.py OUTPUT_DIR /data/output/hrnet_patch TRAIN.DEPTH patch TRAIN.PATCH_SIZE 200 --cfg 'configs/hrnet.yaml'
python train.py OUTPUT_DIR /data/output/hrnet_section TRAIN.DEPTH section TRAIN.PATCH_SIZE 200 --cfg 'configs/hrnet.yaml'

# Patch_Size 250: Patch vs Section Depth
python scripts/prepare_dutchf3.py split_train_val patch --data-dir=/mnt/dutch --stride=50 --patch_size=250
python scripts/prepare_dutchf3.py split_train_val patch --data_dir=/mnt/dutch --stride=50 --patch_size=250
python train.py OUTPUT_DIR /data/output/hrnet_patch TRAIN.DEPTH patch TRAIN.PATCH_SIZE 250 TRAIN.AUGMENTATIONS.RESIZE.HEIGHT 250 TRAIN.AUGMENTATIONS.RESIZE.WIDTH 250 --cfg 'configs/hrnet.yaml'
python train.py OUTPUT_DIR /data/output/hrnet_section TRAIN.DEPTH section TRAIN.PATCH_SIZE 250 TRAIN.AUGMENTATIONS.RESIZE.HEIGHT 250 TRAIN.AUGMENTATIONS.RESIZE.WIDTH 250 --cfg 'configs/hrnet.yaml'

Loading