Reduce memory and time needed for sample_concordance_plink.#362

Merged

jaamarks merged 11 commits intodefaultfrom sample_concordance_efficiency

Dec 11, 2024

+105-33

Commits on Nov 27, 2024

Implements a faster _sort_ids within read_genome from parsers.plink.
rajwanir2
committed
Not reading cols FIID1 and FIID2 in read_genome since they are dropped immediately.
rajwanir2
committed
Uses memory efficient dtypes in read_genome.
rajwanir2
committed
Only loads required_cols from genome to construct concordance_table.
rajwanir2
committed
uses memory efficient dtypes for concordance_table.
rajwanir2
committed
Reduces memory usage in concordance_table by processing .genome file in chunks.
rajwanir2
committed

Commits on Nov 29, 2024

Downgrades the resources needed for sample_concordance_plink based on revised concordance_table.py.
rajwanir2
committed

Commits on Dec 11, 2024

Adds the missing paranthesis to unlink method in concordance_table.py
rajwanir2
committed
docs: updates docstring for read_genome.
rajwanir2
committed
Revises chunk_size in read_genome to 100000.
rajwanir2
committed
docs: corrects the read_genome doctring that it reads IID1,IID2 not ID1,ID2.
rajwanir2
committed