10_get_99plus-features-raw , def collect_admissions_with_more_than_hrs(hrs):

[safynaz]

Dear,
when i run function def collect_admissions_with_more_than_hrs(hrs): in 10_get_99plus-features-raw notebook, for 24 & 48 hours, It took long time to run more than 3 days after that it get the following error:

**

MemoryError Traceback (most recent call last)
in
60 # >= 24hrs
61 #collect_admissions_with_more_than_hrs(24)
---> 62 collect_admissions_with_more_than_hrs(48)

in collect_admissions_with_more_than_hrs(hrs)
52 adm_labels_all = [r[4] for r in collec]
53
---> 54 np.save(os.path.join(HRDIR, 'DB_merged_%dhrs.npy' % hrs), data_all)
55 np.save(os.path.join(HRDIR, 'ICD9-%dhrs.npy' % hrs), label_icd9_all)
56 np.save(os.path.join(HRDIR, 'AGE_LOS_MORTALITY_%dhrs.npy' % hrs), label_mor_all)

~\Anaconda3\envs\py3\lib\site-packages\numpy\lib\npyio.py in save(file, arr, allow_pickle, fix_imports)
527 arr = np.asanyarray(arr)
528 format.write_array(fid, arr, allow_pickle=allow_pickle,
--> 529 pickle_kwargs=pickle_kwargs)
530 finally:
531 if own_fid:

~\Anaconda3\envs\py3\lib\site-packages\numpy\lib\format.py in write_array(fp, array, version, allow_pickle, pickle_kwargs)
627 if pickle_kwargs is None:
628 pickle_kwargs = {}
--> 629 pickle.dump(array, fp, protocol=2, **pickle_kwargs)
630 elif array.flags.f_contiguous and not array.flags.c_contiguous:
631 if isfileobj(fp):

MemoryError:

**
Although i have space in my pc, but i have this problem.
please tell me what is the problem & how i can solve it.
Also, please tell me what are the pc requirements to run your benchmark , because every cell in your notebooks take me long time.
thanks alot

[mengcz13]

We have replaced the notebooks with one preprocessing script. See #21 . It has optimized the running speed: with 4 cores it should finish within 1 day.