while trainig (python train.py --task=all) i got error

[ksharm50]

while trainig (python train.py --task=all) i got error

Traceback (most recent call last):
File "train.py", line 250, in
main(args.task)
File "train.py", line 65, in main
import prepare_data_with_valid as dataset
File "C:\delete\shared_f\braintumor\u-net-brain-tumor-master\prepare_data_with
_valid.py", line 351, in
X_train_input = np.asarray(X_train_input, dtype=np.float32)
File "C:\anaconda\lib\site-packages\numpy\core\numeric.py", line 492, in asarr
ay
return array(a, dtype, copy=False, order=order)
MemoryError

how can i solve this one ?
thanks in advance for helping :)

[zsdonghao]

three solutions:

1. find a machine with more memory
2. smaller batch size
3. reimplement the data loading part with tensorflow dataset API

hope it helps.

[ksharm50]

hey :)

1. i have machine with 16gig ram is it enough ?
2. what you mean by batch sie exactly ?
3. where is data loading part exactly ?
   due you mean that i should replace this code .
   if DATA_SIZE == 'all':
   HGG_path_list = tl.files.load_folder_list(path=HGG_data_path)
   LGG_path_list = tl.files.load_folder_list(path=LGG_data_path)
   elif DATA_SIZE == 'half':
   HGG_path_list = tl.files.load_folder_list(path=HGG_data_path)[0:100]# DEBUG WITH SMALL DATA
   LGG_path_list = tl.files.load_folder_list(path=LGG_data_path)[0:30] # DEBUG WITH SMALL DATA
   elif DATA_SIZE == 'small':
   HGG_path_list = tl.files.load_folder_list(path=HGG_data_path)[0:50] # DEBUG WITH SMALL DATA
   LGG_path_list = tl.files.load_folder_list(path=LGG_data_path)[0:20] # DEBUG WITH SMALL DATA

[ksharm50]

Actually i am trying to run you solution with brats2018 dataset .

[miaozhang0525]

I also got this same issue. I found it is not because of batch size, and the error is in nib.load(image_path).get_data(). So, could you tell us use which tensorflow load api could replace this nib load???

[anitchris]

how did you resolve this problem?