Error: Can't pickle generator

[yogeshhk]

On Windows 10, with Python 3.6.5, getting error on running

tf2_gnn_train RGCN PPI --max-epochs 10 data/ppi/

log is:

2021-06-10 18:44:04.837559: W tensorflow/core/framework/op_kernel.cc:1755] Invalid argument: TypeError: cannot pickle 'generator' object
Traceback (most recent call last):

  File "C:\Users\yogesh.kulkarni\AppData\Local\Continuum\anaconda3\envs\tf2\lib\site-packages\tensorflow\python\data\ops\dataset_ops.py", line 789, in get_iterator
    return self._iterators[iterator_id]

KeyError: 0

Any resolution?

[mmjb]

Could you tell what Tensorflow version you were using?

[yogeshhk]

tensorflow 2.5
Python 3.8.8
CPU

[lh98cool]

I faced the same problem, how to fix it bro?

[yogeshhk]

@lh98cool: did not find any solution yet.

[097475]

Any updates?

[097475]

I have found a temporary fix for this issue.
In file graph_dataset.py, line 294, make a list out of self.graph_batch_iterator(data_fold)
E.g. it should look like something like this:
if use_worker_threads: graph_batch_iterator = lambda: DoubleBufferedIterator( list(self.graph_batch_iterator(data_fold)) )

Alternatively, disable multithreding by setting use_worker_threads to False in line 79.

[NipunaChhabra]

I got the same error on mac(Big Sur), but it worked on Colab so for now I'm using that.