Replies: 1 comment
-
My mistake here is that I am blocking based on a feature that has 400K records which creates billions of pairs, that process uses all the memory I have and make the kernel die. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi all,
I am using Record linkage for my data and I have already chosen a small amount of the big data I kve like 20 rows only, Index it and block it based on 2 features.
![image](https://user-images.githubusercontent.com/70524513/226916371-c1bc8613-b174-47a4-890a-787a9b124f91.png)
Then use the compare function to compare the pairs that were created during indexing.
after that, I use compute function just like how the documentation says. It was working well, but out of a sudden, I have this error. I have tried a lot to solve it. but I could not, All libraries and extensions I have been installed well. I restart the kernel and the code work well until it goes to the cell where compute function will execute, and be crushed again.
I am using Jupiter notebook on vs code.
So do you have any idea on how to solve this issue?
Beta Was this translation helpful? Give feedback.
All reactions