Add chunking to ds_tool

[liPatrick]

Adding chunking to ds_tool so it is more resilient to processing/upload failures for larger datasets.

Dynamically chunks dataset to process and upload. Failed chunks get reprocessed into smaller chunks and recursively go through the same process. Repeated until the chunk_split_threshold is reached, then it gets uploaded as is.

Note:
Push_to_hub automatically shards chunks into roughly 500mb. So in huggingface there will be a chunk and shard denominator, but we can just use a wildcard to set the path for our splits in the README, ie subset_name/split_name/**

[farzadab]

Loved the DatasetChunkProcessor abstraction. It cleanly separates the concerns without increasing complexity in other areas of the code.

I left too many nit comments, feel free to ignore most, but 2 3 comments are very important:

1. I feel like _upload would rewrite the whole set which is not desired and
2. I didn't fully see the "recursive" logic that I thought you mentioned in TGIF. I expected a different approach there.
3. Make sure dataset.py can handle the Error classes gracefully.

[farzadab]

Thanks Pat.
Left some comments, but approved to unblock you.