Release data on Hugging Face

[NielsRogge]

Hi @Wusiwei0410,

Niels here from the open-source team at Hugging Face. I discovered your work through the daily papers on Hugging Face: https://huggingface.co/papers/2410.13639. The paper page lets people discuss about your paper and lets them find artifacts about it (your data for instance) you can also claim the paper as yours which will show up on your public profile at HF.

It'd be great to make the data available on the 🤗 hub, we can add tags so that people find them when filtering https://huggingface.co/datasets, so that people can do:

from datasets import load_dataset

dataset = load_dataset("your-hf-username-or-organization/your-dataset")

See here for a guide: https://huggingface.co/docs/datasets/loading#json.

There's then also the dataset viewer which allows people to see the first few rows in the browser: https://huggingface.co/docs/hub/en/datasets-viewer.

This would make the dataset easier accessible, and also discoverable. We can then also link the dataset to the paper page.

Let me know if you're interested/need any help!

Kind regards,

Niels

[Wusiwei0410]

Hi @NielsRogge ,

Thank you so much for your attention to our work and for the valuable suggestions you've provided.

I have already claimed the paper on Hugging Face.

As for uploading the dataset to Hugging Face Datasets, I will organize the data and upload it to Hugging Face soon.
I'll also include instructions in this repo on how to load the data, and I'll notify you once we upload it on HF.

Best regards,
Siwei

[Wusiwei0410]

Hi @NielsRogge ,

We have uploaded the benchmarks we use to the HF dataset. The following code can be used it:

from datasets import load_dataset
data = load_dataset('SiweiWu/o1_Reasoning_Patterns_Study')

However, apart from the text data, Collie also provides functions in a special format that can be directly used to evaluate the generated responses of LLMs, but it cannot be uploaded to the HF dataset. Therefore, for the Collie dataset, we still suggest that you load the data from the GitHub folder data.

[NielsRogge]

Awesome! I've opened https://huggingface.co/datasets/SiweiWu/o1_Reasoning_Patterns_Study/discussions/1 to link it to the paper page :)

[Wusiwei0410]

Thanks!

[NielsRogge]

Note: you still need to merge the PR linked above :)