Added metadata and correct splits for swda. #1749
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
lhoestq
reviewed
Jan 19, 2021
There was a problem hiding this comment.
Nice thank you !
I left a few comments
Also it looks like the dummy_data.zip file is quite big (1MB), could you try to reduce its size please ?
To do so feel free to take a look inside the zip file and you should see many unused csv files in the swda.zip directory. You can remove all of them except the ones defined by the test/dev/train txt files. For example if there is 3994 in the train_split.txt then you should keep the sw_1319_3994.utt.csv file.
|
I will push updates tomorrow. |
|
@lhoestq thank you for your comments! I went ahead and fixed the code 😃. Please let me know if I missed anything. |
lhoestq
approved these changes
Jan 29, 2021
| * 'pos': (str) The POS tagged version of the utterance, from PtbBasename+.pos | ||
| * 'topic_description': (str) The topic that is being discussed. | ||
| * 'trees': (str) The tree(s) containing this utterance (separated by ||| in the file). Use `[Tree.fromstring(t) | ||
| for t in row_value.split("|||")]` to convert to (list of nltk.tree.Tree). |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Switchboard Dialog Act Corpus
I made some changes following @bhavitvyamalik recommendation in #1678: