This repository has been archived by the owner on Nov 8, 2023. It is now read-only.

feat: Native CSV Parser#1

Closed

HollowMan6 wants to merge 54 commits intomasterfrom csv

+1,464-12

Commits on Jul 27, 2022

feat: A primitive CSV parser
HollowMan6
committed
feat: make csv parser configurable
HollowMan6
committed
feat: allow to use quotes to specify feature values as strings instead of judge only based on the content
HollowMan6
committed
Fix according to change requests
HollowMan6
committed
Remove feature name when no header exists
HollowMan6
committed
feat: Support namespace with special header format
HollowMan6
committed
feat: Add option to specify the namespace info value
HollowMan6
committed
feat: Add support for various label type
HollowMan6
committed
Add CSV parser test cases
HollowMan6
committed
Move separator check under options parsing
HollowMan6
committed
feat: Only check outer quotes; support specify \t as tabs for separator
HollowMan6
committed
Revert auto-converting multi-class labels; Add warnings when CSV namespace and field separator are the same; Remove error thrown when quotes not pairing
HollowMan6
committed
Comment out quotes removing; Change warning into error for ns and field separator being the same
HollowMan6
committed
Add support for tags; Support assigning multi columns for labels as well as multilabels; Add --csv_remove_quotes for auto removing outer quotes
HollowMan6
committed
Skip the empty cells when parsing for labels
HollowMan6
committed
Polish help info
HollowMan6
committed
Move options to parser
HollowMan6
committed
Enable auto detect the header
HollowMan6
committed
Use input_parser interface
HollowMan6
committed
Move options parsing logic
HollowMan6
committed
Move parser_options definition
HollowMan6
committed
Clean up
HollowMan6
committed
Implement quotes support
HollowMan6
committed
Diminish options and use special headers to represent
HollowMan6
committed
Add _weight for Multiclass special header
HollowMan6
committed
simplify
HollowMan6
committed
remove unused check_if_int
HollowMan6
committed
Restrict quoting only at the start and end of the cell
HollowMan6
committed
Consider empty feature value as feature not exists
HollowMan6
committed
Add support for parsing multiline examples; Fix Bugs when last cell is empty
HollowMan6
committed
also a new line when all the cells in the line is empty
HollowMan6
committed
Add line counter for the error msg
HollowMan6
committed
Refactor tests
HollowMan6
committed
Support multi files as input; Fix handling input
HollowMan6
committed
Add Codecov support for csv
HollowMan6
committed
Fulfill the complex csv simple label test
HollowMan6
committed
Add test for multiple files
HollowMan6
committed
Add test for multiclass label
HollowMan6
committed
Add error thrown tests
HollowMan6
committed
Add multiline examples tests
HollowMan6
committed
Make multicharacter separator an error; Revert newline support
HollowMan6
committed
Add warning if _label is missing
HollowMan6
committed
Reduce the float parsing times
HollowMan6
committed
Remove unnecessary find options
HollowMan6
committed
Use force inline to improve performance
HollowMan6
committed
Use VW::v_array<VW::string_view>
HollowMan6
committed
Suppress a class-memaccess warning
HollowMan6
committed
Clean up
HollowMan6
committed
Add more comments to the test
HollowMan6
committed
Use unordered map
HollowMan6
committed
Allow overriding headers and specifying namespace values
HollowMan6
committed
change option csv_no_header into csv_no_file_header
HollowMan6
committed
Polish the ns value feature
HollowMan6
committed
Add tutorial for the iris CSV dataset
HollowMan6
committed