DRILL-7978: Fixed Width Format Plugin#2282

Draft

MFoss19 wants to merge 46 commits intoapache:masterfrom MFoss19:format-fixedwidth

+1,129

Commits on Mar 10, 2022

Start of fixed width format plugin
Megan Foss
committed
Work in Progress. Producing Rows. Currently complains about buffer not being de-allocated.
Megan Foss
committed
First working version
Megan Foss
committed
Added more data types, refactored code
Megan Foss
committed
Checkstyle fixes
Megan Foss
committed
Removed println statement from Batch Reader, Simplified logic
Megan Foss
committed
Modified format, fixed maxRecords in next(), modified Exception handling in Batch Reader
Megan Foss
committed
Addressing Review Comments.
Megan Foss
committed
Added Serialization/Deserialization test, added blank row test file, cleaned up compressed file test
Megan Foss
committed
Fixed Serialization/Deserialization test
Megan Foss
committed
Added another constructor to enable user to not have to enter dateTimeFormat when not appropriate, started adding methods to perform field name verification (not complete).
Megan Foss
committed
Added method to validate field name input and verify there are no duplicates. Modified tests to enable testing of new constructor.
Megan Foss
committed
Added two getters to FixedwidthFormatConfig to prep for offset verification
Megan Foss
committed
Added a check for overlapping fields

estherbuchwalter
authored and
Megan Foss
committed
Updated check for overlapping fields

estherbuchwalter
authored and
Megan Foss
committed
Added field validation for data types, indices, width. Includes creating two setters in field config to set default value for data types and calculate/set width based on indices.
Megan Foss
committed
Modified validation for field width and field index. Added comments to code.
Megan Foss
committed
Added to field validation for field names. Checks for valid length and valid SQL syntax.

estherbuchwalter
authored and
Megan Foss
committed
WIP converting to EVF v2. Pushing to repo for troubleshooting purposes.
Megan Foss
committed

Commits on Mar 22, 2022

Start of fixed width format plugin
Megan Foss
committed
Work in Progress. Producing Rows. Currently complains about buffer not being de-allocated.
Megan Foss
committed
First working version
Megan Foss
committed
Added more data types, refactored code
Megan Foss
committed
Checkstyle fixes
Megan Foss
committed
Removed println statement from Batch Reader, Simplified logic
Megan Foss
committed
Modified format, fixed maxRecords in next(), modified Exception handling in Batch Reader
Megan Foss
committed
Addressing Review Comments.
Megan Foss
committed
Added Serialization/Deserialization test, added blank row test file, cleaned up compressed file test
Megan Foss
committed
Fixed Serialization/Deserialization test
Megan Foss
committed
Added another constructor to enable user to not have to enter dateTimeFormat when not appropriate, started adding methods to perform field name verification (not complete).
Megan Foss
committed
Added method to validate field name input and verify there are no duplicates. Modified tests to enable testing of new constructor.
Megan Foss
committed
Added two getters to FixedwidthFormatConfig to prep for offset verification
Megan Foss
committed
Added a check for overlapping fields

estherbuchwalter
authored and
Megan Foss
committed
Updated check for overlapping fields

estherbuchwalter
authored and
Megan Foss
committed
Added field validation for data types, indices, width. Includes creating two setters in field config to set default value for data types and calculate/set width based on indices.
Megan Foss
committed
Modified validation for field width and field index. Added comments to code.
Megan Foss
committed
Added to field validation for field names. Checks for valid length and valid SQL syntax.

estherbuchwalter
authored and
Megan Foss
committed
WIP converting to EVF v2. Pushing to repo for troubleshooting purposes.
Megan Foss
committed
Updating pom.xml with new drill snapshot version
Megan Foss
committed
Merge branch 'apache:master' into format-fixedwidth
MFoss19
authored
Renamed classes
tswagger
committed
Merge branch 'master' into format-fixedwidth
tswagger
committed
Merge remote-tracking branch 'megan/format-fixedwidth' into format-fixedwidth
tswagger
committed
Merge branch 'format-fixedwidth' of github.com:MFoss19/drill into format-fixedwidth
Megan Foss
committed
Merge branch 'format-fixedwidth' of github.com:MFoss19/drill into format-fixedwidth
Megan Foss
committed
Updated pom.xml
tswagger
committed