You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Destination Connector and version: Custom/Local CSV
Severity: Medium / High
Step where error happened: OutPut file not as expected.
Current Behavior
Tell us what happens.
Trying to pull this data: https://groups.csail.mit.edu/sls/downloads/movie/engtest.bio
Issue faced: Local CSV destination ignoring the empty lines from source. Even after providing "skip_blank_lines: False" in the reader option.
PFB.
Source Data:
B-YEAR right
I-YEAR now
O show
O me
O a
Local CSV destination data:
root@05051086d91a:/weav-data/bio# head -20 _airbyte_raw_Bio_data.csv
"_airbyte_ab_id",_airbyte_emitted_at,_airbyte_data
4100b1ba-b22a-4754-80e4-6d5ab5371efb,1631085587000,"{""col2"":""right"",""col1"":""B-YEAR""}"
6c3972b3-0d0c-4a26-83e8-111040f76318,1631085587000,"{""col2"":""now"",""col1"":""I-YEAR""}"
60e4fa74-139d-4464-b15e-b5089553ecb9,1631085587000,"{""col2"":""show"",""col1"":""O""}"
902547ec-385a-46ee-a527-ecc24179d757,1631085587000,"{""col2"":""me"",""col1"":""O""}"
164c22f4-54e8-4cfa-a9cc-d3c9a31f4eba,1631085587000,"{""col2"":""a"",""col1"":""O""}"
Expected Behavior
Local CSV destination data:
root@05051086d91a:/weav-data/bio# head -20 _airbyte_raw_Bio_data.csv
"_airbyte_ab_id",_airbyte_emitted_at,_airbyte_data
4100b1ba-b22a-4754-80e4-6d5ab5371efb,1631085587000,"{""col2"":""right"",""col1"":""B-YEAR""}"
6c3972b3-0d0c-4a26-83e8-111040f76318,1631085587000,"{""col2"":""now"",""col1"":""I-YEAR""}"
Exxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx,Exxxxxxxxxxxxx,"{""col2"":NaN,""col1"":NaN}"
60e4fa74-139d-4464-b15e-b5089553ecb9,1631085587000,"{""col2"":""show"",""col1"":""O""}"
902547ec-385a-46ee-a527-ecc24179d757,1631085587000,"{""col2"":""me"",""col1"":""O""}"
164c22f4-54e8-4cfa-a9cc-d3c9a31f4eba,1631085587000,"{""col2"":""a"",""col1"":""O""}"
Enviroment
Current Behavior
Tell us what happens.
Trying to pull this data: https://groups.csail.mit.edu/sls/downloads/movie/engtest.bio
Issue faced: Local CSV destination ignoring the empty lines from source. Even after providing "skip_blank_lines: False" in the reader option.
PFB.
Source Data:
B-YEAR right
I-YEAR now
O show
O me
O a
Local CSV destination data:
root@05051086d91a:/weav-data/bio# head -20 _airbyte_raw_Bio_data.csv
"_airbyte_ab_id",_airbyte_emitted_at,_airbyte_data
4100b1ba-b22a-4754-80e4-6d5ab5371efb,1631085587000,"{""col2"":""right"",""col1"":""B-YEAR""}"
6c3972b3-0d0c-4a26-83e8-111040f76318,1631085587000,"{""col2"":""now"",""col1"":""I-YEAR""}"
60e4fa74-139d-4464-b15e-b5089553ecb9,1631085587000,"{""col2"":""show"",""col1"":""O""}"
902547ec-385a-46ee-a527-ecc24179d757,1631085587000,"{""col2"":""me"",""col1"":""O""}"
164c22f4-54e8-4cfa-a9cc-d3c9a31f4eba,1631085587000,"{""col2"":""a"",""col1"":""O""}"
Expected Behavior
Local CSV destination data:
root@05051086d91a:/weav-data/bio# head -20 _airbyte_raw_Bio_data.csv
"_airbyte_ab_id",_airbyte_emitted_at,_airbyte_data
4100b1ba-b22a-4754-80e4-6d5ab5371efb,1631085587000,"{""col2"":""right"",""col1"":""B-YEAR""}"
6c3972b3-0d0c-4a26-83e8-111040f76318,1631085587000,"{""col2"":""now"",""col1"":""I-YEAR""}"
Exxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx,Exxxxxxxxxxxxx,"{""col2"":NaN,""col1"":NaN}"
60e4fa74-139d-4464-b15e-b5089553ecb9,1631085587000,"{""col2"":""show"",""col1"":""O""}"
902547ec-385a-46ee-a527-ecc24179d757,1631085587000,"{""col2"":""me"",""col1"":""O""}"
164c22f4-54e8-4cfa-a9cc-d3c9a31f4eba,1631085587000,"{""col2"":""a"",""col1"":""O""}"
Steps to Reproduce
The text was updated successfully, but these errors were encountered: