Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add handling for corrupted rows in Readers e.g. enum property onBadLines with options ERROR, WARN or SKIP #80

Open
anna-geller opened this issue Jan 9, 2024 · 1 comment
Assignees
Labels
area/backend Needs backend code changes area/plugin Plugin-related issue or feature request enhancement New feature or request good first issue Great issue for new contributors
Milestone

Comments

@anna-geller
Copy link
Member

Feature description

in pandas, there is a "on_bad_lines" property:

on_bad_lines{‘error’, ‘warn’, ‘skip’}, default ‘error’
Specifies what to do upon encountering a bad line (a line with too many fields). Allowed values are :

'`error`', raise an Exception when a bad line is encountered.

'`warn`', raise a warning when a bad line is encountered and skip that line.

'`skip`', skip bad lines without raising or warning when they are encountered.

It's worth adding an enum property onBadLines with options ERROR, WARN or SKIP to all Readers to allow a more configurable handling of bad lines.

@anna-geller anna-geller added the enhancement New feature or request label Jan 9, 2024
@anna-geller anna-geller modified the milestones: v0.16.0, v0.20.0 Jan 9, 2024
@github-project-automation github-project-automation bot moved this to Backlog in Issues Jun 10, 2024
@anna-geller anna-geller added area/plugin Plugin-related issue or feature request area/backend Needs backend code changes labels Aug 19, 2024
@anna-geller anna-geller added the good first issue Great issue for new contributors label Oct 10, 2024
@Sinon11901
Copy link

I would like to be asigned to this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/backend Needs backend code changes area/plugin Plugin-related issue or feature request enhancement New feature or request good first issue Great issue for new contributors
Projects
Status: Backlog
Development

No branches or pull requests

2 participants