-
-
Notifications
You must be signed in to change notification settings - Fork 652
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding download all messages feature #1628
Conversation
I will have to take into account the endTimestamp filter in the new download endpoint if #1629 is merged before |
@AlexisSouquiere your PR #1629 is merged before, sorry 😅 |
@AlexisSouquiere you want to add extra commit on that one to handle |
It's fine for me I took into account the new filter on the download endpoint :) |
@tchiotludo @AlexisSouquiere This commit added a @JsonIgnore to Topic field of Record , this is breaking the tail functionality |
@arindampatra33 thanks for the alert. I will check and fix it |
@AlexisSouquiere its failing with below error in the UI when its trying to read topic.name Tail.jsx:398 Uncaught TypeError: Cannot read properties of undefined (reading 'name') |
@AlexisSouquiere If you added it just to have lesser number of columns in the downloaded data , you can create a new model and populate. from Record data |
Fix #1487
Tested locally with a topic of 600K records, downloaded a 220Mb file in less than 1min
Downloaded file format is the following:
With Avro messages
With Tombstone
Feedback is appreciated 😄