Restore legacy table and adopt EuiDataGrid into Discover as an Option

[ananzh]

In version 2.11, we transitioned from the legacy HTML table to EuiDataGrid in Discover, leading to a substantial amount of user feedback. Recognizing the importance of issue #5555 and to ensure a seamless experience for our users, we plan to revert the legacy table as the default option temporarily. However, it's crucial to discuss the benefits of adopting EuiDataGrid with the community for future releases. We acknowledge the diverse use cases and intricacies of Discover. By documenting these user interactions, we aim to gradually incorporate them into functional tests, ensuring a smooth transition in future updates. This approach not only addresses immediate user needs but also prepares us for a more robust and user-friendly evolution of Discover.

Analysis

Pros

Improved Performance with EuiDataGrid

EuiDataGrid is optimized for handling large datasets efficiently, crucial for data-intensive applications. It leverages modern web technologies for better performance and scalability.

Enhanced Interactivity

• Column Resizing (#1500): Resolved a highly requested feature for dynamic column resizing.
• Clear Sorting Indicators (#4843): Offered more intuitive sorting with distinct options, enhancing usability.
  • In the previous version of the Discover table, the sorting mechanism was indicated by up and down arrows, which would disappear if a column was not sortable. This design lacked clarity. The new system with EuiDataGrid improves this by introducing explicit 'Sort A-Z' and 'Sort Z-A' options. These options are visually clearer, as non-sortable fields are greyed out, making it more obvious to users. This new approach also opens the possibility for future customizations based on data types, enhancing user experience in sorting data.
• Configurable Rows per Page (#5569): Fulfilled the request for customizable rows display, adding flexibility.

Resolvable Customer Requests (Customizability)

Provides options for tailored user experiences, meeting diverse data exploration needs.

• Full-Screen Mode (#4824): The potential to implement a full-screen mode for better data observation.
• Adjustable Line Width (#5227, #4859, #5404): Addresses the need for customizable line width, offering more control to users.
  • Enhancing the Discover table with EuiDataGrid's rowHeightsOption offers significant flexibility and control over row height settings. This feature addresses feedback from users who want the ability to adjust line width for better data display. With rowHeightsOption, users can set a single line height to display more data in one page, opt for auto-fit (similar to the legacy table), or customize it according to their preferences. This adaptability not only resolves certain user concerns but also opens up new possibilities for future customization, demonstrating the potential of EuiDataGrid to evolve and better meet diverse user needs.
• Savable Column Width (#5524): Allows save column width settings, aligning with user preferences. Similar feature is already implemented in table vis.
• Enhanced Copy/Paste Functionality (#5570): Allows export data as table or csv. Improves data export options for users. Similar feature is already implemented in table vis.

Consistent UI/UX:

Aligns with modern design standards, ensuring a cohesive and user-friendly interface across the platform, including discover, table visualization, plugins and other developer usages.

Resolved Technical Debt

Eliminates outdated dependencies like jQuery (3658), KUI (3385) enhancing code quality and future-proofing the application.

Cons

This adoption will cause Regression and some Missing Functionalities.

Acknowledges the need to address one missing feature: multiple document expansion for a complete user experience (5555). This one is not solvable in EuiDataGrid and would need more designs and research.

Action Items

• Implement Legacy Table as Default: Temporarily reintroduce the legacy table to ensure all functionalities are available. #5715
• Allow switch between legacy table and EuiDataGrid: Add an option to enable or disable the EuiDataGrid (2.11 table) for user preference. #5716
• Expand Functional Tests: Develop comprehensive tests to cover new functionalities and user feedback, ensuring robustness. Tracking issue is #5713.
• Conduct Manual Tests on all Missing Functionalities: Prioritize adding back essential features like multiple document expansion to match legacy capabilities.