Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update conformance test data to latest #475

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

jpschorr
Copy link
Contributor

@jpschorr jpschorr commented Jul 9, 2024


By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Copy link

codecov bot commented Jul 9, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 81.01%. Comparing base (a54868e) to head (d4fa4f0).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #475      +/-   ##
==========================================
- Coverage   81.18%   81.01%   -0.18%     
==========================================
  Files          67       67              
  Lines       18563    18563              
  Branches    18563    18563              
==========================================
- Hits        15070    15038      -32     
- Misses       3051     3081      +30     
- Partials      442      444       +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link

github-actions bot commented Jul 9, 2024

Conformance comparison report

Base (a54868e) e122fc6 +/-
% Passing 90.35% 87.81% -2.54%
✅ Passing 5731 5591 -140
❌ Failing 612 776 164
🔶 Ignored 0 0 0
Total Tests 6343 6367 24

Number passing in both: 5589

Number failing in both: 608

Number passing in Base (a54868e) but now fail: 142

Number failing in Base (a54868e) but now pass: 0

⁉️ CONFORMANCE REPORT REGRESSION DETECTED ⁉️. The following test(s) were previously passing but now fail:

Click here to see
  • partiql_tests::eval::query::order_by::order_by::data_types::permissive_should_order_data_types_by_the_specifications_nulls_should_be_first_due_to_nulls_spec
  • partiql_tests::eval::query::order_by::order_by::simple::strict_group_and_order_by_asc_nulls_last_as_default
  • partiql_tests::eval::primitives::operators::operators::bag_operators::bag_operators::permissive_outer_except_distinct
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_count_1_as_the_count_sum_p_price_missings_as_the_agg_from_products_sparse_as_p
  • partiql_tests::eval::query::group_by::group_by::group_by::group_by_test::strict_select_region_id_supplier_id_missings_from_products_sparse_p_group_by_p_region_id_p_supplier_id_missings
  • partiql_tests::eval::query::group_by::group_by::group_by::group_by_test::strict_select_p_region_id_p_supplier_id_missings_from_products_sparse_p_group_by_p_region_id_p_supplier_id_missings
  • partiql_tests::eval::query::order_by::order_by::simple::strict_group_and_order_by_asc_and_place_nulls_first
  • partiql_tests::eval::query::order_by::order_by::data_types::strict_should_order_data_types_by_the_specifications_nulls_should_be_last_due_to_nulls_spec
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_count_1_as_the_count_avg_p_price_mixed_as_the_agg_from_products_sparse_as_p
  • partiql_tests::eval::spec_tests::section_6::strict_bag_element_evaluates_to_missing_in_bag_constructor
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_lists_compared_lexicographically_based_on_comparison_of_elements_desc
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_count_1_as_the_count_min_p_price_mixed_as_the_agg_from_products_sparse_as_p
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_bags_compared_as_sorted_lists_asc
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_p_category_id_count_1_as_the_count_avg_p_price_missings_as_the_agg_from_products_sparse_as_p_group_by_p_category_id
  • partiql_tests::eval::misc::uncategorized::strict_select_value_struct_constructor_with_missing
  • partiql_tests::eval::spec_tests::section_6::strict_bag_element_evaluates_to_missing
  • partiql_tests::eval::spec_tests::section_6::strict_array_element_evaluates_to_missing
  • partiql_tests::eval::query::group_by::group_by::group_by::group_by_test::strict_select_supplier_id_mixed_from_products_sparse_p_group_by_p_supplier_id_mixed
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_lists_compared_lexicographically_based_on_comparison_of_elements_desc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_text_types_compared_by_lexicographical_ordering_of_unicode_scalar_desc
  • partiql_tests::eval::query::order_by::order_by::simple::strict_supplier_id_nulls_asc_nulls_last_product_id_asc
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_count_1_as_the_count_min_p_price_missings_as_the_agg_from_products_sparse_as_p
  • partiql_tests::eval::query::order_by::order_by::simple::strict_group_and_order_by_desc_seller_id
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_bags_compared_as_sorted_lists_asc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_inf_before_numeric_values_then_inf_then_nan_desc
  • partiql_tests::eval::query::undefined_variable_behavior::undefined_variable_behavior::undefined_variable_behavior::strict_undefined_unqualified_variable_in_select_with_undefined_variable_behavior_missing
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_empty_output_ordered
  • partiql_tests::eval::query::select::select::sql_aggregate::sql_any::strict_any_with_group_by
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_structs_should_be_ordered_by_data_types_asc_nulls_last_as_default_for_asc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_structs_compared_lexicographically_first_by_key_then_by_value_asc
  • partiql_tests::eval::query::order_by::order_by::simple::strict_nulls_first_for_supplier_id_nulls_desc
  • partiql_tests::eval::query::select::select::sql_aggregate::sql_some::strict_some_with_group_by
  • partiql_tests::eval::query::select::select::select::select_list_item::strict_select_list_with_missing
  • partiql_tests::eval::query::order_by::order_by::simple::permissive_price_desc_product_id_asc
  • partiql_tests::eval::query::order_by::order_by::simple::strict_group_and_place_nulls_last_asc_as_default
  • partiql_tests::eval::spec_tests::section_6::strict_attribute_value_evaluates_to_missing
  • partiql_tests::eval::query::group_by::group_by::group_by::group_by_test::strict_select_region_id_p_supplier_id_mixed_from_products_sparse_p_group_by_p_region_id_p_supplier_id_mixed
  • partiql_tests::eval::query::select::select::projection::projection_iteration_behavior_unfiltered::strict_undefined_unqualified_variable_in_select_with_projection_option
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_lob_types_follow_their_lexicographical_ordering_by_octet_asc
  • partiql_tests::eval::query::select::select::from_clause::various_types_in_from_clause::strict_range_over_bag_with_at
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_shorter_array_comes_first_asc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_structs_should_be_ordered_by_data_types_desc_nulls_first_as_default_for_desc
  • partiql_tests::eval::query::order_by::order_by::simple::permissive_nulls_last_for_supplier_id_nulls_desc
  • partiql_tests::eval::query::order_by::order_by::simple::permissive_supplier_id_nulls_nulls_last
  • partiql_tests::eval::query::select::select::sql_aggregate::sql_every::strict_every_with_group_by
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_lists_items_should_be_ordered_by_data_types_asc_nulls_last_as_default_for_asc
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_category_id_count_1_as_the_count_count_p_price_missings_as_the_agg_from_products_sparse_as_p_group_by_category_id
  • partiql_tests::eval::query::order_by::order_by::data_types::strict_should_order_data_types_by_the_specifications_nulls_last_default_for_asc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_lob_types_should_ordered_desc
  • partiql_tests::eval::query::select::select::sql_aggregate::sql_every::strict_every_distinct_with_group_by
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_lists_compared_lexicographically_based_on_comparison_of_elements_asc
  • partiql_tests::eval::query::order_by::order_by::simple::permissive_group_and_order_by_asc_seller_id
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_category_id_count_1_as_the_count_sum_p_price_missings_as_the_agg_from_products_sparse_as_p_group_by_category_id
  • partiql_tests::eval::query::order_by::order_by::simple::strict_nulls_last_for_supplier_id_nulls_desc
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_p_category_id_count_1_as_the_count_min_p_price_missings_as_the_agg_from_products_sparse_as_p_group_by_p_category_id
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_longer_array_comes_first_desc
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_count_1_as_the_count_max_p_price_missings_as_the_agg_from_products_sparse_as_p
  • partiql_tests::eval::query::order_by::order_by::simple::permissive_group_and_order_by_desc_seller_id
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_structs_compared_lexicographically_first_by_key_then_by_value_desc
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_category_id_count_1_as_the_count_sum_p_price_mixed_as_the_agg_from_products_sparse_as_p_group_by_category_id
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_p_category_id_count_1_as_the_count_sum_p_price_mixed_as_the_agg_from_products_sparse_as_p_group_by_p_category_id
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_count_1_as_the_count_count_p_price_mixed_as_the_agg_from_products_sparse_as_p
  • partiql_tests::eval::query::order_by::order_by::simple::permissive_nulls_first_as_default_for_supplier_id_nulls_desc
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_category_id_count_1_as_the_count_avg_p_price_mixed_as_the_agg_from_products_sparse_as_p_group_by_category_id
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_category_id_count_1_as_the_count_min_p_price_mixed_as_the_agg_from_products_sparse_as_p_group_by_category_id
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_nan_before_inf_then_numeric_values_then_inf_asc
  • partiql_tests::eval::query::group_by::group_by::group_by::group_by_test::strict_select_p_supplier_id_missings_from_products_sparse_p_group_by_p_supplier_id_missings
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_p_category_id_count_1_as_the_count_count_p_price_mixed_as_the_agg_from_products_sparse_as_p_group_by_p_category_id
  • partiql_tests::eval::query::order_by::order_by::data_types::permissive_should_order_data_types_by_the_specifications_nulls_last_default_for_asc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_nan_before_inf_then_numeric_values_then_inf_asc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_text_types_compared_by_lexicographical_ordering_of_unicode_scalar_desc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_lists_compared_lexicographically_based_on_comparison_of_elements_asc
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_count_1_as_the_count_max_p_price_mixed_as_the_agg_from_products_sparse_as_p
  • partiql_tests::eval::query::order_by::order_by::simple::permissive_col_1_desc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_true_before_false_desc
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_count_1_as_the_count_count_p_price_missings_as_the_agg_from_products_sparse_as_p
  • partiql_tests::eval::query::order_by::order_by::simple::strict_supplier_id_nulls_nulls_last
  • partiql_tests::eval::query::order_by::order_by::simple::permissive_group_and_place_nulls_first_asc_as_default
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_empty_output_ordered
  • partiql_tests::eval::query::order_by::order_by::simple::permissive_col_1_asc_col_2_asc
  • partiql_tests::eval::query::group_by::group_by::group_by::group_by_test::strict_select_p_supplier_id_mixed_from_products_sparse_p_group_by_p_supplier_id_mixed
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_inf_before_numeric_values_then_inf_then_nan_desc
  • partiql_tests::eval::query::order_by::order_by::data_types::strict_should_order_data_types_by_the_specifications_nulls_should_be_first_due_to_nulls_spec
  • partiql_tests::eval::query::order_by::order_by::simple::strict_group_and_order_by_desc_nulls_first_as_default
  • partiql_tests::eval::query::select::select::from_clause::path_in_from_clause::strict_ordinal_access_with_negative_index
  • partiql_tests::eval::query::order_by::order_by::simple::strict_group_and_place_nulls_first_asc_as_default
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_structs_compared_lexicographically_first_by_key_then_by_value_desc
  • partiql_tests::eval::query::order_by::order_by::data_types::permissive_should_order_data_types_by_the_specifications_nulls_first_default_for_desc
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_category_id_count_1_as_the_count_count_p_price_mixed_as_the_agg_from_products_sparse_as_p_group_by_category_id
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_p_category_id_count_1_as_the_count_count_p_price_missings_as_the_agg_from_products_sparse_as_p_group_by_p_category_id
  • partiql_tests::eval::query::select::select::sql_aggregate::sql_some::strict_some_distinct_with_group_by
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_lists_items_should_be_ordered_by_data_types_asc_nulls_last_as_default_for_asc
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_p_category_id_count_1_as_the_count_sum_p_price_missings_as_the_agg_from_products_sparse_as_p_group_by_p_category_id
  • partiql_tests::eval::query::order_by::order_by::simple::permissive_supplier_id_nulls_asc_nulls_last_product_id_asc
  • partiql_tests::eval::query::order_by::order_by::simple::permissive_group_and_order_by_asc_and_place_nulls_first
  • partiql_tests::eval::primitives::operators::operators::bag_operators::bag_operators::strict_outer_except_distinct
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_count_1_as_the_count_sum_p_price_mixed_as_the_agg_from_products_sparse_as_p
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_count_1_as_the_count_avg_p_price_missings_as_the_agg_from_products_sparse_as_p
  • partiql_tests::eval::query::order_by::order_by::simple::strict_price_desc_product_id_asc
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_p_category_id_count_1_as_the_count_min_p_price_mixed_as_the_agg_from_products_sparse_as_p_group_by_p_category_id
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_category_id_count_1_as_the_count_min_p_price_missings_as_the_agg_from_products_sparse_as_p_group_by_category_id
  • partiql_tests::eval::query::order_by::order_by::simple::strict_group_and_order_by_asc_seller_id
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_p_category_id_count_1_as_the_count_avg_p_price_mixed_as_the_agg_from_products_sparse_as_p_group_by_p_category_id
  • partiql_tests::eval::query::order_by::order_by::data_types::strict_should_order_data_types_by_the_specifications_nulls_first_default_for_desc
  • partiql_tests::eval::query::order_by::order_by::simple::strict_supplier_id_nulls_nulls_first
  • partiql_tests::eval::query::order_by::order_by::simple::strict_col_1_asc_col_2_asc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_false_before_true_asc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_structs_should_be_ordered_by_data_types_desc_nulls_first_as_default_for_desc
  • partiql_tests::eval::query::order_by::order_by::simple::permissive_group_and_order_by_asc_nulls_last_as_default
  • partiql_tests::eval::query::group_by::group_by::group_by::group_by_test::strict_select_supplier_id_missings_from_products_sparse_p_group_by_p_supplier_id_missings
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_bags_compared_as_sorted_lists_desc
  • partiql_tests::eval::query::select::select::from_clause::path_in_from_clause::strict_ordinal_access_with_negative_index_and_bindings
  • partiql_tests::eval::query::order_by::order_by::simple::permissive_col_1_asc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_bags_compared_as_sorted_lists_desc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_lists_items_should_be_ordered_by_data_types_desc_nulls_first_as_default_for_desc
  • partiql_tests::eval::query::order_by::order_by::simple::permissive_group_and_order_by_desc_nulls_first_as_default
  • partiql_tests::eval::query::order_by::order_by::simple::strict_nulls_first_as_default_for_supplier_id_nulls_desc
  • partiql_tests::eval::query::order_by::order_by::simple::permissive_nulls_first_for_supplier_id_nulls_desc
  • partiql_tests::eval::query::group_by::group_by::group_by::group_by_test::strict_select_region_id_supplier_id_mixed_from_products_sparse_p_group_by_p_region_id_p_supplier_id_mixed
  • partiql_tests::eval::query::select::select::sql_aggregate::sql_any::strict_any_distinct_with_group_by
  • partiql_tests::eval::query::order_by::order_by::data_types::permissive_should_order_data_types_by_the_specifications_nulls_should_be_last_due_to_nulls_spec
  • partiql_tests::eval::query::order_by::order_by::simple::permissive_supplier_id_nulls_nulls_first
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_category_id_count_1_as_the_count_max_p_price_missings_as_the_agg_from_products_sparse_as_p_group_by_category_id
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_longer_array_comes_first_desc
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_p_category_id_count_1_as_the_count_max_p_price_missings_as_the_agg_from_products_sparse_as_p_group_by_p_category_id
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_category_id_count_1_as_the_count_avg_p_price_missings_as_the_agg_from_products_sparse_as_p_group_by_category_id
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_text_types_compared_by_lexicographical_ordering_of_unicode_scalar_asc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_shorter_array_comes_first_asc
  • partiql_tests::eval::query::order_by::order_by::simple::permissive_group_and_place_nulls_last_asc_as_default
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_false_before_true_asc
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_p_category_id_count_1_as_the_count_max_p_price_mixed_as_the_agg_from_products_sparse_as_p_group_by_p_category_id
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_structs_should_be_ordered_by_data_types_asc_nulls_last_as_default_for_asc
  • partiql_tests::eval::spec_tests::section_8::strict_where_clause_eliminating_absent_values
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_text_types_compared_by_lexicographical_ordering_of_unicode_scalar_asc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_true_before_false_desc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_structs_compared_lexicographically_first_by_key_then_by_value_asc
  • partiql_tests::eval::query::order_by::order_by::simple::strict_col_1_desc
  • partiql_tests::eval::query::group_by::group_by::group_by::sql_92_style_aggregates::strict_select_category_id_count_1_as_the_count_max_p_price_mixed_as_the_agg_from_products_sparse_as_p_group_by_category_id
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_lob_types_should_ordered_desc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::permissive_lists_items_should_be_ordered_by_data_types_desc_nulls_first_as_default_for_desc
  • partiql_tests::eval::query::order_by::order_by::edge_cases::strict_lob_types_follow_their_lexicographical_ordering_by_octet_asc
  • partiql_tests::eval::query::order_by::order_by::simple::strict_col_1_asc

@jpschorr
Copy link
Contributor Author

jpschorr commented Jul 9, 2024

Diff of test file changes: partiql/partiql-tests@23c64fb...daf9234

@jpschorr
Copy link
Contributor Author

jpschorr commented Jul 9, 2024

Many failures seem related to partiql/partiql-tests@1dfe10e

{ 'data_value': $time::{'hour':12, 'minute':12, 'second':12.1,'timezone_hour':null.int,'timezone_minute':null.int} }

was changed to

{ 'data_value': $time::{'hour':12, 'minute':12, 'second':12.1,'offset':null.int} }

the latter is not a valid serialization of time in the ion-extension

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants