Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature 282 enhance schema #292

Merged
merged 19 commits into from
Apr 8, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
4e47ba8
Issue #282 update the schema for additions to the ECNT, VCNT, VL1L2, …
bikegeek Apr 2, 2024
eaefb2f
Add sample syntax for adding a column to a linetype table.
bikegeek Apr 2, 2024
eb841db
Corrected the incorrect table from line_data_val1l1 to line_data_val2.
bikegeek Apr 2, 2024
833afcc
Fix warnings due to errors in rst syntax
bikegeek Apr 2, 2024
1e28012
Issue #282 updates for the additional columns in ECNT, VL1L2, VAL1L2,…
bikegeek Apr 2, 2024
bf69451
Merge branch 'develop' of https://github.com/dtcenter/METdataio into …
bikegeek Apr 2, 2024
20c77bd
Issue #282 skip the tests for VCNT, VL1L2, and ECNT. These no longer…
bikegeek Apr 2, 2024
78527cf
Issue #282 Update the schema with the latest column additions to VCNT…
bikegeek Apr 3, 2024
2200ba2
issue #282 tests for checking the updates to the schema
bikegeek Apr 5, 2024
9fb4e31
Tarballs with the latest data for the ECNT, VCNT, VL1L2, and VAL1L2 l…
bikegeek Apr 5, 2024
8c79e45
issue #282 added the RMSE columns for VCNT
bikegeek Apr 5, 2024
f650c3e
Added test for loaded ECNT data
bikegeek Apr 5, 2024
8f01010
Additional information on testing
bikegeek Apr 5, 2024
8ad9ae9
Added step to clean up/remove test database after testing is finished.
bikegeek Apr 5, 2024
6fdf9d9
modify instructions to just remove the test database.
bikegeek Apr 5, 2024
1a50285
some of the line_data_vl1l2 commands were mislabelled as line_data_va…
bikegeek Apr 5, 2024
313f8ca
replace version from 5_1 to 6
bikegeek Apr 8, 2024
1b3ba73
try disabling this test until the updated schema changes have been me…
bikegeek Apr 8, 2024
1f86f09
remove the code that was used to disable workflow-doesn't work
bikegeek Apr 8, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/compare_db.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ defaults:
run:
shell: bash -leo pipefail {0}

jobs:
jobs:
run-shell-command:
runs-on: ubuntu-20.04
name: job_run
Expand Down
21 changes: 21 additions & 0 deletions METdbLoad/sql/mv_mysql.sql
Original file line number Diff line number Diff line change
Expand Up @@ -458,6 +458,8 @@ CREATE TABLE line_data_ecnt
me_ge_obs DOUBLE,
n_lt_obs INT,
me_lt_obs DOUBLE,
ign_conv_oerr DOUBLE,
ign_corr_oerr DOUBLE,

CONSTRAINT line_data_ecnt_data_file_id_pk
FOREIGN KEY (data_file_id)
Expand Down Expand Up @@ -910,6 +912,9 @@ CREATE TABLE line_data_vl1l2
uvoobar DOUBLE,
f_speed_bar DOUBLE DEFAULT -9999,
o_speed_bar DOUBLE DEFAULT -9999,
dir_me DOUBLE,
dir_mae DOUBLE,
dir_mse DOUBLE,

CONSTRAINT line_data_vl1l2_data_file_id_pk
FOREIGN KEY (data_file_id)
Expand Down Expand Up @@ -948,6 +953,9 @@ CREATE TABLE line_data_val1l2
uvooabar DOUBLE,
fa_speed_bar DOUBLE DEFAULT -9999,
oa_speed_bar DOUBLE DEFAULT -9999,
dira_me DOUBLE,
dira_mae DOUBLE,
dira_mse DOUBLE,

CONSTRAINT line_data_val1l2_data_file_id_pk
FOREIGN KEY (data_file_id)
Expand Down Expand Up @@ -1706,6 +1714,19 @@ CREATE TABLE line_data_vcnt
anom_corr_uncntr DOUBLE DEFAULT -9999,
anom_corr_uncntr_bcl DOUBLE DEFAULT -9999,
anom_corr_uncntr_bcu DOUBLE DEFAULT -9999,
dir_me, DOUBLE,
dir_me_bcl DOUBLE,
dir_me_bcu DOUBLE,
dir_mae DOUBLE,
dir_mae_bcl DOUBLE,
dir_mae_bcu DOUBLE,
dir_mse DOUBLE,
dir_mse_bcl DOUBLE,
dir_mse_bcu DOUBLE,
dir_rmse DOUBLE,
dir_rmse_bcl DOUBLE,
dir_rmse_bcu DOUBLE,


CONSTRAINT line_data_vcnt_data_file_id_pk
FOREIGN KEY (data_file_id)
Expand Down
50 changes: 50 additions & 0 deletions METdbLoad/sql/updates/update_for_5_1_beta4.sql
Original file line number Diff line number Diff line change
@@ -0,0 +1,50 @@
DELIMITER |


ALTER TABLE line_data_vcnt
ADD COLUMN dir_me DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_me_bcl DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_me_bcu DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_mae DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_mae_bcl DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_mae_bcu DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_mse DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_mse_bcl DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_mse_bcu DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_rmse DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_rmse_bcl DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_rmse_bcu DOUBLE |

ALTER TABLE line_data_val1l2
ADD COLUMN dira_me DOUBLE |
ALTER TABLE line_data_val1l2
ADD COLUMN dira_mae DOUBLE |
ALTER TABLE line_data_val1l2
ADD COLUMN dira_mse DOUBLE |

ALTER TABLE line_data_vl1l2
ADD COLUMN dir_me DOUBLE |
ALTER TABLE line_data_vl1l2
ADD COLUMN dir_mae DOUBLE |
ALTER TABLE line_data_vl1l2
ADD COLUMN dir_mse DOUBLE |

ALTER TABLE line_data_ecnt
ADD COLUMN ign_conv_oerr DOUBLE |
ALTER TABLE line_data_ecnt
ADD COLUMN ign_corr_oerr DOUBLE |



DELIMITER ;
50 changes: 50 additions & 0 deletions METdbLoad/sql/updates/update_for_6_0_beta4.sql
Original file line number Diff line number Diff line change
@@ -0,0 +1,50 @@
DELIMITER |


ALTER TABLE line_data_vcnt
ADD COLUMN dir_me DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_me_bcl DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_me_bcu DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_mae DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_mae_bcl DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_mae_bcu DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_mse DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_mse_bcl DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_mse_bcu DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_rmse DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_rmse_bcl DOUBLE |
ALTER TABLE line_data_vcnt
ADD COLUMN dir_rmse_bcu DOUBLE |

ALTER TABLE line_data_val1l2
ADD COLUMN dira_me DOUBLE |
ALTER TABLE line_data_val1l2
ADD COLUMN dira_mae DOUBLE |
ALTER TABLE line_data_val1l2
ADD COLUMN dira_mse DOUBLE |

ALTER TABLE line_data_vl1l2
ADD COLUMN dir_me DOUBLE |
ALTER TABLE line_data_vl1l2
ADD COLUMN dir_mae DOUBLE |
ALTER TABLE line_data_vl1l2
ADD COLUMN dir_mse DOUBLE |

ALTER TABLE line_data_ecnt
ADD COLUMN ign_conv_oerr DOUBLE |
ALTER TABLE line_data_ecnt
ADD COLUMN ign_corr_oerr DOUBLE |



DELIMITER ;
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Empty file.
Loading
Loading