This reverts commit af09818.

…les out in L2toL3, trying not to re-write sorted tx file if already sorted

…rging function, attribute management and use site_id and list_station_id

…laciology-and-Climate/pypromice into add-historical-data-to-l3

…gging, attributes and tests,

…258)

* numpy dependency <2.0

* resample rules updated (deprecation warning)

* fillna replaced with ffill (deprecation warning)

* get_l3 called directly rather than from file

* process action restructured

renamed new variable.csv

moved old variable.csv

renamed new variables.csv

recreate variables.csv

…te.py

…etcdf

instead of just reading the stid to join

…her it's a Nead file

…laciology-and-Climate/pypromice into add-historical-data-to-l3

…tly from the dataset when sorting

…ast-track-l2-product-before-any-derived-variables-are-being-calculated

Write L2 to file and leave all additional variable derivation for the L2toL3 step

…al-data-to-l3

Add historical data to l3

…friendly-CLI-scripts

Make python friendly CLI scripts

- Moved test modules and data from the package directory to the root-level tests directory.
- Updated directory structure to ensure clear separation of source code and tests.
- Updated import statements in test modules to reflect new paths.
- Restructured the tests module:
  - Renamed original automatic tests to `e2e` as they primarily test the main CLI scripts.
  - Added `unit` directory for unit tests.
  - Created `data` directory for shared test data files.

This comprehensive refactoring improves project organization by clearly separating test code from application code. It facilitates easier test discovery and enhances maintainability by following common best practices.

* implemented gps postprocessing on top of the #262

This update:
- clears up the SHF LHF calculation
- reads dates of station relocations (when station coordinates are discontinuous) from the `aws-l0/metadata/station_configurations` 
- for each interval between station relocations, a linear function is fitted to the GPS observations of latitude longitude and altitude and is used to interpolate and extrapolate the gps observations
- these new smoothed and gap-free coordinates are the variables `lat, lon, alt`
- for bedrock stations (like KAN_B) static coordinates are used to build `lat, lon, alt`
- eventually `lat_avg`, `lon_avg` `alt_avg` are calculated from `lat, lon, alt` and added as attributes to the netcdf files.

Several minor fixes were also brought like:
- better encoding info removal when reading netcdf
- printing to files variables full of NaNs at `L2` and `L3/stations` but not printing them in the `L3/sites files`.
- recalculate dirWindSpd if needed for historical data
- due to xarray version, new columns need to be added manually before a concatenation of different datasets in join_l3

Avoided applying the persistence filter on averaged pressure variables (`p_u` and `p_l`) due to their 0 decimal precision often leading to incorrect filtering.

* Relocated unit persistence tests
* Added explicit test for `get_duration_consecutive_true`
* Renamed `duration_consecutive_true` to `get_duration_consecutive_true` for imperative clarity

Configuration variables were to strictly validated.
* Made bufr_integration_test explicit

* Updated read_bufr_file to use wmo_id as index

* Added corresponding unit tests
* Added flag to raise exceptions on errors
* Added create_bufr_files.py to setup

Updated station config:
* Added sonic_ranger_from_gps
* Changed height_of_gps_from_station_ground from 0 to 1