Release 2024.12

ska3-flight 2024.12

• acisfp_check: Update to allow for HRC dependence in the ACIS FP model.
• chandra_aca: Add some routines to get background subtracted images (relevant only for ACA).
• maude: Add get_last_backorbit_date function to return the last available backorbit (SSR-dump) data for a list of MSIDs. This is useful to avoid accidentally getting realtime data that may have gaps or corruptions.

Interface Impacts:

• chandra_aca:
  • dtype of return value in get_aca_images changed.
  • get_aca_images now allows fetching data over time ranges larger than 3 hours
• maude: Adds a new function get_last_backorbit_date
• mica: columns in return value of get_aca_images are unmasked, except images.

What's Changed

• add recipes for acq_stat_reports and guide_stat_reports by @javierggt in #1391
• Update ruff-base.toml to discourage using assert in code except for tests by @taldcroft in #1426
• Add comment to ruff-base.toml by @taldcroft in #1434
• Add recipe for fotmp package by @jeanconn in #1435
• 2024.10 by @javierggt in #1423
• 2024.11 by @javierggt in #1427
• add aperoll by @javierggt in #1418

PR: 1450

Full Changelog: 2024.11...2024.12

Release 2024.11

Ska3-flight 2024.11

This release includes the following changes:

• starcheck: Update starcheck IR zone to (-5, +35).
• kadi: Support offset pitch for Safe mode and NSM events and improve Safe mode.
• proseco: Exclude COLOR1=0.7 stars from guide selection.
• ska_sun: Add functions get_att_for_sun_pitch_yaw() and get_nsm_attitude().
• ska_tdb: Updates to support remote access from Windows.
• aca_view: improvements to handle real-time telemetry.
• acispy: Updates to thermal model support, and improvements handling of vehicle loads in SimulateECSRun.

It also includes a collection of small fixes and improvements detailed below.

Interface Impacts:

Removed packages:

• The find_attitude package is being removed from ska3-flight. Operationally this is not an interface impact - the find_attitude package at the current version will remain installed in /proj/sot/ska3/flight, but removing it from the metapackage will allow us to transition to doing updates to this package (which is isolated in scope and users) via a single-package FSDS request.
• The chandra_cmd_states Python package is being removed from ska3-flight. This package will actually be removed - it has been replaced with functionality in kadi command states and has been deprecated (with an error if used without env var override) since ska3-flight 2023.10.

Other:

• ska_tdb. If cheta.remote_access.access_remotely is set to True when ska_tdb is loaded, the user will now be prompted to provide a hostname, username, and password (unless they have already been set in the cheta.remote_access package), this should not impact existing code, outside of the FOT MATLAB Tools.
• ska_sun: Add functions get_att_for_sun_pitch_yaw and get_nsm_attitude.
• ska_helpers. Added new utilities: logger context manager and random RA and Decs
• proseco. Added proseco.acq.get_acq_candidates_mask and proseco.guide.get_guide_candidates_mask.
• parse_cm. All backstop files written out by parse_cm will use the modern, .12f, output for the components of the quaternion in MP_TARGQUAT / AOUPTARQ. Previously these were written out as .8e .
• mica
  • Removed a small html file of the aiprops data.
  • Added two columns PIXTLM, BGDTYP to the output of get_slot_data. For L0 data that hasn't been reprocessed since DS10.8.3 and doesn't have those columns in the source data FITS file, these are filled with ORIG and FLAT, respectively. This also adds a new derived column IMG_VCDUCTR.
  • Removed useless outdir argument from mica.report.report.get_obs_temps.
• chandra_maneuver. NSM_attitude is deprecated.
• chandra_aca
  • Added one column IMG_VCDUCTR which correspond to the VCDUCTR of the first sub-image. This matters only for 6x6 and 8x8 images, which are updated over 2 and 4 ACA packets respectively.
  • The filtering mask in proseco requires two new AGASC columns compared to the previous chandra_aca.plot code: MAG_ACA and COLOR1.
  • The filtering in proseco is somewhat different from the previous code, so there will be changes in the color of plotted stars. In general the changes are for the better and accurately reflect what proseco is using in star selection.
• acispy. The accepted value to use for specifying the vehicle load option to the attitude argument in SimulateECSRun has changed. Previously, one gave as the value the name of the load to take the commands from. Now, to specify vehicle commands, simply specify "vehicle" as the argument.

What's Changed

• Make kadi-apps build recipe arch-dependent by @javierggt in #1373
• add build recipe for sherpa by @javierggt in #1349
• Remind about ska3-perl in PR template and Issue template by @jeanconn in #1384
• Exclude PLR1730 in ruff-base by @jeanconn in #1390
• Bump actions/download-artifact from 2 to 4.1.7 in /.github/workflows by @dependabot in #1392
• 2024.8 by @jeanconn in #1380
• Remove pyrightconfig.json file from templates by @taldcroft in #1402

New Contributors

• @dependabot made their first contribution in #1392

Full Changelog: 2024.8...2024.11

Release 2024.10

What's Changed

• Make kadi-apps build recipe arch-dependent by @javierggt in #1373
• add build recipe for sherpa by @javierggt in #1349
• Remind about ska3-perl in PR template and Issue template by @jeanconn in #1384
• Exclude PLR1730 in ruff-base by @jeanconn in #1390
• Bump actions/download-artifact from 2 to 4.1.7 in /.github/workflows by @dependabot in #1392
• 2024.8 by @jeanconn in #1380
• Remove pyrightconfig.json file from templates by @taldcroft in #1402

New Contributors

• @dependabot made their first contribution in #1392

Full Changelog: 2024.8...2024.10

Release 2024.8

ska3-matlab 2024.8

This PR includes the following changes to bring ska3-matlab in sync with ska3-flight 2024.7 and an update to fot-matlab:

• starcheck:
  • changes to use the default AGASC file (so when 1p8 is promoted starcheck uses it without any change)
• kadi
  • changes to support the AGASC 1.8 promotion
• agasc
  • fix test and ancillary script to work with AGASC 1.8
• ska_sync
  • Update to support AGASC 1.8 promotion
• fot-matlab
  • MATLAB-12089 - Updates to the structure of the model data

Diffs from last ska3-matlab release

Interface Impacts:

• agasc
  • Added new argument full_agasc to agasc.write_agasc(). If true (default), require exactly the standard AGASC column names and dtypes. If false, ensure that the output columns are a strict subset of the standard AGASC columns.
  • New keyword columns in agasc.get_agasc_cone
• ska_sync will not sync the following files anymore:
  • kadi/cmds.h5
  • kadi/cmds.pkl
  • cmd_states/cmd_states.db3
• starcheck. Changed starcheck notes format to add a 3-digit output of the max CCD temperature for diagnostics.

PR: #1380

Full Changelog: 2024.7...2024.8

Release 2024.7

ska3-flight 2024.7

This PR includes:

• starcheck:
  • changes to use the default AGASC file (so when 1p8 is promoted starcheck uses it without any change)
• kadi
  • changes to support the AGASC 1.8 promotion
• agasc
  • fix test and ancillary script to work with AGASC 1.8
• ska_sync
  • Update to support AGASC 1.8 promotion

This is the first release where all packages (including starcheck) are expected to work in the osx-arm64 build. A number of core packages and the ska3-perl meta-package were updated to that effect.

Interface Impacts:

None

PR: #1366

Full Changelog: 2024.5...2024.7

Release 2024.6

ska3-matlab 2024.6

This PR includes:

• acis_thermal_check
  • now uses chandra_limits package (acis_thermal_check PR 71)
  • first version of 1DPAMYT model (acis_thermal_check PR 72)
• updates to chandra_limits to support new ACIS FP limits
• update to the time range used for High IR Zone checking in starcheck
• Fixes proseco bug, noticed on prelim review of obsid 26719, which caused include_ids_guide to be ignored when guide stars were close.

Interface Impacts:

None

PR: #1363

Full Changelog: 2024.3...2024.6

Release 2024.5

ska3-flight 2024.5

This PR includes:

• updates to chandra_limits to support new ACIS FP limits
• update to the time range used for High IR Zone checking in starcheck

Note: **This PR includes an ARM build for the first time - that build is intended for beta testing and not operational use **

Interface Impacts:

• chandra_limits : new limits from chandra_models 3.53 are used by the ACIS FP model. Requires chandra_models >= 3.53.
• parse_cm: new required_sequenced_duration added to or_list_types.yaml (no impact)
• xija: Colors of the new ACIS FP limits in xija_gui_fit and acis_thermal_check will change.
• starcheck: Changes to placement of newlines in the text file report.

PR: #1350

Full Changelog: 2024.4...2024.5

Release 2024.4

This PR includes:

• acis_thermal_check
  • now uses chandra_limits package (acis_thermal_check PR 71)
  • first version of 1DPAMYT model (acis_thermal_check PR 72)
• cheta.
  • updated HRMA OHRTHR data to use WIDE mode.
  • Fix Computed_Quat MSID in cases when there are bad data in the fetch range.
• kadi. Remove commands v1.
• proseco. Implement acquisition box overlap penalty

Interface Impacts:

• Commands v1 has been deprecated for a long time and now it is fully removed. The configuration setting commands_version is removed and the environment variable KADI_COMMANDS_VERSION no longer has any effect.
• Proseco will change which acquisition stars are selected or modify box sizes in cases where an overlapping box would have been chosen. While this code will become operation for load checking, the corresponding changes that affect load creation will not become operational until Matlab 2024_030 is promoted. As a result, there might be some discrepancies between star selection and load checking until then.
• acis_thermal_check
  • The 1DPAMYT model will have a calling sequence similar to 1DPAMZT
  • The table reporting violations on the webpages has changed slightly, but is human-read. Plots show limit lines as a function of time instead of every limit line across the whole plot; also human-read.

Full Changelog: 2024.1...2024.4

PR: #1341

Release 2024.3 (ska3-matlab 2024.3 for 2024_030)

ska3-matlab 2024.3

This PR includes:

• cheta.
  • Updated HRMA OHRTHR data to use WIDE mode.
  • Fix Computed_Quat MSID in cases when there are bad data in the fetch range.
• kadi. Remove commands v1.
• proseco. Implement acquisition box overlap penalty.

Interface Impacts:

• Commands v1 has been deprecated for a long time and now it is fully removed. The configuration setting commands_version is removed and the environment variable KADI_COMMANDS_VERSION no longer has any effect.
• Not an API change, but Proseco will change which stars are selected in cases where an overlapping box would have been chosen.

PR: #1322

Full Changelog: 2024.1...2024.3

Release 2024.1

ska3-flight 2024.1

This is a major update of external (core) packages. Python is upgraded to version 3.11.

This PR includes the following changes in Ska packages:

• kadi
  • Add command events to implement maneuver to pitch and roll about sun line
  • Support get_observations() and get_starcats() from backstop commands
  • Add fids commanded state
  • Deprecate kadi load_ska_dir() in favor of parse_cm load_dir_from_load_name
• starcheck
  • Remove use of maneuver error file
  • Stop doing acquisition spoiler checks (still included in acquisition probability)
  • Remove some warnings on acquisition stars that are no longer useful

Interface Impacts:

• There are new command events to implement pitch and roll maneuvers about the sun line. FOT MP command events TWiki documentation needs to be updated to include the two new command event types.
• The types dict argument of kadi.occ_web.get_ifot now requires that the type be specified as the actual type object (e.g. str or np.int64) (sot/kadi/pull/321)
• kadi.commands.core. ska_load_dir is now deprecated and using it will cause unit tests to fail or issue warnings to the console.
• Calling kadi.commands.read_backstop() with an existing backstop table issues a FutureWarning that in the future this will raise an exception. Instead use kadi.commands.get_cmds_from_backstop().
• A bug was fixed in the Quat constructor that allowed non-normalized quaternions (in particular, it allowed Quat(q=[0, 0, 0, 0])). From now on this will raise an exception.
• sybase was removed as an available dbi in ska_dbi.DBI.
• Importingska_parsecm raises an exception unless SKA_ALLOW_DISCONTINUED_PACKAGES=1.
• Changes the sense of the yaw parameter in ska_sun (sot/ska_sun/pull/37).
• The dyaw column in the att_opts table in sparkles was flipped in sign from the previous results. It now relates directly to the yaw maneuver mission planning and engineers would use. I.e. dyaw = +5 deg would imply creating a command load using a positive yaw bias rate input.
• The ACA review table will have an extra column. Any tests that depend on the exact repr of such a table may need to be updated but the sparkles tests themselves did not need modification.
• Newly "ingested" starcheck outputs into mica database will not have slew_err_arcsec populated.

Full Changelog: 2023.9...2024.1

PR: #1282