You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
the pipeline will add data to previously created FITS files: 'solo_L0_stix-ql-spectra_0678153600_V01.fits'
in the add() method of the product one time bin gets removed as it is very very close (8binary seconds) to an existing one.
But the data (spectra, trigger, detector_index) within this "duplicated" time bins is very different.
needs to be investigated where this double time bin comes from and why it has different data.
records_array = np.around(data['time'].as_float().value, 2)
# creates an array of indices, sorted by unique element
idx_sort = np.argsort(records_array)
# sorts records array so all unique elements are together
sorted_records_array = records_array[idx_sort]
# returns the unique values, the index of the first occurrence of a value, and the count for each element
vals, idx_start, count = np.unique(sorted_records_array, return_counts=True, return_index=True)
# splits the indices into separate arrays
res = np.split(idx_sort, idx_start[1:])
#filter them with respect to their size, keeping only items occurring more than once
vals = vals[count > 1]
res = np.where(records_array == vals[0])
this will help to find the "almost identical" time bins
when processing this files:
32.zip
the pipeline will add data to previously created FITS files: 'solo_L0_stix-ql-spectra_0678153600_V01.fits'
in the add() method of the product one time bin gets removed as it is very very close (8binary seconds) to an existing one.
But the data (spectra, trigger, detector_index) within this "duplicated" time bins is very different.
needs to be investigated where this double time bin comes from and why it has different data.
was discovered during end2end testing fixes in: https://github.com/nicHoch/STIXCore/tree/end2end_fix
with forced IDB version 35
The text was updated successfully, but these errors were encountered: