-
Notifications
You must be signed in to change notification settings - Fork 11
/
CHANGELOG.txt
309 lines (255 loc) · 13.3 KB
/
CHANGELOG.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
3.2.0
* fixes compile issue with XCode 16
* updates installation to R=4.2 and other package version updates
* adds EARTHSCOPE as alias of IRIS
* updates service.iris.edu references to service.earthscope.org
* changes http to https
* the default event service is USGS
* makes explicit that event services directed to IRIS or EARTHSCOPE use
"https://earthquake.usgs.gov/fdsnws/event/1/"
3.1.2
* bug fix for when csv_dir, psd_dir, and/or pdf_dir are blank
* replaced test_data/RESP.KAPI.II.00.BHZ.txt to a functional resp file
3.1.1
* updated conda package versions when running './run_ispaq.py -U'
3.1.0
* addition of --sds argument for specifying Seiscomp SDS file naming convention NET.STA.LOC.CHAN.TYPE.YEAR.DAY
* bug fix for FDSN station web services that do not support optional parameter includerestricted
* bug fix for reading local files for event metrics that span day boundaries
* bug fix, will not append to TRANSCRIPT log unless '-A' option specified
* bug fix, sort out-of-order miniseed segments when reading
* recommends creating conda environment using obspy 1.4.0
3.0.1
* dependency numpy package version must be <1.22 to avoid errors. Added numpy=1.21.4 to the ispaq-conda-install.txt file.
3.0.0
* ports code to Python3
* includes MUSTANG metrics sample_rate_resp, sample_rate_channel, max_range
* modifications to preference file default.txt
* access to IRIS PH5 archive data, using IRISPH5 name
* includes option to write metric values to SQLite database
* updates recommended conda package versions
* requires installation of R-packages seismicRoll 1.1.4, IRISMustangMetrics 2.4.4, IRISSeismic 1.6.3
* local data will be marked percent_availability=0 for target-days without data if metadata is included for target
* updates to documentation, including new Jupyter notebook tutorials
* updates to logging output
* PSD and PDF output targets now contain quality code information
* bug fix, transfer_function metric will run on all requested days with correct results
* bug fix, PDF calculation completes when using CSV files having multiple SNCLs with a differing number of targets
2.0.1
* updates recommended conda ObsPy package version to 1.1.1. Run `run_ispaq.py -U` to install ObsPy 1.1.1.
2.0.0
* adds aggregate PDF feature, in addition to the original daily PDF functionality. Aggregate PDFs
calculate and display PDFs as a single text file or single plot for the entire time period between starttime
and endtime.
* dead_channel_exp has been retired and is no longer available as a metric.
* 'pdf_plot' and 'pdf_text' are no longer metric name options. They have been replaced by metric name 'pdf'.
* custom preference files from previous ISPAQ versions will need to be modified to replace 'pdf_plot' and
'pdf_text' with 'pdf', and to remove dead_channel_exp
* significant changes made to format of preference files with the addition of PDF_Preferences:
pdf_type specifies text or plot (or both), pdf_interval specifies daily or aggregated, and
plot_include allows you to specify whether the PDF plot should display the legend, colorbar, or
fixed_yaxis_limits of -25,-225 dB.
* other preference file changes include: 'png_dir' has been removed as a Preferences option and replaced by
'pdf_dir' to specify where to write PDF plot and text files. 'psd_dir' has been added to Preferences as a
directory to store PSD text files (in csv format).
* PSD text files are required to calculate PDFs and these can be created by running the metric 'psd_corrected'. They
will be written to the directory specified as 'psd_dir' in the Preferences, with a directory structure of
psd_dir/network/station. If the metric 'pdf' is run, it will look in the 'psd_dir' directory for PSD text files. To run
both PSD and PDFs at the same time, use 'psd_corrected,pdf' either in the preference file or the command line.
* command line options have been changed to match the changes to the preference files. These new options override the
preference files.
* requires installation of R-package IRISMustangMetrics 2.2.0
1.2.1
* fixed bug in PSD/PDF metrics that affected output values when local RESP files are used.
1.2.0
* updates the recommended packages for conda environment install, notably to R 3.5.1 and obspy 1.1.0,
in the ispaq-conda-install.txt file. If you have an earlier version of ISPAQ installed, please run `run_ispaq.py -U
* `run_ispaq.py -U` will now ask if you want to upgrade to the recommended conda package versions
if it detects that you are using old versions
* `run_ispaq.py -U` will now install the IRIS MUSTANG R-packages if they do not exist in your
conda environment instead of failing
* with obspy version 1.1.0+, ispaq can calculate the following metrics on local miniseed files:
calibration_signal, clock_locked, event_begin, event_end, event_in_progress, timing_correction,
clock_locked
* fixed bug in crossCorrelation (polarity_check) that incorrectly calculated distances
1.1.1
* fixed bug introduced by IRISSeismic 1.4.8 that prevented the retrieval of seismic data
* requires IRISSeismic 1.4.8
1.1.0
* Will now trim data trace to sample level when requesting data from a SeisComP dataselect webservice
that returns miniseed cut on record boundaries.
* requires IRISSeismic 1.4.6
1.0.0
* modifies channel filters
* requires IRISMustangMetrics 2.0.8
* "-M spikes" will now run 'spikes' state of health metric instead of 'num_spikes' metric
* replaced ispaq-explicit-spec-file.txt with ispaq-conda-install.txt
* bug fix for get_availability when no metadata found
* bug fix for PSDMetric when no derived metrics are available because of channel type
0.9.0
* adds sncl_format entry to preferences file. Specifies which order of network, station, location, channel
to use when looking for miniSEED files and station aliases.
* adds optional arguments dataselect_url, station_url, event_url, csv_ouput_dir, plot_output_dir,
sigfigs, sncl_format that override preference file entries
* use of preference file is not required as every entry can be overridden on command line
* when output directory does not exist, ispaq tries to create it. If that fails, it defaults to current directory
* searches for miniSEED files down directory structure
* when local data is used and no starttime is specified, ISPAQ will calculate start and end times from data file names
* crossTalk and orientationCheck now search metadata for e.g, BH? when BHZ is the sncl_pattern (metrics require 3 channels)
* output file names replace characters "*,?" with "x"
* addition of ignoreEpoch=TRUE for simple metrics, ignoreEpoch argument now works for local files
* makes channel filters less restrictive
* bug fix for crashes when internet connection not available
* bug fix for day looping when starttime and endtime have different years
* bug fix for transferFunction involving channel matching
* additional error handling
* improved command line help output
0.8.8
* fixed bug when specifying FDSN webservices url that begins with https
* when USGS is specified as event_url, bypass ObsPy URL_MAPPINGS and map to https:/earthquake.usgs.gov
0.8.7
* adds repository argument to get_dataselect, to work with IRISSeismic_1.4.1.tar.gz
* not backwards compatible with IRISSeismic versions < 1.4.0
0.8.6
* typo fix in crossCorrelation.py that was causing it to fail
0.8.5
* exits cleanly if no metrics can be run
* PSD metrics now use sample rate from r_stream instead of get_availability()
* bug fix for concierge.availability distance selection when latitude and longitude do not exist
* additional sanity checks for metadata and station_url
* changes in logger levels for some cases, improves messages
* improves error checking for event based metrics, concierge.dataselect
* additional documentation
0.8.4
* checks whether metric available in R package can be run with current ISPAQ version
* when using local miniSEED files, will not return flag metrics for flags that do not exist in ObsPy traces
* license changed to GNU Lesser General Public License
* bug fix for missing station XML
0.8.3
* adds -L options to run_ispaq.py, lists available metrics
0.8.2
* added checks for correct miniconda environment
* adds more checks for preference file data access content, bug fixes when set to 'None'
* fixes bug in handling of travel time
* improves log messages
* additional documentation
0.8.1
* additional error handling for invalid metrics
* improvements to command line input of non-aliased metrics and stations
* additional documentation
* reorders columns for PSDText output
0.8.0
* changes ispaq-runner.py name to run_ispaq.py
* adds quality code to R trace when converting from ObsPy trace
0.7.25
* additional checking for missing or invalid preference file content
0.7.24
* fix for bug in ispaq.py validating command line arguments
0.7.23
* single metrics and stations can now be specified from command line independent of a preference file
* adds nearest_sample=FALSE option to py_stream.slice commands
0.7.22
* user can now specify http:// address for web services instead of FDSN service provider name
0.7.21
* get_dataselect() now correctly handles start-end times that span day boundary for local miniSEED files
0.7.20
* added IRISSeismic_1.3.9.tar.gz
* updated documentation
* fixes bug in get_dataselect() caused by obspy.merge
0.7.19
* fixes indentation bug for spikes metric code in simple_metrics.py
0.7.18
* get_event() now has filtering capabilities for time, magnitude, depth
0.7.17
* transferFunction_metrics now calculate for an hour window from 12:00-13:00 UTC.
* various bug fixes
0.7.16
* output file names now contain endtime if multiple days are requested
* bug fix in handling of start and endtimes that are not at 00:00:00
0.7.14
* transfer function and PSD metrics now work with local RESP files.
* addition of resp_dir entry to preference file
* bug fix for outputting PDF plots only
* metrics that are defined as 24 hours will now run in single day loops when --starttime and --endtime are input from run_ispaq.py
* improvements in get_availability() and get_dataselect()
* PSD metric channel filter changed to '.[HNL].'
* file output column names changed to match MUSTANG
* get_availability() now filters by station epoch dates.
* improved compatibility with all FDSN web services
* bug fixes to updater.py
* cross correlation metrics now use ObsPy travel times
0.7.13
* fixed orientation_check reporting value=nan.
* requires IRISMustangMetrics version 2.0.0 and IRISSeismic version 1.3.5.
0.7.12
* concierge.get_availability will now load up 1st) all local metadata, then 2) any local data that matches our user-specified sncl pattern.
* crossCorrelation, SNR_metric, crossTalk, orientationCheck, transferFunction now bypasses any metadata-less sncls
* crossCorrelation matchies the first sncl type when finding available data for the second sncl
* crossTalk, SNR channelFilter="[BH]H."
* suppress FutureWarnings
0.7.11
* fixed bugs in transferFunction, orientationCheck
* more columns in PDF.csv, no microseconds on output
* major refactoring of Concierge.get_availability for
more careful creation of filtered availability to handle
combinations of local and remote StationXML and Miniseed files
including filtering based on locally available data
0.7.10
* SNCL pattern filtering applied to local StationXML metadata
* avoid duplicating single local StationXML metadata file when using multiple SNCL patterns
* new NoDataAvailableError exception
* improved error handling and logging
* glob searching for local MSEED files to allow for different (or missing) quality flags
0.7.9
* added station metadata to stream objects (required by IRISSeismic::rotate2d() which is used in orientationCheck)
0.7.8
* added ".H." channelFilter for PSD metrics
0.7.7
* proper initialization of R_stream @endtime from data read from disk
* proper initialization of act_, io_ and dq_flags from data read from disk
* additional sanity check for 3 channels in orientation_check
0.7.6
* support for automated IRIS R package updating with "--update-r" flag
* channel filters used in all metric business logic
* lots more error handling and logging
0.7.5
* PSD metrics now save correctedPSDs and PDFs
0.7.4
* specificy use of python2.7 in ispaq-runner.py
* obtaining metrics function data from R package
0.7.3
* initial support for Anaconda installation
0.7.2
* -A option to append to TRANSCRIPT.txt instead of rewriting
0.7.1
* improved logging
* don't show error messages from R
0.7.0
* new transferFunction_metric
* regularized logging
* __future__ imports
0.6.0
* improved PDF plotting code
* partially complete orientationCheck metric
* added pressureCorrelation_metrics
* updated to work with latest R packages
* added crossCorrelation metric
* added crossTalk metric
* added transfer_function metric (old version -- needs update)
0.5.1
* improvements to logger messages
* additional "Preferences:" section in the preferences file
* configurable output directories and sigfigs
0.5.0
* psd metric and pdf plots now working
* additional doctests in irisseismic module
* updated irisseismic function signatures to match R package signatures
0.4.2:
* now using the logging module
* successfully using local miniseed data
* added Concierge.get_dataselect() method
0.4.1:
* skipping unused portions of business logic
0.4.0:
* first version on github
* end-to-end functionality for 'simple' and 'SNR' metrics