Releases: TUW-GEO/rt1
Releases · TUW-GEO/rt1
RT1 v2.0
new
- HDF5 containers can now be used instead of pickle-dumps to store
Fits
andMultiFits
objects RTprocess
is now directly appending results to an HDF5-container during parallel processing- colored log-messages can be used (requires
colorama
package) - there's now a proper container for
defdict
to simplify get/set of variable definitions - indicate fit-results in
fit.plot.analyzemodel
changes
processfunc
is now private (e.g._processfunc
) -> userun_processing
instead!
fixes
- several bugfixes along the way
RT1 v1.5.2
new
- there's now a quick and easy data-export function
RTprocess.export_data()
- extract parameters and performance-metrics from a folder of dump-files
- there's now an
RTresults.dump_fits
- generator that directly returns Fits-objects RTprocess
object can now be initialized without a config-file- option to pass a list of dump-files to
rtprocess.run_finalout()
added
fixes
- speedup for indexing of folders with large amounts of dump-files
- some minor logging updates
RT1 v1.5.1
new
- add possibility to provide numeric V & SRF functions for faster evaluation if no interaction-term is calculated
- there is now a property
fit.config_name
that indicates the config-name for fits that belong to aMultiFits
object - datasets provided to
rtfits.Fits
are now checked for sorting (and automatically sorted if necessary)
fixes
- make
ncoefs
a propery for "Rayleigh" and "Isotropic" phase-functions - improved logging messages
- don't log each successful progress step, only errors and warnings
- don't create a single file for each error (log traceback to log-file directly)
- keep minimal info from
fit.fit_output
when dumping fits to disc - improvements on caching and pre-computation steps
- pre-evaluate fn-coefficients during finalout-generation
- cache lambda-functions for
V.p
andSRF.brdf
- fix sorting of fractional contributions in
rtplots.printsig0analysis()
- some updates on
rtplots.polarplot()
for symbolic parameter specification - make sure copying of config-files and modules is only attempted from the main process
RT1 v1.5
new
- add possibility to provide numeric V & SRF functions for faster evaluation if no interaction-term is calculated
- there is now a property
fit.config_name
that indicates the config-name for fits that belong to aMultiFits
object - datasets provided to
rtfits.Fits
are now checked for sorting (and automatically sorted if necessary)
fixes
- make
ncoefs
a propery for "Rayleigh" and "Isotropic" phase-functions - improved logging messages
- don't log each successful progress step, only errors and warnings
- don't create a single file for each error (log traceback to log-file directly)
- keep minimal info from
fit.fit_output
when dumping fits to disc - improvements on caching and pre-computation steps
- pre-evaluate fn-coefficients during finalout-generation
- cache lambda-functions for
V.p
andSRF.brdf
- fix sorting of fractional contributions in
rtplots.printsig0analysis()
- some updates on
rtplots.polarplot()
for symbolic parameter specification - make sure copying of config-files and modules is only attempted from the main process
RT1 v1.4
new
- add possibility to call finalizer after
rt1.rtprocess.run_processing()
finished- to "clean-up" after processing is done (or the process is terminated)
- add option to save dumps in
rtprocess.run_processing()
even ifpostprocess
is not called via
rt1.rtprocess.run_processing(..., dump_fit=True)
Multiconfig Fits
- add possibility to specify multiple configs in a single .ini file
- processing of multiple configs involves only a single call to
read()
! - you can specify as many configs as you like in a single
.ini
file! - to specify multiconfigs, add the config-specific changes to sections starting with
[#config <NAME> <SECTION>]
for example:
- processing of multiple configs involves only a single call to
[defdict]
--- the default defdict ---
[#config NAME defdict]
--- all specifications that differ from the default defdict ---
- Multiconfig fits will be handled with a
rt1.rtfits.MultiFits
object- use
rt1.rtfits.MultiFits.accessor
to accessFits
propeties of all configs
- use
- all processed configurations can be saved in a single
.dump
-file!- this avoids duplicating data that is shared between the configs
fixes
- fix issue in the default "domainfuncs" of
rt1.general_functions.scale()
- make sure
rt1.rtfits.reinit_object()
only copies relevant properties - speed up
rtprocess.RTresults
initialization for folders with many files
v1.3
new
- logging implemented
- incorporate basic NetCDF export functionality via
xarray
(rt1.processing_config.postprocess_xarray()
) - new
rtmetrics
class to provide easy access to common metrics calculation - add option to disable postprocessing va
RTprocess.run_processing(postprocess=False)
- add option to run processing and NetCDF export in 2 separate runs
- e.g. via
run_processing()
andrun_finalout()
- e.g. via
- add
dump_fit
option torun_processing()
so fits are dumped even ifpostprocess=False
- add option to run processing and NetCDF export in 2 separate runs
changes
copy
is now an argument of the__init__
ofRTprocess
instead ofRTprocess.run_processing()
unittests
- switch tests to github actions
- use conda
.yml
file for requirements
- use conda
- switch coverage reports to codecov
- reactivate stickler & flake8
- use github actions for PyPi upload
fixes
- fix processing and logging with
ncpu=1
- enure that the
processing_config
class and additional modules are loaded from the correct folder - fix future warnings in
sympy
andmatplotlib
- make
RTresults.load_fit()
find fits faster- allow passing integers to load the nth result
- fix sorting in
printsig0analysis()
- fix parsing error in
param_dyn_dict
- use pickleable decoration of initializer function
- proper detection of submodules in
setup.py
- incorporate pending changes in
scipy > v1.6.3
(e.g. adjust call signature ofsympy.Lambdify
)
v1.2
changes
- the reader-function in
rt1.rtprocess
is now called without dict-unpacking!!
(e.g. viareader(reader_args)
instead ofreader(**reader_args)
)
! this might require modifications in existing scripts !
fixes
- correct parsing of
None
inrt1.rtparse
- multiprocessing pool initializer also executed in single core processing (for debug)
rt1.rtprocess
now useswarnings.warn
instead ofprint
for general messages
new
- convenience-method
interpolate_to_index()
added tort1.genreal_functions
v1.1.9
changes
rtfits.preprocess()
is now called prior to parallel-processing- a check if files already exist should now be done within the reader-function!
- copying of modules is shifted from the
rtparse
tortprocess
to avoid copying files when config is read - the configparser now has methods
get_module('modulename')
as well asget_all_modules()
to programmatically import modules - all parallel-processing functions have been shifted to the dedicated
rtprocess
module
fixes
- corrections to the treatment of
integer
parameter-dynamics specified infit.defdict
- the cache is now only cleared at the beginning of a
fit.performfit()
call - correct final message in
processfunc()
progress-bar
new
-
a dedicated class for parallel processing (
rt1.rtprocess
) has been introducedrt1.rtprocess.RTprocess
can be used to setup and run parallel jobsrt1.rtprocess.RTresults
can be used to provide easy-access to processing-results
-
some updates on rtplots.printsig0analysis()
- now one can select additional timeseries from both fit.res_df and fit.dataset
- ... and the styles can be set using the printparamstyles - dict
v1.1.8
changes
- manual parameter dynamics are no longer automatically used if a column
'param_dyn'
is provided
... to use manual dynamics, you now must use one of the following:- explicitly specify parameter-dynamics as
'manual'
infit.defdict
- to combine a pandas datetime-offset
freq
with a manual-dyn use'freq + manual'
- explicitly specify parameter-dynamics as
new
- the
model_definition
text has been updated to include more details - the property
fit._model_definition
is added to allow accessing the model_definition string
(useful for example to write it to a file) RT1_configparser
now provides a function.get_module(modulename)
to import a specific module from a file
fixes
- fix import-location for copied modules in
rtparse
(now modules are imported from the copy-path)
v1.1.7
new
- define parameter-grouping with respect to number of observations within a group
fixes
- fix dynamic startvalue-assignment
- better implementation of rectangularize function