Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Tune] Test #3

Closed
wants to merge 170 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
170 commits
Select commit Hold shift + click to select a range
21fba52
init steps to separating search and execution
richardliaw Jul 22, 2018
a03f356
Rewire and reorganize
richardliaw Jul 22, 2018
a249421
remove control
richardliaw Jul 23, 2018
32b02ac
flake8
richardliaw Jul 24, 2018
197aee3
added parallel of scheduler
richardliaw Jul 24, 2018
db8d355
rename
richardliaw Jul 24, 2018
dc1eb73
add hyperband to scheduling
richardliaw Jul 24, 2018
f512f5e
update trials
richardliaw Jul 24, 2018
6f25a11
live trials
richardliaw Jul 24, 2018
7a9be01
fix trial_id
richardliaw Jul 24, 2018
957f3b9
some cleanup
richardliaw Jul 24, 2018
d684ec4
moved example
richardliaw Jul 24, 2018
642e67e
search algorith,
richardliaw Jul 24, 2018
13a2d64
docs
richardliaw Jul 24, 2018
87c0d0e
tuned
richardliaw Jul 25, 2018
754e935
better_results
richardliaw Jul 25, 2018
038b7d0
Ray Tune -> Tune
richardliaw Jul 25, 2018
d5b62f8
logo
richardliaw Jul 25, 2018
c8d54af
TEMP: changes in quickstart
richardliaw Jul 25, 2018
c5be56a
yapf and lint
richardliaw Jul 25, 2018
af217d7
fix tests
richardliaw Jul 25, 2018
8042007
nice example
richardliaw Jul 25, 2018
a58f64d
comments
richardliaw Jul 25, 2018
b24a58e
refactor stopping
richardliaw Jul 26, 2018
edeb529
yapf
richardliaw Jul 26, 2018
357f21f
tests
richardliaw Jul 26, 2018
fc22d58
yapf and fix tests
richardliaw Jul 26, 2018
c7befc5
simplify test
richardliaw Jul 26, 2018
cbe0e7f
yapf
richardliaw Jul 26, 2018
fd2d7d3
Merge branch 'tune_algorithm' into tune_branding
richardliaw Jul 27, 2018
c4b01d1
better graphic
richardliaw Jul 27, 2018
dcc6fdc
Merge branch 'tune_algorithm' into tune_branding
richardliaw Jul 27, 2018
7719b68
augment run to support trainables and register automatically
richardliaw Jul 28, 2018
3f44796
move and ypaf
richardliaw Jul 28, 2018
d1b0653
Move schedulers imports correctly
richardliaw Jul 28, 2018
8eb5e52
fix docstring
richardliaw Jul 28, 2018
be19a7b
yapf
richardliaw Jul 28, 2018
0704e43
more documentation with package ref
richardliaw Jul 28, 2018
721b10c
Merge branch 'master' into tune_algorithm
richardliaw Jul 30, 2018
bafc73e
Merge branch 'master' into tune_algorithm
richardliaw Jul 30, 2018
fa7d173
yapf upgrade
richardliaw Jul 30, 2018
f4af093
Merge branch 'master' into tune_branding
richardliaw Jul 30, 2018
e94d440
Merge branch 'tune_algorithm' into tune_branding
richardliaw Jul 30, 2018
dce64f8
Move onto VariantAlgorithm
richardliaw Jul 31, 2018
916ad1b
revise truth condition
richardliaw Jul 31, 2018
30edc82
flake
richardliaw Jul 31, 2018
5a15d72
consistency
richardliaw Jul 31, 2018
57c6fa1
Moving variant_generator into suggest
richardliaw Jul 31, 2018
54475ae
fix tests
richardliaw Jul 31, 2018
c3d59e1
some test fixups
richardliaw Aug 1, 2018
546c28d
better naming
richardliaw Aug 1, 2018
e976fe3
address comments
richardliaw Aug 1, 2018
27561e1
Finished state
richardliaw Aug 1, 2018
2f0d169
flake8
richardliaw Aug 1, 2018
ae0bd61
fix hyperopt
richardliaw Aug 1, 2018
03effd0
move experiment resolution into ExistingVariants
richardliaw Aug 1, 2018
eb16298
test
richardliaw Aug 1, 2018
7d4e3ba
refactor generation
richardliaw Aug 2, 2018
41ef8b3
comments
richardliaw Aug 2, 2018
cf71bfa
Move to restructure ExistingVariants to two classes
richardliaw Aug 2, 2018
67518e2
yapf
richardliaw Aug 2, 2018
4546bc3
suggestion algorithm => suggest
richardliaw Aug 2, 2018
e1057f6
max concurrency
richardliaw Aug 2, 2018
69fb156
trials, fix some tests
richardliaw Aug 2, 2018
614ece2
let hyperopt support added trials
richardliaw Aug 2, 2018
57a4612
fix trial generation
richardliaw Aug 2, 2018
c06f1a7
fix some bugs
richardliaw Aug 2, 2018
bcec122
fix some tests
richardliaw Aug 2, 2018
00dc2c8
fix more tests
richardliaw Aug 3, 2018
fadba05
Add tests
richardliaw Aug 3, 2018
2dcb149
fix jenkins because str is bad
richardliaw Aug 3, 2018
7f21ff1
add tests and fix docs
richardliaw Aug 3, 2018
0298aff
fix tests
richardliaw Aug 3, 2018
b106557
done
richardliaw Aug 3, 2018
061d7aa
forgot to commit test
richardliaw Aug 3, 2018
7540e3e
fix notification
richardliaw Aug 4, 2018
a30f242
tests for trial notification
richardliaw Aug 4, 2018
2a609b3
Fix tests for hyperopt
richardliaw Aug 4, 2018
3b01bfe
Merge branch 'tune_algorithm' into training_result
richardliaw Aug 4, 2018
46d5425
fix format vars
richardliaw Aug 4, 2018
5641739
Merge branch 'tune_algorithm' into training_result
richardliaw Aug 4, 2018
71dd35f
training_result
richardliaw Aug 4, 2018
a0148e0
result.py
richardliaw Aug 4, 2018
7197b4e
try documenting this
richardliaw Aug 4, 2018
7eb409e
attempt to document TrainingResult
richardliaw Aug 4, 2018
bc5f2ca
documentation
richardliaw Aug 4, 2018
eb8531f
yapf
richardliaw Aug 4, 2018
615a8bb
Change Trainable to non-RLlib specific
richardliaw Aug 4, 2018
bd75e9d
Modifying TrainingResult yet again
richardliaw Aug 5, 2018
06ed185
superclassing result
richardliaw Aug 5, 2018
fa2ffa1
removing training_result traces
richardliaw Aug 5, 2018
9c5ab85
Merge branch 'master' into training_result
richardliaw Aug 5, 2018
6c30239
import rllib correctly
richardliaw Aug 5, 2018
fe479ed
modified to support dict operations instead
richardliaw Aug 5, 2018
165f004
comments
richardliaw Aug 5, 2018
2dd816d
fix bugs
richardliaw Aug 5, 2018
a6c7127
Merge branch 'master' into training_result
richardliaw Aug 5, 2018
2f2aa9b
move onto mutable mapping
richardliaw Aug 5, 2018
228c2bf
remove comment
richardliaw Aug 5, 2018
025e859
Removed from timesteps_total
richardliaw Aug 5, 2018
487ad06
removed getattr from hyperband
richardliaw Aug 5, 2018
71cc75d
proper py2 import
richardliaw Aug 5, 2018
558b8ff
Syntax, and removed test allowing for arbitrary reporting
richardliaw Aug 5, 2018
3929aaf
check for proper stopping at runtime
richardliaw Aug 5, 2018
ee9ee41
as_dict
richardliaw Aug 5, 2018
c40be78
as_dict
richardliaw Aug 5, 2018
3b8ba73
fix 1 rllib issue
richardliaw Aug 5, 2018
26d2766
cleanup
richardliaw Aug 6, 2018
ebad40b
revert result to subclass dict
richardliaw Aug 6, 2018
33dc801
changes
richardliaw Aug 6, 2018
fe3ac1e
linting
richardliaw Aug 6, 2018
e3a3b25
revert some changes
richardliaw Aug 6, 2018
6d25f35
some safeguards
richardliaw Aug 6, 2018
cf82bcb
training result
richardliaw Aug 6, 2018
05d9bbb
introducing constants'
richardliaw Aug 6, 2018
e39e7c5
introduced constants 2
richardliaw Aug 6, 2018
2e304f4
output
richardliaw Aug 6, 2018
b34a6ae
more yapf
richardliaw Aug 6, 2018
f9622b6
some more constants
richardliaw Aug 6, 2018
e9fc513
update tests
richardliaw Aug 6, 2018
dc4c01b
avoid negmeanloss regression
richardliaw Aug 6, 2018
6892550
resulting stuff
richardliaw Aug 6, 2018
0be794d
lint
richardliaw Aug 7, 2018
5e9cd45
Ignored warning for dict
richardliaw Aug 7, 2018
05ef048
doc
richardliaw Aug 7, 2018
83b5d0d
Merge branch 'training_result' into tune_branding
richardliaw Aug 7, 2018
281224d
merging
richardliaw Aug 7, 2018
f12222f
Merge branch 'master' into tune_branding
richardliaw Aug 12, 2018
b7d7a66
Restructure documentation
richardliaw Aug 12, 2018
1adfe69
Auto-register
richardliaw Aug 12, 2018
6cc4d3a
cite
richardliaw Aug 12, 2018
0b7b9f5
toc
richardliaw Aug 12, 2018
f73c6d3
Not including contents
richardliaw Aug 12, 2018
33ca77e
better package ref
richardliaw Aug 12, 2018
d0f6687
some documentation
richardliaw Aug 12, 2018
694094e
Merge branch 'master' into tune_branding
richardliaw Aug 15, 2018
00872e2
trial schedulers
richardliaw Aug 15, 2018
f0b85d4
revamped usage
richardliaw Aug 15, 2018
2803265
final touches
richardliaw Aug 16, 2018
bdc6b9d
note
richardliaw Aug 16, 2018
89daf31
clarify doc strings, address comments
richardliaw Aug 17, 2018
6996f5d
formating
richardliaw Aug 17, 2018
18d5b5e
reformat algs
richardliaw Aug 17, 2018
3c72ecc
issues
richardliaw Aug 17, 2018
ebd46b0
flake8
richardliaw Aug 17, 2018
3a5e042
move docstring for hyperopt
richardliaw Aug 17, 2018
c12e847
nit
richardliaw Aug 17, 2018
44f0845
didn't pass yapf before?
richardliaw Aug 17, 2018
a9e377c
didn't pass yapf before? pt 2
richardliaw Aug 17, 2018
33746d5
move
richardliaw Aug 17, 2018
d3f6ba7
move
richardliaw Aug 17, 2018
c457e94
list
richardliaw Aug 17, 2018
31cd874
fix pitch
richardliaw Aug 17, 2018
2c210cb
revise
richardliaw Aug 17, 2018
e553e12
fix tests
richardliaw Aug 17, 2018
7f46747
note
richardliaw Aug 17, 2018
06b63d7
nit
richardliaw Aug 17, 2018
8494967
usage
richardliaw Aug 17, 2018
ea7594c
add to noindex to fix lint
richardliaw Aug 17, 2018
03ff494
twiddle until it worked
richardliaw Aug 17, 2018
202c72e
nits and comments
richardliaw Aug 17, 2018
ec89110
comment for config
richardliaw Aug 17, 2018
5787ec1
readme
richardliaw Aug 17, 2018
73b1cc1
Refactor Search Algorithm Interface
richardliaw Aug 17, 2018
1f44956
fix and add test
richardliaw Aug 18, 2018
5c2dbc6
fix restore
richardliaw Aug 19, 2018
ed75949
fix tests with proper handling of errors and variable resolution
richardliaw Aug 19, 2018
aafc784
Fix hyperopt tests
richardliaw Aug 19, 2018
ece78c7
Merge branch 'master' into tune_branding
richardliaw Aug 19, 2018
1bf976e
fix py2 issue with strings
richardliaw Aug 19, 2018
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion doc/source/conf.py
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@
"ray.core.generated.TablePubsub",]
for mod_name in MOCK_MODULES:
sys.modules[mod_name] = mock.Mock()
# ray.rllib.models.action_dist.py and
# ray.rllib.models.action_dist.py and
# ray.rllib.models.lstm.py will use tf.VERSION
sys.modules["tensorflow"].VERSION = "9.9.9"

Expand Down
99 changes: 0 additions & 99 deletions doc/source/hyperband.rst

This file was deleted.

Binary file added doc/source/images/tune.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
17 changes: 9 additions & 8 deletions doc/source/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -40,11 +40,11 @@ View the `codebase on GitHub`_.

Ray comes with libraries that accelerate deep learning and reinforcement learning development:

- `Ray Tune`_: Hyperparameter Optimization Framework
- `Ray RLlib`_: Scalable Reinforcement Learning
- `Tune`_: Scalable Hyperparameter Search
- `RLlib`_: Scalable Reinforcement Learning

.. _`Ray Tune`: tune.html
.. _`Ray RLlib`: rllib.html
.. _`Tune`: tune.html
.. _`RLlib`: rllib.html


.. toctree::
Expand All @@ -67,12 +67,13 @@ Ray comes with libraries that accelerate deep learning and reinforcement learnin

.. toctree::
:maxdepth: 1
:caption: Ray Tune
:caption: Tune

tune.rst
tune-config.rst
hyperband.rst
pbt.rst
tune-usage.rst
tune-schedulers.rst
tune-searchalg.rst
tune-package-ref.rst

.. toctree::
:maxdepth: 1
Expand Down
33 changes: 0 additions & 33 deletions doc/source/pbt.rst

This file was deleted.

3 changes: 2 additions & 1 deletion doc/source/rllib-training.rst
Original file line number Diff line number Diff line change
Expand Up @@ -115,11 +115,12 @@ Here is an example of the basic usage:
checkpoint = agent.save()
print("checkpoint saved at", checkpoint)


.. note::

It's recommended that you run RLlib agents with `Tune <tune.html>`__, for easy experiment management and visualization of results. Just set ``"run": AGENT_NAME, "env": ENV_NAME`` in the experiment config.

All RLlib agents are compatible with the `Tune API <tune.html#concepts>`__. This enables them to be easily used in experiments with `Tune <tune.html>`__. For example, the following code performs a simple hyperparam sweep of PPO:
All RLlib agents are compatible with the `Tune API <tune-usage.html>`__. This enables them to be easily used in experiments with `Tune <tune.html>`__. For example, the following code performs a simple hyperparam sweep of PPO:

.. code-block:: python

Expand Down
84 changes: 0 additions & 84 deletions doc/source/tune-config.rst

This file was deleted.

33 changes: 33 additions & 0 deletions doc/source/tune-package-ref.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
Tune Package Reference
=======================

ray.tune
--------

.. automodule:: ray.tune
:members:
:exclude-members: TuneError, Trainable

.. autoclass:: ray.tune.Trainable
:members:
:private-members:

ray.tune.schedulers
-------------------

.. automodule:: ray.tune.schedulers
:members:
:show-inheritance:

ray.tune.suggest
----------------

.. automodule:: ray.tune.suggest
:members:
:exclude-members: function, grid_search, SuggestionAlgorithm
:show-inheritance:

.. autoclass:: ray.tune.suggest.SuggestionAlgorithm
:members:
:private-members:
:show-inheritance:
Loading