Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Integration of aim metric tracker as an alternative to tensorboardx in ray tune #30537

Closed
ju2ez opened this issue Nov 21, 2022 · 3 comments · Fixed by #32041
Closed

Integration of aim metric tracker as an alternative to tensorboardx in ray tune #30537

ju2ez opened this issue Nov 21, 2022 · 3 comments · Fixed by #32041
Labels
enhancement Request for new feature and/or capability tune Tune-related issues

Comments

@ju2ez
Copy link
Contributor

ju2ez commented Nov 21, 2022

Description

I suggest integrating the aim metric tracker to ray tune as an alternative to tensorboardx.

I already have a working implementation of this inspired by https://github.com/ray-project/ray/blob/master/python/ray/tune/logger/tensorboardx.py and I am already in touch with aim:
aimhubio/aim#2369

If this feature is considered useful I'm happy to implement it.

Use case

Tensorboardx has some donwsides to it like poor scalability and having another open source metrics tracker as a possible alternative could be quite valuable.
@ju2ez ju2ez added the enhancement Request for new feature and/or capability label Nov 21, 2022
@ju2ez ju2ez mentioned this issue Nov 26, 2022
Closed
7 tasks
@ju2ez
Copy link
Contributor Author

ju2ez commented Dec 1, 2022

@krfricke , maybe that is interesting to you, since it is very much based on your tensorboardx logger implementation.

@richardliaw
Copy link
Contributor

@ju2ez that's awesome. I think you could open a pull-request here? cc @krfricke to make the final call.

@ju2ez
Copy link
Contributor Author

ju2ez commented Dec 10, 2022

@ju2ez that's awesome. I think you could open a pull-request here? cc @krfricke to make the final call.

@richardliaw , thanks for the reply :)
Only the test are missing but PR is already out.

#30674

@krfricke krfricke added the tune Tune-related issues label Jan 18, 2023
@ju2ez ju2ez mentioned this issue Jan 30, 2023
Merged
7 tasks
richardliaw pushed a commit that referenced this issue Mar 3, 2023
@ju2ez
[air][tune] Aim logger (#32041)
98cee18 
Co-authored-by: Justin Yu <justinvyu@anyscale.com>
Co-authored-by: angelinalg <122562471+angelinalg@users.noreply.github.com>
Co-authored-by: tmynn <hovhannes.tamoyan@gmail.com>
Co-authored-by: Justin Yu <justinvyu@berkeley.edu>
Closes #30537
Fixes #30674
ProjectsByJackHe pushed a commit to ProjectsByJackHe/ray that referenced this issue Mar 21, 2023
@ju2ez @ProjectsByJackHe
[air][tune] Aim logger (ray-project#32041)
55a1428 
Co-authored-by: Justin Yu <justinvyu@anyscale.com>
Co-authored-by: angelinalg <122562471+angelinalg@users.noreply.github.com>
Co-authored-by: tmynn <hovhannes.tamoyan@gmail.com>
Co-authored-by: Justin Yu <justinvyu@berkeley.edu>
Closes ray-project#30537
Fixes ray-project#30674

Signed-off-by: Jack He <jackhe2345@gmail.com>
edoakes pushed a commit to edoakes/ray that referenced this issue Mar 22, 2023
@ju2ez @edoakes
[air][tune] Aim logger (ray-project#32041)
e6dbd82 
Co-authored-by: Justin Yu <justinvyu@anyscale.com>
Co-authored-by: angelinalg <122562471+angelinalg@users.noreply.github.com>
Co-authored-by: tmynn <hovhannes.tamoyan@gmail.com>
Co-authored-by: Justin Yu <justinvyu@berkeley.edu>
Closes ray-project#30537
Fixes ray-project#30674

Signed-off-by: Edward Oakes <ed.nmi.oakes@gmail.com>
peytondmurray pushed a commit to peytondmurray/ray that referenced this issue Mar 22, 2023
@ju2ez @peytondmurray
[air][tune] Aim logger (ray-project#32041)
5947002 
Co-authored-by: Justin Yu <justinvyu@anyscale.com>
Co-authored-by: angelinalg <122562471+angelinalg@users.noreply.github.com>
Co-authored-by: tmynn <hovhannes.tamoyan@gmail.com>
Co-authored-by: Justin Yu <justinvyu@berkeley.edu>
Closes ray-project#30537
Fixes ray-project#30674
elliottower pushed a commit to elliottower/ray that referenced this issue Apr 22, 2023
@ju2ez @elliottower
[air][tune] Aim logger (ray-project#32041)
44de093 
Co-authored-by: Justin Yu <justinvyu@anyscale.com>
Co-authored-by: angelinalg <122562471+angelinalg@users.noreply.github.com>
Co-authored-by: tmynn <hovhannes.tamoyan@gmail.com>
Co-authored-by: Justin Yu <justinvyu@berkeley.edu>
Closes ray-project#30537
Fixes ray-project#30674

Signed-off-by: elliottower <elliot@elliottower.com>
ProjectsByJackHe pushed a commit to ProjectsByJackHe/ray that referenced this issue May 4, 2023
@ju2ez @ProjectsByJackHe
[air][tune] Aim logger (ray-project#32041)
101de31 
Co-authored-by: Justin Yu <justinvyu@anyscale.com>
Co-authored-by: angelinalg <122562471+angelinalg@users.noreply.github.com>
Co-authored-by: tmynn <hovhannes.tamoyan@gmail.com>
Co-authored-by: Justin Yu <justinvyu@berkeley.edu>
Closes ray-project#30537
Fixes ray-project#30674

Signed-off-by: Jack He <jackhe2345@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement Request for new feature and/or capability tune Tune-related issues
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[air][tune] Aim logger ju2ez/ray
[air][tune] Aim logger ju2ez/ray
3 participants
@richardliaw @krfricke @ju2ez