-
-
Notifications
You must be signed in to change notification settings - Fork 402
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Remove redundant code in tutorials #1159
base: master
Are you sure you want to change the base?
Conversation
It may be good to mention somewhere in the tutorials the LRU caching thing and then link to an environment which uses it, but yeah I agree having it in the tutorials is a bit confusing and extra verbose |
@elliottower I may have to take a different approach to this actually. Tests are failing because the space object have to return the exact same object. |
Ah right yeah cause the random seeding the lru cache stuff is necessary. Maybe we could make a helper function to define the static space objects and do the caching for you instead of all this boiler plate code |
Interesting commit messages hahah looks good though, the LRU cache I guess is not necessary for the api test to pass here? May still be worth mentioning the situations in which you do need the cache code (not 100% certain of when this is myself, I feel like even when they are separate fixed objects I’ve had to do the cache code). The tutorials might also benefit from explaining what exactly happens when you do env.seed() and explain that you in some cases want to seed action spaces or even observation spaces if there is anything stochastic in there (e.g., our generated agents test envs). |
Tbh the cache code seems redundant,
|
Ok turns out I was wrong, import timeit
import functools
stuff: dict[str, int] = dict()
for i in range(1000):
stuff[str(i)] = i
@functools.lru_cache(maxsize=None)
def get_stuff_lru(_id: str):
return stuff[_id]
get_stuff_no_lru = lambda _id: stuff[_id]
def test_lru():
for key in stuff.keys():
get_stuff_lru(key)
def test_no_lru():
for key in stuff.keys():
get_stuff_no_lru(key)
print("Using lru: ", timeit.timeit("test_lru()", number=100000, setup="from __main__ import test_lru"))
print("Just a dict: ", timeit.timeit("test_no_lru()", number=100000, setup="from __main__ import test_no_lru")) Result:
|
Your call on how to handle the lru caching stuff, I honestly don't know too much about which parts of the environment are the bottlenecks, my guess is this is a super minor component that probably doesn't matter (I imagine Gymnasium doesn't use the caching anywhere for example, but they don't have dicts of agent IDs). I did a search through the pz repo for lru_cache and found some error messages that say it in the API test and parallel API test, but it isn't used in any internal environments, and is only used in the two environment creation tutorials (aec_rps.py/parallel_rps.py and the prisoners tutorial has it as well). Honestly not sure what the best thing to do is here, would prefer to get some other opinions, I feel like when I tested it out in the past I found that there were some cases where an environment shouldn't need it but the lru cache was the only thing that worked to make the test pass. So that's a reason to at least keep it in the error message, but there may be a better way to fix it in that case / succinct way to explain the best practice.
|
Actually, I'm indifferent about leaving it in the error message. I think having the function return the same object in the error message is sufficient. The lru cache idea to me just seems like extra fluff in terms of what PZ should be. If users want to make their environments faster this should be the least of their concerns. I view this as sort of legacy code that's added to fix a the seeding tests that were introduced later. |
Makes sense, agreed that it is pretty hacky and fluff. I think if it does get removed it should be very clear how to return the correct action space or observation space, and the best practices for defining them, as removing the functools thing in the error message may lead to people being confused as to how to make the test pass. Gymnasium errors linking to their documentation and specific pages seems like a great thing to have here, but the problem is our starter scripts (the AEC and parallel RPS ones at least) are pretty old and not necessarily the best practices either. |
I think the error message about returning the exact same object is reasonable. That's a pretty basic OOP concept. |
Fair enough, I was just thinking in terms of like, how some of the tutorials and envs define |
With the lambda function, there is no need for lru cache, I think that's kind of the most pure Python way of doing it in a way that satisfies PZ's requirements. Your suggestion is fair, we can just leave the lru cache error message and remove lru cache from the tutorials. |
Could you fully remove it from the other tutorials in this PR as well? This stuff also has it https://pettingzoo.farama.org/tutorials/custom_environment/2-environment-logic/#code |
Sure, got it. I'll do a ripgrep and nuke all instances of it except in the warnings once I'm back behind a bigger monitor. |
What the fk is that error, looks like it's related to #1160. Edit: doesn't look like it. |
Oh didn’t see this but that’s highly bizarre no idea why pytest plugins would be trying to be imported from pz classic |
Description
This removes some redundant code in the tutorials which add unnecessary confusion to new users.
Type of change