stephenoffer
commented
5 years ago Since you didn't post the source code, I'm assuming that you tried something like this?
import ray
import ray.rllib.agents.a3c as a3c
from ray.tune.logger import pretty_print
import line_profiler
@profile
def main():
ray.init()
config = a3c.DEFAULT_CONFIG.copy()
config["num_gpus"] = 0
config["num_workers"] = 1
agent = a3c.A3CAgent(config=config, env="SpaceInvaders-v4")
for i in range(1000):
result = agent.train()
print(pretty_print(result))
if i % 100 == 0:
checkpoint = agent.save()
print("checkpoint saved at", checkpoint)
if __name__ == "__main__":
main()And then you called it with:
kernprof -l rllib_profiler.pyFor only 10 epochs in this example, it worked fine:
$ python -m line_profiler rllib_profiler.py.lprof
Timer unit: 1e-06 s
Total time: 89.1993 s
File: rllib_profiler.py
Function: main at line 6
Line # Hits Time Per Hit % Time Line Contents
==============================================================
6 @profile
7 def main():
8 1 538095.0 538095.0 0.6 ray.init()
9 1 55.0 55.0 0.0 config = a3c.DEFAULT_CONFIG.copy()
10 1 2.0 2.0 0.0 config["num_gpus"] = 0
11 1 1.0 1.0 0.0 config["num_workers"] = 1
12 1 2102656.0 2102656.0 2.4 agent = a3c.A3CAgent(config=config, env="SpaceInvaders-v4")
13
14 11 17.0 1.5 0.0 for i in range(10):
15 10 86348015.0 8634801.5 96.8 result = agent.train()
16 10 182952.0 18295.2 0.2 print(pretty_print(result))
17
18 10 27.0 2.7 0.0 if i % 100 == 0:
19 1 27420.0 27420.0 0.0 checkpoint = agent.save()
20 1 37.0 37.0 0.0 print("checkpoint saved at", checkpoint)
heeryerate
richardliaw
System information
Describe the problem
I have been trying to use profiling with ray, for which I have installed line_profiler. If I try to run the code as specified in https://ray.readthedocs.io/en/latest/user-profiling.html, I keep on getting the
NameError: name 'profile' is not defined. However, if I try to run something outside of ray, then I never get this error for line_profiler, and it works perfectly. Has anyone come across this issue?Source code / logs