tensorflow / benchmarks

A benchmark framework for Tensorflow
Apache License 2.0
1.14k stars 630 forks source link

not using GCE instance #505

Open jjziets opened 3 years ago

jjziets commented 3 years ago

Is there away to use the benchmark.py but not upload to GCE? Im running it on my local system in a docker container but its turning out to be a fight

Traceback (most recent call last): File "benchmark.py", line 193, in benchmark_runner.run_benchmark() File "benchmark.py", line 148, in run_benchmark site_package_info = self._setup() File "benchmark.py", line 52, in _setup self.workspace_dir) File "/root/benchmarks/perfzero/lib/perfzero/utils.py", line 141, in active_gcloud_service download_data([{'url': gcloud_key_file_url, 'local_path': local_path}]) File "/root/benchmarks/perfzero/lib/perfzero/utils.py", line 183, in download_data run_commands([cmd], shell=False) File "/root/benchmarks/perfzero/lib/perfzero/utils.py", line 288, in run_commands cmd, exit_code, stdout)) Exception: "['gsutil', '-m', 'cp', '-r', '-n', 'gs://tf-performance/auth_tokens/benchmark_upload_gce.json', '/root/benchmarks/perfzero/lib/workspace']" failed with code:1 and stdout: ServiceException: 401 Anonymous caller does not have storage.objects.get access to the Google Cloud Storage object. CommandException: 1 file/object could not be transferred.

elgalu commented 3 years ago

@jjziets did you solve this issue?

jjziets commented 3 years ago

@jjziets did you solve this issue?

No. I ended up using another benchmark https://github.com/jjziets/pytorch-benchmark-volta