Closed alyashev closed 1 year ago
run: ~/src/pti-gpu/tools/onetrace/build/onetrace --chrome-call-logging --chrome-device-timeline python -u ds_scripts/bloom/bloom_ds_inference.py --name bigscience/bloom-560m --dtype=float16 --benchmark --ki --greedy message: python: /home/alyashev/src/pti-gpu/tools/onetrace/../cl_tracer/cl_kernel_collector.h:417: static void ClKernelCollector::ComputeHostTimestamps(const ClKernelInstance*, cl_ulong, cl_ulong, uint64_t&, uint64_t&, uint64_t&, uint64_t&): Assertion `instance->device_sync <= queued' failed.
With the latest driver onetrace is not asserting anymore.
run: ~/src/pti-gpu/tools/onetrace/build/onetrace --chrome-call-logging --chrome-device-timeline python -u ds_scripts/bloom/bloom_ds_inference.py --name bigscience/bloom-560m --dtype=float16 --benchmark --ki --greedy message: python: /home/alyashev/src/pti-gpu/tools/onetrace/../cl_tracer/cl_kernel_collector.h:417: static void ClKernelCollector::ComputeHostTimestamps(const ClKernelInstance*, cl_ulong, cl_ulong, uint64_t&, uint64_t&, uint64_t&, uint64_t&): Assertion `instance->device_sync <= queued' failed.