Due to how we profile operations (i.e. we use monkey-patched hooks), we end up profiling inconsequential operations like dim, size, etc. These operations are not useful to have in the profile because they are metadata operations. They often get attributed to other more important code lines (e.g., batch norm and dim), which is undesirable for the end-user's understandability.
Due to how we profile operations (i.e. we use monkey-patched hooks), we end up profiling inconsequential operations like
dim
,size
, etc. These operations are not useful to have in the profile because they are metadata operations. They often get attributed to other more important code lines (e.g., batch norm and dim), which is undesirable for the end-user's understandability.