search

pytorch / torchchat

Run PyTorch LLMs locally on servers, desktop and mobile
BSD 3-Clause "New" or "Revised" License
3.1k stars 192 forks source link

[UX] ET is super wordy with warnings #827

Open mikekgfb opened 3 months ago

mikekgfb commented 3 months ago

"UserWarning: Mutation on a buffer in the model is detected. ExecuTorch assumes buffers that are mutated in the graph have a meaningless initial state, only the shape and dtype will be serialized"

How can a user who got the memo turn this off? x-ref: https://github.com/pytorch/torchchat/issues/753#issuecomment-2107694407

Also the following ET errors keep spewing in copious amounts - if it's an error we should stop, if it's a debug message we should make it go away.

  [program.cpp:130] InternalConsistency verification requested but not available
  [method.cpp:939] Overriding output data pointer allocated by memory plan is not allowed.
byjlw commented 1 month ago

what steps did you take to get this message? I'm not seeing it on my end.