search

pytorch / executorch

On-device AI across mobile, embedded and edge for PyTorch
https://pytorch.org/executorch/
Other
2.24k stars 376 forks source link

LLaVA example fails with error #6512

Open hannakoepcke opened 1 month ago

hannakoepcke commented 1 month ago

🐛 Describe the bug

Following https://github.com/pytorch/executorch/blob/main/examples/models/llava/README.md I execute python -m executorch.examples.models.llava.export_llava --pte-name llava.pte --with-artifacts --no-use-sdpa-with-kv-cache and get the following error

Traceback (most recent call last): File "/home/ec2-user/anaconda3/envs/executorch/lib/python3.10/runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "/home/ec2-user/anaconda3/envs/executorch/lib/python3.10/runpy.py", line 86, in _run_code exec(code, run_globals) File "/home/ec2-user/executorch/examples/models/llava/export_llava.py", line 327, in <module> main() File "/home/ec2-user/executorch/examples/models/llava/export_llava.py", line 305, in main executorch_program = export_all(llava_model) File "/home/ec2-user/executorch/examples/models/llava/export_llava.py", line 230, in export_all executorch_program = lowered_and_edge.to_executorch( File "/home/ec2-user/executorch/exir/program/_program.py", line 1357, in to_executorch return ExecutorchProgramManager( File "/home/ec2-user/executorch/exir/program/_program.py", line 1411, in __init__ self._pte_data: Cord = _serialize_pte_binary( File "/home/ec2-user/executorch/exir/_serialize/_program.py", line 445, in serialize_pte_binary result: _FlatbufferResult = _program_json_to_flatbuffer( File "/home/ec2-user/executorch/exir/_serialize/_flatbuffer.py", line 277, in _program_json_to_flatbuffer schema_info = _prepare_schema( File "/home/ec2-user/executorch/exir/_serialize/_flatbuffer.py", line 148, in _prepare_schema schemas = _ResourceFiles([program_schema] + deps) File "/home/ec2-user/executorch/exir/_serialize/_flatbuffer.py", line 105, in __init__ self._files[name] = importlib.resources.read_binary(__package__, name) File "/home/ec2-user/anaconda3/envs/executorch/lib/python3.10/importlib/resources.py", line 88, in read_binary with open_binary(package, resource) as fp: File "/home/ec2-user/anaconda3/envs/executorch/lib/python3.10/importlib/resources.py", line 46, in open_binary return reader.open_resource(resource) File "/home/ec2-user/anaconda3/envs/executorch/lib/python3.10/importlib/abc.py", line 433, in open_resource return self.files().joinpath(resource).open('rb') File "/home/ec2-user/anaconda3/envs/executorch/lib/python3.10/pathlib.py", line 1117, in open return self._accessor.open(self, mode, buffering, encoding, errors, FileNotFoundError: [Errno 2] No such file or directory: '/home/ec2-user/executorch/exir/_serialize/program.fbs'

Versions

PyTorch version: 2.5.0+cpu Is debug build: False CUDA used to build PyTorch: None ROCM used to build PyTorch: N/A

OS: Amazon Linux 2023.6.20241010 (x86_64) GCC version: (GCC) 11.4.1 20230605 (Red Hat 11.4.1-2) Clang version: Could not collect CMake version: version 3.30.5 Libc version: glibc-2.34

Python version: 3.10.0 (default, Mar 3 2022, 09:58:08) [GCC 7.5.0] (64-bit runtime) Python platform: Linux-6.1.112-122.189.amzn2023.x86_64-x86_64-with-glibc2.34 Is CUDA available: False CUDA runtime version: No CUDA CUDA_MODULE_LOADING set to: N/A GPU models and configuration: No CUDA Nvidia driver version: No CUDA cuDNN version: No CUDA HIP runtime version: N/A MIOpen runtime version: N/A Is XNNPACK available: True

CPU: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 46 bits physical, 48 bits virtual Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: GenuineIntel Model name: Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz CPU family: 6 Model: 62 Thread(s) per core: 2 Core(s) per socket: 8 Socket(s): 1 Stepping: 4 BogoMIPS: 4985.99 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx rdtscp lm constant_tsc rep_good nopl xtopology cpuid tsc_known_freq pni pclmulqdq ssse3 cx16 pcid sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm pti fsgsbase smep erms xsaveopt Hypervisor vendor: Xen Virtualization type: full L1d cache: 256 KiB (8 instances) L1i cache: 256 KiB (8 instances) L2 cache: 2 MiB (8 instances) L3 cache: 25 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported Vulnerability L1tf: Mitigation; PTE Inversion Vulnerability Mds: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown Vulnerability Meltdown: Mitigation; PTI Vulnerability Mmio stale data: Unknown: No mitigations Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Retpoline Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Not affected

Versions of relevant libraries: [pip3] executorch==0.4.0a0+6a085ff [pip3] numpy==1.21.3 [pip3] torch==2.5.0+cpu [pip3] torchao==0.6.1 [pip3] torchaudio==2.5.0+cpu [pip3] torchsr==1.0.4 [pip3] torchvision==0.20.0+cpu [conda] executorch 0.4.0a0+6a085ff pypi_0 pypi [conda] numpy 1.21.3 pypi_0 pypi [conda] torch 2.5.0+cpu pypi_0 pypi [conda] torchao 0.6.1 pypi_0 pypi [conda] torchaudio 2.5.0+cpu pypi_0 pypi [conda] torchsr 1.0.4 pypi_0 pypi [conda] torchvision 0.20.0+cpu pypi_0 pypi

JacobSzwejbka commented 1 month ago

@larryliu0820 @dbort Can you take a look? Seems like a flatbuffer issue