mattt
commented
2 months ago Hi @platform-kit. Thanks for reporting this issue. File uploads appear to be working for other models like stability-ai/stable-diffusion-3, and I'm not aware of any historical or ongoing incidents around that. However, I was able to reproduce this failure myself.
Logs
``` Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/cog/server/runner.py", line 303, in _upload_files return self._file_uploader(output) File "/usr/local/lib/python3.10/site-packages/cog/server/runner.py", line 212, in file_uploader return upload_files(output, upload_file=upload_file) File "/usr/local/lib/python3.10/site-packages/cog/json.py", line 53, in upload_files return [upload_files(value, upload_file) for value in obj] File "/usr/local/lib/python3.10/site-packages/cog/json.py", line 53, inThe ultimate failure was cog.server.runner.FileUploadError, but the relevant part of the trace was here:
File "/usr/local/lib/python3.10/site-packages/cog/json.py", line 53, in <listcomp>
return [upload_files(value, upload_file) for value in obj]
File "/usr/local/lib/python3.10/site-packages/cog/json.py", line 55, in upload_files
with obj.open("rb") as f:
File "/usr/local/lib/python3.10/pathlib.py", line 1119, in open
return self._accessor.open(self, mode, buffering, encoding, errors,
FileNotFoundError: [Errno 2] No such file or directory: 'workspace/gradio_output.mp4'So the problem isn't that uploading is broken, it's that the file can't be located.
Looking at internal logs, the success rate for camenduru/lgm does appear to change around May 2nd, which corresponds to our rollout of Cog v0.9.6. But I can't tell for sure whether that's a coincidence.
Looking into the source code there are a few things that seem suspect:
- This call to
os.chdircould be messing with where - The
cog.yamlfile, which is... well, it's doing a lot
I can't account for why this stopped working, but I'll continue looking into it.
I've reached out to Camb-ai in the linked issue and will work with them to try to get to the bottom of this.
platform-kit
arnavmehta7
Model: https://replicate.com/camenduru/lgm
This is happening on many models, including ones that have been usable on Replicate for some time now.
See also: https://discord.com/channels/775512803439280149/779461485277347850/1243322233099653130 https://discord.com/channels/775512803439280149/1144193090970722394/1215721819143929917
also: search "upload error" or just "upload" for many more instances of people reporting this.
No response from the Replicate team that I could see.
Has something about cog's file output behavior changed?
This is the only conclusion I can come to, as the code I have used to export files (mp3, wav, etc) on my old models is not working on new ones.
For context - I am currently trying to help CambAI release a versoin of their Mars5-TTS that uses Replicate's native file output to return audio. However they haven't been able to make it work, nor have I.
Relevant issue: https://github.com/Camb-ai/MARS5-TTS/issues/40