Error occured while attempting to split the file into chunks

[BryanKofsky]

Describe the bug Error An error occured while attempting to split the file into chunks, or while sending the chunks to OpenAI. If the full error below says "Unidentified connection error", please double-check that you have entered valid billing info in your OpenAI account. Afterward, generate a new API key and enter it in the OpenAI app here in Pipedream. Then, try running the workflow again. If that does not work, please open an issue at this workflow's Github repo: https://github.com/TomFrankly/pipedream-notion-voice-notes/issues Full error from OpenAI: Connection error.

Details: at Object.chunkFileAndTranscribe (file:///tmp/pdg/dist/code/4cf355a52ab0f9c275ba953eea42492276c4b796f961fdffefa87942b1ced4df/code/Notion-Voice-Notes.mjs:391:11) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at Object.run (file:///tmp/pdg/dist/code/4cf355a52ab0f9c275ba953eea42492276c4b796f961fdffefa87942b1ced4df/code/Notion-Voice-Notes.mjs:1901:22) at null.executeComponent (/var/task/launch_worker.js:287:22) at MessagePort.messageHandler (/var/task/launch_worker.js:786:28)

Which cloud storage app are you using? (Google Drive, Dropbox, or OneDrive)

Google Drive

Have you tried updating your workflow?

Yes, including setting up a completely new instance.

Does the issue only happen while testing the workflow, or does it happen during normal, automated runs? Both

Please paste the contents of your Logs tab from the notion_voice_notes action step.

PM Checking that file is under 300mb...

4/8/2024, 2:38:51 PM File size is approximately 6.1mb.

4/8/2024, 2:38:51 PM File is under the size limit. Continuing...

4/8/2024, 2:38:51 PM Checking if the user set languages...

4/8/2024, 2:38:51 PM No language set. Whisper will attempt to detect the language.

4/8/2024, 2:38:51 PM Successfully got duration: 256 seconds

4/8/2024, 2:38:51 PM Chunking file: /tmp/Sample Audio File (1).mp3

4/8/2024, 2:38:51 PM Chunks created successfully. Transcribing chunks: chunk-000.mp3

4/8/2024, 2:38:51 PM Transcribing file: chunk-000.mp3

4/8/2024, 2:40:21 PM Attempting to clean up the /tmp/ directory...

4/8/2024, 2:40:21 PM Cleaning up /tmp/chunks-2epVUoZNcUwgowtHo50YpqBVYPe...

4/8/2024, 2:40:21 PM ACTIVE_HANDLE This step was still trying to run code when the step ended. Make sure you promisify callback functions and await all Promises. (Reason: ChildProcess, Learn more: https://pipedream.com/docs/code/nodejs/async/)

[TomFrankly]

@BryanKofsky if your account has real-money credits (non-promo credits), and you're using an API key you generated after adding those credits, then this is just due to OpenAI's service being overloaded with requests.

"Connection Error" means OpenAI rejected the connection request. I don't think there's anything we can do other than try again later when it happens, and within the limitations of Pipedream's free account, that means you'll need to go into the Pipedream dashboard and Replay the failed run.

[BryanKofsky]

Interesting. I'm paid on open AI, but not pipe dream... Yet.

It's been like that for a while now. Thanks, for the quick response!

Bryan Kofsky Sales Engineer | Growth Marketer | Tech Enthusiast

🌐 www.bkofsky.com 📞 419-825-6723 💼 https://www.linkedin.com/in/bkofsky/

On Tue, Apr 9, 2024, 9:39 AM Thomas Frank @.***> wrote:

@BryanKofsky https://github.com/BryanKofsky if your account has real-money credits (non-promo credits), and you're using an API key you generated after adding those credits, then this is just due to OpenAI's service being overloaded with requests.

"Connection Error" means OpenAI rejected the connection request. I don't think there's anything we can do other than try again later when it happens, and within the limitations of Pipedream's free account, that means you'll need to go into the Pipedream dashboard and Replay the failed run.

— Reply to this email directly, view it on GitHub https://github.com/TomFrankly/pipedream-notion-voice-notes/issues/84#issuecomment-2045204068, or unsubscribe https://github.com/notifications/unsubscribe-auth/BHV2KHT4IR2TK3DGZBONU4TY4PVRFAVCNFSM6AAAAABF5HJ77OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANBVGIYDIMBWHA . You are receiving this because you were mentioned.Message ID: @.***>

[TomFrankly]

@BryanKofsky yeah it's a tough one. I don't believe upgrading to a paid Pipedream account will fix it.

I've just messaged the Pipedream team to double-check if there's anything in the underlying infrastructure that would be causing the issue, but I still think it's due to OpenAI being overloaded.

Nearly everyone who reports this issue solves it either by adding credit at OpenAI (not ChatGPT Plus) and making a new API key, or just by waiting and trying again if they already did that first step.

My guess is that the Whisper endpoint in particular gets overloaded at times.

[BryanKofsky]

You rock, thank you! I will keep an eye on that.... Instead of resetting it up from scratch to see if there's any issue from a lack of update or something on my end.

I met with a friend (younger brother of a good friend) who was showing me his process for YouTube ideation and scripting, and he mentioned to his teammate, this is why we need a record this stuff. Ding ding ding! 😆 He was mind-blown at the possibilities for this.

Bryan Kofsky Sales Engineer | Growth Marketer | Tech Enthusiast

🌐 www.bkofsky.com 📞 419-825-6723 💼 https://www.linkedin.com/in/bkofsky/

On Tue, Apr 9, 2024, 9:59 AM Thomas Frank @.***> wrote:

@BryanKofsky https://github.com/BryanKofsky yeah it's a tough one. I don't believe upgrading to a paid Pipedream account will fix it.

I've just messaged the Pipedream team to double-check if there's anything in the underlying infrastructure that would be causing the issue, but I still think it's due to OpenAI being overloaded.

Nearly everyone who reports this issue solves it either by adding credit at OpenAI (not ChatGPT Plus) and making a new API key, or just by waiting and trying again if they already did that first step.

My guess is that the Whisper endpoint in particular gets overloaded at times.

— Reply to this email directly, view it on GitHub https://github.com/TomFrankly/pipedream-notion-voice-notes/issues/84#issuecomment-2045245986, or unsubscribe https://github.com/notifications/unsubscribe-auth/BHV2KHT6Y6RA7JGR6YJSEBLY4PX27AVCNFSM6AAAAABF5HJ77OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANBVGI2DKOJYGY . You are receiving this because you were mentioned.Message ID: @.***>

[TomFrankly]

Yeah it's super helpful! I record the ideas for most of my videos using this now.

Definitely no need to set up the entire workflow from scratch here; hopefully if you try again later, the issue will be resolved.

Btw, my team and I are also working on a new tool: https://flylighter.com/

We're very near releasing our web clipper. Once we have our mobile app out, we'll be adding this voice notes workflow to it and making it much, much better – for example, in this version, it's not at all easy to have different voice-recording destinations for different purposes. In Flylighter, it'll be trivial.

[BryanKofsky]

Dude, I'm using UBCC and Flylighter beta 😎 The feature coming to the mobile app is awesome to know though.

Side note: interesting in my journey how I just started using the b-roll database. And now it looks like the sponsorship side of the template is going to become extremely helpful. Your stuff has helped my a lot, and continues as I grow (baby steps).

Bryan Kofsky Sales Engineer | Growth Marketer | Tech Enthusiast

🌐 www.bkofsky.com 📞 419-825-6723 💼 https://www.linkedin.com/in/bkofsky/

On Tue, Apr 9, 2024, 10:16 AM Thomas Frank @.***> wrote:

Yeah it's super helpful! I record the ideas for most of my videos using this now.

Definitely no need to set up the entire workflow from scratch here; hopefully if you try again later, the issue will be resolved.

Btw, my team and I are also working on a new tool: https://flylighter.com/

We're very near releasing our web clipper. Once we have our mobile app out, we'll be adding this voice notes workflow to it and making it much, much better – for example, in this version, it's not at all easy to have different voice-recording destinations for different purposes. In Flylighter, it'll be trivial.

— Reply to this email directly, view it on GitHub https://github.com/TomFrankly/pipedream-notion-voice-notes/issues/84#issuecomment-2045290928, or unsubscribe https://github.com/notifications/unsubscribe-auth/BHV2KHVL3U3XO5PLZ64Q6DLY4PZ3BAVCNFSM6AAAAABF5HJ77OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANBVGI4TAOJSHA . You are receiving this because you were mentioned.Message ID: @.***>

[TomFrankly]

Oh awesome! Super glad to hear that 😁

We're nearly done with the next Flylighter beta, and it's a massive improvement. Way faster, way more intuitive, and we've got on-page highlights working as well.

[TomFrankly]

@BryanKofsky one thing to note: The error message you posted looks a bit older than the ones I have coded in the latest public version of the workflow.

There might be an update available for you: https://thomasjfrank.com/how-to-transcribe-audio-to-text-with-chatgpt-and-notion/#update