denoland / deploy_feedback

For reporting issues with Deno Deploy
https://deno.com/deploy
74 stars 5 forks source link

[Bug]: TypeError: Queue backlog limit exceeded #559

Closed DonsWayo closed 11 months ago

DonsWayo commented 11 months ago

Problem description

Im trying to make some tries with a lot of new queues, working well all day and now get this error:

TypeError: Queue backlog limit exceeded at async Kv.enqueue (ext:deno_kv/01_db.ts:153:26) at async generateEnq (file:///src/queue.ts:24:5)

the body is:

 await kv.enqueue({ "test": 1 });

Steps to reproduce

  1. create a queue
  2. consume on deno deploy

Expected behavior

process the kv.enqueue

Environment

No response

Possible solution

maybe hit the free limits?

Additional context

No response

igorzi commented 11 months ago

The project reached the queue backlog limit, which is 100K messages. This means that you've enqueued 100K messages without getting dequeued. Was this the intention?

DonsWayo commented 11 months ago

Build a status monitor and test the perfomance, similar thing that already have in AWS.

I cannot see any event log with the dequeued process.

kv.listenQueue((msg) => {
  console.log("msg", msg);
});
igorzi commented 11 months ago

Did you enqueue messages with delay set? Or are they enqueued to be processed immediately?

DonsWayo commented 11 months ago

no, just like that:

 await kv.enqueue({ "test": 1 });

I processed immediately every minute, also see that have a big delay to process 500 events.

After some hours I be able to make more request.