taskforcesh / bullmq-pro-support

Support repository for BullMQ Pro edition.
1 stars 0 forks source link

Can you check the events maxLen setting is work for pro with group feature? #60

Open for2gles opened 1 year ago

for2gles commented 1 year ago

Hi, I have issue on Redis stream size for the events.

Before the same issue I had, I have fixed this from the another queue by setting stream.events.maxLen to 10 just like this. And the size of the event stream went down when I use just normal bullmq.

But it looks not work what if I use the Bull Pro & group

this is my setting

const createdQueue = new Queue<T>(name, {
    connection: RedisIO,
    defaultJobOptions: {
        removeOnComplete: 3,
        removeOnFail: 10,
    },
    streams: {
      events: {
        maxLen: 10,
      },
    },
  });

But the size of Redis stream event when several gigabyte even 스크린샷 2023-09-18 오전 11 45 14 스크린샷 2023-09-18 오전 11 45 20

manast commented 1 year ago

I am confused about this... you mean the same maxLen setting does not work on the Pro version, but works on the standard version?

jaroslaw-weber commented 1 year ago

this is critical issue, it can fill up the redis very quickly (every few days needs to manually clean this up)

for2gles commented 1 year ago

@manast It looks working without group feature, but doesn't look working with group feature

manast commented 1 year ago

Ok, We are looking into it.

roggervalf commented 1 year ago

hi @for2gles, could you please try version 6.6.1, we introduce some improvements regarding our events