Only the first 100 projects are found when adding projects with gitlab

[mjrider]

What Renovate type are you using? Gitlab

Describe the bug Whwn adding projects with gitlab, only the first 20 are found ( pagination in the api ? )

Did you see anything helpful in debug logs? n/a/

To Reproduce

1. open dashboard with gitlab login with an account with access to more then 20 projects
2. click on ⚙️
3. count the projects, and compare them with the actual list

Expected behavior see more then 20 projects

Screenshots

Additional context Add any other context about the problem here.

[mjrider]

maybe relevant headers from the list projects request

X-Next-Page: 2
X-Page: 1
X-Per-Page: 20
X-Prev-Page: 
X-Total: 39
X-Total-Pages: 2

[rarkins]

Thanks. I've added per_page=100 to the URL so that might alleviate your problem for now. Full solution requires paginating the responses.

[mjrider]

i don't see anything different atm, is it already live ?

[mjrider]

addendum: you added the per_page=100 on the wrong place around line 451 in $('#install-more').click(function() { you need the per_page and not around line 389 in $('#installModalBody').on('change', '.switch', async function() {

[rarkins]

Thanks. can you try again now?

[mjrider]

Works like a charm

[bartlangelaan]

We have ~70 active projects, and ~150 archived projects. Because the list isn't filtered based on archived status, all archived projects still show up which made the list longer as 100 projects. The projects I wanted to enable didn't show up.

By adding &archived=false to the GitLab project API url, only unarchived projects are listed. Archived projects won't work with Renovate anyway. Maybe you can add that to the fetch url as well when you're working on this issue? 😄

[rarkins]

@bartlangelaan archived projects should now be filtered out in that query

[Raimmaster]

Any news regarding this issue? Given that #65 also had this. Or perhaps any current workaround to get the projects we're looking for to use Renovate?

[alecgerona]

@Raimmaster as mentioned by @rarkins in #60, you can just add Renovate bot as a developer/collaborator for your project and it will still work. The only caveat is its execution time which happens hourly rather than relying on a hook.

[Raimmaster]

I've added @renovate-bot to the repo, 21 hrs ago, but no integration MR has been received so far. Any reasons why this may be happening? Note: it does have Developer access.

[alecgerona]

I believe I waited a bit more for mine. YMMV. If it still doesn't appear then something may be wrong.

[rarkins]

@Raimmaster what's the GitLab group or username this is under? I'll check if I can find any newly discovered repos in our DB

[Raimmaster]

The organization/group it's under is leadiq, @rarkins.

[rarkins]

@Raimmaster only one repo is detected (the web app). It syncs hourly, and is not seeing any others. Developer level should be enough for it to be detected though.

[Raimmaster]

Yes, that's the repo where it was added, but no MRs have been received so far.

[rarkins]

A job was in the queue, should be through now

[Raimmaster]

So it's been over 48 hours now, but there's no integration MR. Is the job still in the queue, @rarkins?

[rarkins]

@Raimmaster if you log into the dashboard, can you view the logs? There is an error that I think is caused by your branch naming restrictions

[Raimmaster]

If I log into the dashboard there's nothing there, this is a screenshot of it, even after I checked the repos cog to look for the project (which again, doesn't load because it loads exactly 100 projects and not the one I added @renovate-bot to).

[Raimmaster]

Is it possible you can share the error without disclosing any private details or anything else regarding this, @rarkins?

[rarkins]

If I had to guess, I think your branch naming restrictions don't allow the "renovate/*" prefix.

Please don't continue following up in this issue though as it's not related to the original topic. Open a new issue if you need.

[rarkins]

Pagination should now be working for GitLab when you select the install option. Please comment here once you can test it to confirm it's fixed or reopen the issue