[source-sharepoint] connector fetches documents only from the main site

[akozichev]

Connector Name

source-microsoft-sharepoint

Connector Version

0.2.2

What step the error happened?

During the sync

Relevant information

Sharepoint portals are structured in a way so they can host multiple site. Currently connector only recognises files hosted in the main site and everything else is ignored. The change is required so connector would iterate through all site when combining the files list.

Relevant log output

No response

Contribute

• [X] Yes, I want to contribute

[isaac47]

Does the connector also retrieve the permission levels of documents? I'm developing a tool and need to inherit document permission levels to manage user rights effectively.

[nataliekwong]

Grooming notes:

• Most businesses create a different, custom site and don't use the default site. The default Sharepoint site is hard-coded as it assumes users use the default site, so this is a blocker.
• Allow users to specify a site_id or multiple set_id values in the source config. Leaving it empty would sync all discovered site_id

Example default site: https://{{company}}.sharepoint.com/Shared%20Documents/{{file name}} Example custom site: https://{{company}}.sharepoint.com/sites/{{folder_name}}/Shared%20Documents/{{file name}}

fyi @natikgadzhi I added this to the community board, but let me know if the team is not working on file sources

[natikgadzhi]

Yeah, file sources are a bit out of scope for now, but the common bottleneck usually is design partners to verify test builds with. We'll get to this.

[natikgadzhi]

We also potentially have design partners willing to test with us.