Enhance plural ai scraper

[michaeljguarino]

Summary

Also scrape the repositories api for app docs. Next step would be to dagsterize this and upload to s3 to be auto-synced by model servers.

Test Plan

local

Checklist

• [ ] If required, I have updated the Plural documentation accordingly.
• [ ] I have added tests to cover my changes.
• [ ] I have added a meaningful title and summary to convey the impact of this PR to a user.
• [ ] I have added relevant labels to this PR to help with categorization for release notes.

[stoat-app[bot]]

Easy and customizable dashboards for your build system. Learn more about Stoat ↗︎

Static Hosting

Name	Link	Commit	Status
api-coverage	Visit	06b63c9a337f1e58c30fb62f7c8f1346a8fa0f0a	✅
rtc-coverage	Visit	06b63c9a337f1e58c30fb62f7c8f1346a8fa0f0a	✅
core-coverage	Visit	06b63c9a337f1e58c30fb62f7c8f1346a8fa0f0a	✅
cron-coverage	Visit	06b63c9a337f1e58c30fb62f7c8f1346a8fa0f0a	✅
email-coverage	Visit	06b63c9a337f1e58c30fb62f7c8f1346a8fa0f0a	✅
worker-coverage	Visit	06b63c9a337f1e58c30fb62f7c8f1346a8fa0f0a	✅
api-test-results	Visit	06b63c9a337f1e58c30fb62f7c8f1346a8fa0f0a	✅
graphql-coverage	Visit	06b63c9a337f1e58c30fb62f7c8f1346a8fa0f0a	✅
rtc-test-results	Visit	06b63c9a337f1e58c30fb62f7c8f1346a8fa0f0a	✅
core-test-results	Visit	06b63c9a337f1e58c30fb62f7c8f1346a8fa0f0a	✅
cron-test-results	Visit	06b63c9a337f1e58c30fb62f7c8f1346a8fa0f0a	✅
email-test-results	Visit	06b63c9a337f1e58c30fb62f7c8f1346a8fa0f0a	✅
worker-test-results	Visit	06b63c9a337f1e58c30fb62f7c8f1346a8fa0f0a	✅
graphql-test-results	Visit	06b63c9a337f1e58c30fb62f7c8f1346a8fa0f0a	✅

Job Runtime