CredentialEngine / ai-course-crawler

Apache License 2.0
1 stars 0 forks source link

Landing Page Updates #25

Open jeannekitchens opened 3 months ago

jeannekitchens commented 3 months ago

Update the landing page.

It should use the Credential Engine logo and a favicon. I'm getting both from our communications manager and will attach them here. Use the text below. We'll put the instructions on our CR Guidance site and will need a link added, once the instructions exist on that site. In the meantime, here's the text.

Welcome to Credential Engine's AI Crawler This tool is designed to crawl public web pages, extract content, and transform it into Credential Transparency Description Language (CTDL) formats for easy upload to the Credential Registry Publishing System using pre-defined bulk upload templates.

Current Capabilities: At present, the AI Crawler is optimized for extracting and transforming course information from web pages that meet specific formatting criteria. As we continue to refine the tool, we plan to extend its capabilities to include other CTDL classes, such as credentials, learning programs, and competencies.

How It Works:

Account Setup: Users must have an account set up by the Credential Engine team to access the tool.

Provide the URL: Enter the URL that directly displays the course content. For course catalogs, use the URL that shows a list of course descriptions or links. The AI Crawler requires the courses to be visible directly on the page.

Crawling Process: Once you enter the URL, the tool will begin crawling the web pages. You don't need to keep the browser window open—just wait for two emails from the system. The first email will notify you that the crawling process has started. The second email will inform you whether the data extraction and transformation were successful or failed.

Download the Results: If the process is successful, the email will include a link to download the pre-defined bulk upload template. The template is ready for use, with the header row formatted for bulk upload. Each subsequent row represents a single resource, such as a course.

Review and Upload: After downloading the bulk upload CSV, review it for accuracy. Once confirmed, you can upload it to the Credential Registry Publishing System using the Bulk Upload System.

Getting Started:

To begin a new extraction, select "Catalogues" from the menu, then choose "+Add Catalogue."

Contact Credential Engine:

Email publishing@credentialengine.org for assistance. We check this email regularly during normal U.S. business hours.

image