Fetching markdown files programmatically

[madjin]

Idea: use github api to recursively search responses for markdown files

we usually keep everything here: https://api.github.com/repos/omigroup/gltf-extensions/contents/extensions/2.0?ref=main

example download url: https://raw.githubusercontent.com/omigroup/gltf-extensions/main/extensions/2.0/KHR_audio/README.md

another way is to just clone the repo and grab / convert the markdown files this way

npm install mdpdf -g git clone mkdir docs find extensions/ -name ".md" -exec bash -c 'mkdir -p docs/"$(dirname "{}")" && mv "{}" docs/"{}"' \; find ./extensions -iname ".md" -exec mdpdf '{}' \;

then clean up

this would be useful then to convert to pdf and use in gpt4 langchain stuff: https://github.com/mayooear/gpt4-pdf-chatbot-langchain

[madjin]

for now I added direct links to the raw markdown files hosted on github in txt files