c2siorg / Project-Explainer

Set of tools to explain github repositories using large language models
https://huggingface.co/spaces/SriPravallikaB/projectexplainer
Apache License 2.0
14 stars 12 forks source link

Improve heading's paragraph extraction from markdown #29

Open Haitham-AbdelKarim opened 6 months ago

Haitham-AbdelKarim commented 6 months ago

The extract headings with paragraphs from the markdown function considered the paragraph of a heading to be the rest of the markdown content. However, it should extract up to the start of the next heading. If no subsequent heading found, the rest of the content is considered the paragraph. This change makes the paragraph extraction more accurate and relevant to each heading.