Extract source symbols and strings using Pygments

aboutcode-org / purldb

Tools to create and expose a database of purls (Package URLs). This project is sponsored by NLnet project https://nlnet.nl/project/vulnerabilitydatabase/ and nexB for https://www.aboutcode.org/ Chat is at https://gitter.im/aboutcode-org/discuss

https://purldb.readthedocs.io/

35 stars 23 forks source link

Extract source symbols and strings using Pygments #399

Closed pombredanne closed 7 months ago

pombredanne commented 7 months ago

This implies:

[x] Support in source-inspector https://github.com/nexB/source-inspector/pull/20
[x] Create add-on pipeline in SCIO for Pygments source symbols https://github.com/nexB/scancode.io/pull/1179

keshav-space commented 7 months ago

The simple way to test this is to follow the below steps after installing PurlDB (https://github.com/nexB/purldb?tab=readme-ov-file#installation):

Go to /api/collect/ add PURL for indexing. ex: /api/collect/?purl=pkg:generic/udhcp@0.9.7&addon_pipelines=collect_pygments_symbols
Once the indexing has completed go to /api/resources/and filter out resource based on PURL to see the symbols and strings for each resource in extra_data field. ex: /api/resources/?purl=pkg:generic/udhcp@0.9.7