[TSK-266] Describe details of each data scraper

maany commented 3 months ago

Provide a description of what data scrapers do ( register data to kernel, upload data to MinIO, produce logs, generate path names) Create a page in the concepts section, one for each data scraper i.e.

Telegram scraper
Twiiter Scraper
Sentinel Scraper

Describe how they work:

What inputs they need
What files they produce
What external API tokens they need and how should one retrieve them
What relevant logs they provide
How can you run them locally ( redirect to the section in the guides where we describe how to run data scrapers locally)

Deeptikandhol10 commented 3 months ago

@harsh010102 , what's the status of this activity?

harsh010102 commented 3 months ago

@Deeptikandhol10 sending a PR today! sentinel docs are done.

Deeptikandhol10 commented 3 months ago

Okay, perfect.

Deeptikandhol10 commented 3 months ago

@ydamit , could you please review it?

ydamit commented 3 months ago

On it!

harsh010102 commented 3 months ago

@Deeptikandhol10 i guess laurent and mayank are going to review the docs.

Deeptikandhol10 commented 3 months ago

Thanks, it will be taken care of.

Deeptikandhol10 commented 3 months ago

@ydamit , is the review done?

dream-aim-deliver / planckster-docs

[TSK-266] Describe details of each data scraper #4