kaustav202 / RealTime-TwitterDataAnalysis

Collect and process real time twitter data plotting various metrics like volume , proportion, sentiment. Analyze tweet node networks and map them geographically.
29 stars 15 forks source link

Doc Update [ Important data formats ] #13

Open kaustav202 opened 2 years ago

kaustav202 commented 2 years ago

There are no references for a lot of the main data structures utilized in various modules of the application for analytics and processing. Also since all of the functionality is based on the information contained in these units it's essential to have a close look at them including the structure / hierarchy / fields / types etc. Mainly the extracted or mined data from raw json as it is the main source.

A diagrammatic or chart like representation of all the primary DS used in different modules for analysis. If transformation has been done then need to show those too.

Will be helpful in better understanding the project and gaining familiarity with it.

Coder-Manan commented 2 years ago

In what form should the work for this issue be submitted?

kaustav202 commented 2 years ago

In what form should the work for this issue be submitted?

Final result should be an image preferably with colored highlighting for fields

kaustav202 commented 2 years ago

If using an IDE like Spyder.. all the data should be readily available to view along with structure

kaustav202 commented 2 years ago

But the hierarchy/ tabular characteristics must be clear