ISG-ICS / cloudberry

Big Data Visualization
http://cloudberry.ics.uci.edu
90 stars 82 forks source link

[Backend] Update Noah (Ingestion) module to use extended TwitterAPI to include `full_text` for data ingestion. #801

Closed baiqiushi closed 4 years ago

baiqiushi commented 4 years ago

Currently, our ingestion module and schema both use old TwitterAPI with only text field, while TwitterAPI has published an extended version with another full_text field which contains twice length of characters limit than text. We need to update both the ingestion module Noah and the schema of TwitterMap to include this full_text field.

baiqiushi commented 4 years ago

Temporary resolved by #814