The current schema is derived from 40G of Tweets from the Brexit collection in SFM. But not all fields are present in every kind of tweet (for instance, the user elements are richer in user timeline tweets than in search/filter tweets).
Using additional samples from SFM, create a union schema that will cover the various possible kinds of collections we ingest.
The current schema is derived from 40G of Tweets from the Brexit collection in SFM. But not all fields are present in every kind of tweet (for instance, the
user
elements are richer in user timeline tweets than in search/filter tweets).Using additional samples from SFM, create a union schema that will cover the various possible kinds of collections we ingest.