Closed dolsysmith closed 2 years ago
Tested with user timeline, search, and filter collections. Getting user URLs in all but filter tweets.
Noting here that in the filter stream tweets, there are URLs in recent tweets in the user.url
field rather than user.entitites.url.urls
where Twarc is looking for them (for json2csv). Agreed we will move forward with this PR as is.
Updates the schema to handle the
user.entities.url.urls
element, when present (user timeline tweets). This element is output in the CSV extract asuser_urls
.Test with user timeline collections and other kinds of collections, if possible.