-
# Objectif
Créer un pipeline qui va extraire les données depuis Twitter et les charger dans une base de données.
# Ce que je propose
* Utiliser Python pour développer rapidement
* Utiliser [snscra…
-
Dataloader name: `tgl_profanity/tgl_profanity.py`
DataCatalogue: http://seacrowd.github.io/seacrowd-catalogue/card.html?tgl_profanity
| Dataset| tgl_profanity |
|-------------|---|
| Description …
-
```
➜ scihub snscrape --jsonl --progress vkontakte-user sci_hub > sci_hub.vk.txt
2022-01-03 19:39:30.311 WARNING snscrape.modules.vkontakte Skipping post without link: '\n\n
-
Traceback
```
2022-01-29 14:13:49.022 INFO snscrape.modules.twitter Retrieving guest token
2022-01-29 14:13:49.023 INFO snscrape.base Retrieving https://twitter.com/i/web/919265494347137024…
-
Hi.
I wrote a simple loop:
```
def _get_all_user_tweets(self, user_id):
user_tweets = tweety.types.UserTweets(user_id, self.tweety, get_replies=False)
tweets = user_tweets…
-
For some tweets, I suspect the long ones, somehow api.tweet_details() returns None. Try this one as an example:
```
tweet = await api.tweet_details(1701310919207198770)
print(tweet)
```
This …
-
I am using twscrape from command line.
I get user id with this command:
twscrape user_by_login GobiernoMX
But appears a weird id for twitter user:
{"id": 1067218403914436608, "id_str": "…
-
### Describe the bug
IndexError: list index out of range
jsonData = r.text.split('window._sharedData = ')[1].split(';')[0] # May throw an IndexError if Instagram changes something again; we just …
-
### Describe the bug
An AttributeError is given when scraping for mastodon profile data.
### How to reproduce
snscrape mastodon-profile @daphne@indieweb.social
### Expected behaviour
Receiving pr…
-
```
import os
os.environ["http_proxy"] = "http://127.0.0.1:56916"
os.environ["https_proxy"] = "http://127.0.0.1:56916"
import snscrape.modules.twitter as sntwitter
from transformers import pipeli…