I ran the request below: twarc2 search '#ENDSARS-is:retweet' --start-time 2017-12-01 --end-time 2020-11-30 --flatten --archive C:\Users\USER\Desktop\MyTwarcResults.json

and I got this error message below:

Traceback (most recent call last):
  File "C:\Users\USER\PycharmProjects\workspace\venv\Scripts\twarc2-script.py", line 33, in <module>
    sys.exit(load_entry_point('twarc==2.0.6', 'console_scripts', 'twarc2')())
  File "c:\users\user\pycharmprojects\workspace\venv\lib\site-packages\click\core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "c:\users\user\pycharmprojects\workspace\venv\lib\site-packages\click\core.py", line 782, in main
    rv = self.invoke(ctx)
  File "c:\users\user\pycharmprojects\workspace\venv\lib\site-packages\click\core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "c:\users\user\pycharmprojects\workspace\venv\lib\site-packages\click\core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "c:\users\user\pycharmprojects\workspace\venv\lib\site-packages\click\core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "c:\users\user\pycharmprojects\workspace\venv\lib\site-packages\click\decorators.py", line 33, in new_func
    return f(get_current_context().obj, *args, **kwargs)
  File "c:\users\user\pycharmprojects\workspace\venv\lib\site-packages\twarc\decorators.py", line 172, in __call__
    result = e.response.json()
  File "c:\users\user\pycharmprojects\workspace\venv\lib\site-packages\requests\models.py", line 900, in json
    return complexjson.loads(self.text, **kwargs)
  File "C:\Users\USER\AppData\Local\Programs\Python\Python36\lib\json\__init__.py", line 354, in loads
    return _default_decoder.decode(s)
  File "C:\Users\USER\AppData\Local\Programs\Python\Python36\lib\json\decoder.py", line 339, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "C:\Users\USER\AppData\Local\Programs\Python\Python36\lib\json\decoder.py", line 357, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

What exactly be the cause/source of this error, and how can i get help?

'#ENDSARS-is:retweet'

i think this query is missing a space, it should be "#ENDSARS -is:retweet"

Another issue may be the ' vs " quotes - so the full command that might work is:

twarc2 search --start-time "2017-12-01" --end-time "2020-11-30" --flatten --archive "#ENDSARS -is:retweet" "C:\Users\USER\Desktop\MyTwarcResults.json"

Does that give the same error?

I noticed the missing space too. I couldn't get it to throw the same error though. Maybe it's a Windows only behavior? Does anyone else with access have time to confirm?

I saw this error before from someone else, and the issue was a failing connection to the API, solved with setting alternative DNS servers, : Expecting value: line 1 column 1 (char 0) comes up if there's a blank or no response from the API but I can't reproduce this either. Will have to load up Windows again for more testing

'#ENDSARS-is:retweet'

i think this query is missing a space, it should be "#ENDSARS -is:retweet"

Another issue may be the ' vs " quotes - so the full command that might work is:

twarc2 search --start-time "2017-12-01" --end-time "2020-11-30" --flatten --archive "#ENDSARS -is:retweet" "C:\Users\USER\Desktop\MyTwarcResults.json"

Does that give the same error?

Yes it still does unfortunately. I am really stucked, don't know what to do

to run other simple commands like; twarc search blacklivesmatter > search.jsonl gives me same error.

I have tried all the suggestions from @igorbrigadir and @edsu, yet, i get the error response:

raise JSONDecodeError("Expecting value", s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

Interesting! @osemele can you paste the last 20 lines or so of your twarc.log file. You should find the file in the directory where you are running your twarc command?

Also, I've just released twarc v2.0.7 that should log what was received from the Twitter API when an error message is not JSON. Could you try installing it with pip3 install --upgrade twarc and see what error message you get?

Thinking about @igorbrigadir's point about DNS I'd also be interested to see if the v1.1 API is working. Can you try the older twarc client and see what happens?

twarc search blacklivesmatter

Note twarc instead of twarc2.

twarc search blacklivesmatter works perfectly. Every other search on twarc work for me.

twarc search #EndSARS > tweets222.json also worked perfectly and a file was saved from it.

but all searches on twarc2 give the error message. for instance a simple command of: "twarc2 search blacklivesmatter" pops the following error:

Traceback (most recent call last): File "c:\users\user\pycharmprojects\main2projects\venv\lib\site-packages\twarc\decorators.py", line 179, in call result = e.response.json() File "c:\users\user\pycharmprojects\main2projects\venv\lib\site-packages\requests\models.py", line 900, in json return complexjson.loads(self.text, **kwargs) File "C:\Users\USER\AppData\Local\Programs\Python\Python39\lib\json__init__.py", line 346, in loads return _default_decoder.decode(s) File "C:\Users\USER\AppData\Local\Programs\Python\Python39\lib\json\decoder.py", line 337, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "C:\Users\USER\AppData\Local\Programs\Python\Python39\lib\json\decoder.py", line 355, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) During handling of the above exception, another exception occurred:

I have also upgraded twarc using pip3 install --upgrade twarc to get v2.0.8, yet, gets the same error message

On Sun, Apr 25, 2021 at 12:22 PM Ed Summers @.***> wrote:

Thinking about @igorbrigadir https://github.com/igorbrigadir's point about DNS I'd also be interested to see if the v1.1 API is working. Can you try the older twarc client and see what happens?

twarc search blacklivesmatter

Note twarc instead of twarc2.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/DocNow/twarc/issues/441#issuecomment-826307611, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATRWO6B3CGFVUOUOJIU7OK3TKP3PHANCNFSM43M324CA .

-- Kingsley Oladayo Ogunne

Department of Corporate Services Obafemi Awolowo University Teaching Hospitals Complex P.M.B. 5538 Ile-Ife, Nigeria

Telephone: +2348088444325, +2349050054242

Strange, I thought I was catching JSONDecodeError in v2.0.7 and up. What do you see when you run this:

twarc2 version

twarc2 is finally not running at all again. to run 'twarc2' and 'twarc2 version' I get the response 'failed to create process.'. meanwhile, twarc is still running perfectly. what can i do now?

On Mon, Apr 26, 2021 at 3:08 PM Ed Summers @.***> wrote:

Strange, I thought I was catching JSONDecodeError in v2.0.8. What do you see when you run this:

twarc2 version

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/DocNow/twarc/issues/441#issuecomment-826864782, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATRWO6DMLJ5VKZLCKUUU7RLTKVXT7ANCNFSM43M324CA .

-- Kingsley Oladayo Ogunne

Department of Corporate Services Obafemi Awolowo University Teaching Hospitals Complex P.M.B. 5538 Ile-Ife, Nigeria

Telephone: +2348088444325, +2349050054242

If twarc works, but twarc2 does not, I would first check if the app is setup for v2 access on https://developer.twitter.com/en/portal/dashboard - and if that's correct (the app should be under "Academic Research" Project, not "Standard") try this command, replacing AAA...zzz with your bearer token:

curl "https://api.twitter.com/2/tweets/search/all?query=from%3Atwitterdev%20new%20-is%3Aretweet&max_results=10" -H "Authorization: Bearer AAA...zzz"

If that fails, something else is wrong.

If you do not have Academic Access, you will not be able to use --archive and can search within the last 7 days only. Standard endpoint example is:

curl https://api.twitter.com/2/tweets/search/recent?query=from%3Atwitterdev%20new%20-is%3Aretweet&max_results=10 -H "Authorization: Bearer AAA...zzz"

If those work, but twarc2 still does not, I would recommend reinstalling twarc, or trying it in a brand new vitrualenv environment:

pip install--upgrade --force-reinstall twarc

Another thing i found, is that maybe there is a space in your user name, and your Anaconda / pip is broken as a result: https://stackoverflow.com/questions/42152589/anaconda-failed-to-create-process

I've been meaning to check what happens when you use --archive with keys that don't have access to the Academic Product Track. If that really is the cause here I think twarc2 should give an understandable error.

@osemele can you please paste the full stack trace you see when you run twarc2 version ?

C:\Users\USER>twarc2 search '#blacklivesmatter' Traceback (most recent call last): File "c:\users\user\pycharmprojects\main2projects\venv\lib\site-packages\twarc\decorators.py", line 179, in call result = e.response.json() File "c:\users\user\pycharmprojects\main2projects\venv\lib\site-packages\requests\models.py", line 900, in json return complexjson.loads(self.text, **kwargs) File "C:\Users\USER\AppData\Local\Programs\Python\Python39\lib\json__init__.py", line 346, in loads return _default_decoder.decode(s) File "C:\Users\USER\AppData\Local\Programs\Python\Python39\lib\json\decoder.py", line 337, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "C:\Users\USER\AppData\Local\Programs\Python\Python39\lib\json\decoder.py", line 355, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "C:\Users\USER\AppData\Local\Programs\Python\Python39\lib\runpy.py", line 197, in _run_module_as_main return _run_code(code, main_globals, None, File "C:\Users\USER\AppData\Local\Programs\Python\Python39\lib\runpy.py", line 87, in _run_code exec(code, run_globals) File "C:\Users\USER\PycharmProjects\main2projects\venv\Scripts\twarc2.exe__main.py", line 7, in File "c:\users\user\pycharmprojects\main2projects\venv\lib\site-packages\click\core.py", line 829, in call__ return self.main(args, kwargs) File "c:\users\user\pycharmprojects\main2projects\venv\lib\site-packages\click\core.py", line 782, in main rv = self.invoke(ctx) File "c:\users\user\pycharmprojects\main2projects\venv\lib\site-packages\click\core.py", line 1259, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "c:\users\user\pycharmprojects\main2projects\venv\lib\site-packages\click\core.py", line 1066, in invoke return ctx.invoke(self.callback, ctx.params) File "c:\users\user\pycharmprojects\main2projects\venv\lib\site-packages\click\core.py", line 610, in invoke return callback(args, *kwargs) File "c:\users\user\pycharmprojects\main2projects\venv\lib\site-packages\click\decorators.py", line 33, in new_func return f(get_current_context().obj, args, **kwargs) File "c:\users\user\pycharmprojects\main2projects\venv\lib\site-packages\twarc\decorators.py", line 187, in call except JSONDecodeError: NameError: name 'JSONDecodeError' is not defined

On Wed, Apr 28, 2021 at 1:29 AM Ed Summers @.***> wrote:

@osemele https://github.com/osemele can you please paste the full stack trace you see when you run twarc2 version ?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/DocNow/twarc/issues/441#issuecomment-828050245, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATRWO6FH2S3ZY7BPCRJA6W3TK5JFJANCNFSM43M324CA .

-- Kingsley Oladayo Ogunne

Department of Corporate Services Obafemi Awolowo University Teaching Hospitals Complex P.M.B. 5538 Ile-Ife, Nigeria

Telephone: +2348088444325, +2349050054242

@osemele I accidentally introduced a new error when trying to catch the one you found earlier. Could you upgrade twarc to v2.0.9 and try your twarc2 command again and paste any errors you see?

Thank you sir. I just upgraded to v2.0.9. However, a simple command of twarc2 search '#blacklivesmatter' gives this error: Unable to parse error as JSON, received:

http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail Virus-free. www.avg.com http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

On Thu, Apr 29, 2021 at 12:47 PM Ed Summers @.***> wrote:

@osemele https://github.com/osemele I accidentally introduced a new error when trying to catch the one you found earlier. Could you upgrade twarc to v2.0.9 and try your twarc2 command again and paste any errors you see?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/DocNow/twarc/issues/441#issuecomment-829161509, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATRWO6FW7535TMA5W4ZDIM3TLFBMVANCNFSM43M324CA .

-- Kingsley Oladayo Ogunne

Department of Corporate Services Obafemi Awolowo University Teaching Hospitals Complex P.M.B. 5538 Ile-Ife, Nigeria

Telephone: +2348088444325, +2349050054242

http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail Virus-free. www.avg.com http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

Thanks! This is making sense to me now - It appears that AVG is blocking or redirecting requests to api.twitter.com. You will need to configure AVG to allow connections to twitter, or allow twarc2.exe or something like that - i don't know AVG settings, but that's the source of your error, which was hidden by our JSONDecode bug.

Thank you so much for all the efforts and responses, What if I totally uninstall AVG from my system. Will that work?

On Thu, Apr 29, 2021 at 3:29 PM Igor Brigadir @.***> wrote:

http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail Virus-free. www.avg.com

http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

Thanks! This is making sense to me now - It appears that AVG is blocking or redirecting requests to api.twitter.com. You will need to configure AVG to allow connections to twitter, or allow twarc2.exe or something like that - i don't know AVG settings, but that's the source of your error, which was hidden by our JSONDecode bug.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/DocNow/twarc/issues/441#issuecomment-829285884, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATRWO6FGRYXUVXSY62WTYMDTLFULZANCNFSM43M324CA .

-- Kingsley Oladayo Ogunne

Department of Corporate Services Obafemi Awolowo University Teaching Hospitals Complex P.M.B. 5538 Ile-Ife, Nigeria

Telephone: +2348088444325, +2349050054242

I have totally uninstalled AVG from my system but twarc2 still gives this error. kindly see attached screenshot sir.

On Thu, Apr 29, 2021 at 4:23 PM Kingsley OGUNNE @.***> wrote:

Thank you so much for all the efforts and responses, What if I totally uninstall AVG from my system. Will that work?

http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail Virus-free. www.avg.com http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail <#m_-6322445360901552343_DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

On Thu, Apr 29, 2021 at 3:29 PM Igor Brigadir @.***> wrote:

http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail Virus-free. www.avg.com

http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

Thanks! This is making sense to me now - It appears that AVG is blocking or redirecting requests to api.twitter.com. You will need to configure AVG to allow connections to twitter, or allow twarc2.exe or something like that - i don't know AVG settings, but that's the source of your error, which was hidden by our JSONDecode bug.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/DocNow/twarc/issues/441#issuecomment-829285884, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATRWO6FGRYXUVXSY62WTYMDTLFULZANCNFSM43M324CA .

-- Kingsley Oladayo Ogunne

Department of Corporate Services Obafemi Awolowo University Teaching Hospitals Complex P.M.B. 5538 Ile-Ife, Nigeria

Telephone: +2348088444325, +2349050054242

-- Kingsley Oladayo Ogunne

Department of Corporate Services Obafemi Awolowo University Teaching Hospitals Complex P.M.B. 5538 Ile-Ife, Nigeria

Telephone: +2348088444325, +2349050054242

This is just for reference but @igorbrigadir is doing some fine detective work on this over in the Twitter Forum: https://twittercommunity.com/t/mining-historical-data-using-twarc/153350/13

@osemele what is AVG? Can you try to reinstall twarc with this command and see if twarc2 works?

python -m pip install --upgrade --force-reinstall twarc

I have upgraded to twarc 2.0.10 however, a simple twarc2 search gives the response:

⚡ Unable to parse error as JSON, received:

On Thu, Apr 29, 2021 at 5:36 PM Ed Summers @.***> wrote:

@osemele https://github.com/osemele what is AVG? Can you try to reinstall twarc with this command and see if twarc2 works?

python -m pip install --upgrade --force-reinstall twarc

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/DocNow/twarc/issues/441#issuecomment-829405967, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATRWO6BPRYEZX7KIYY6OTH3TLGDITANCNFSM43M324CA .

-- Kingsley Oladayo Ogunne

Department of Corporate Services Obafemi Awolowo University Teaching Hospitals Complex P.M.B. 5538 Ile-Ife, Nigeria

Telephone: +2348088444325, +2349050054242

And what's the exact command you're running and where (Anaconda prompt? cmd.exe?)

What does

pip list

output?

The sample requests i made on cmd.exe are: twarc2 search endsars twarc2 search '#endsars' --archive it then returns the error message: Unable to parse error as JSON, received:

The 'pip list' gives a list of the python packages on my computer. Inside it, there is 'twarc 2.0.10' Below is the full list:

C:\Users\USER>pip list Package Version

anyio 2.2.0 argon2-cffi 20.1.0 async-generator 1.10 atomicwrites 1.4.0 attrs 20.3.0 Babel 2.9.0 backcall 0.2.0 bleach 3.3.0 certifi 2020.12.5 cffi 1.14.5 chardet 4.0.0 click 7.1.2 click-config-file 0.6.0 click-plugins 1.1.1 colorama 0.4.4 configobj 5.0.6 cycler 0.10.0 decorator 5.0.7 defusedxml 0.7.1 deprecation 2.1.0 entrypoints 0.3 idna 2.10 iniconfig 1.1.1 ipykernel 5.5.3 ipython 7.22.0 ipython-genutils 0.2.0 jedi 0.18.0 Jinja2 2.11.3 json5 0.9.5 jsonschema 3.2.0 jupyter-client 6.1.12 jupyter-core 4.7.1 jupyter-packaging 0.9.2 jupyter-server 1.6.4 jupyterlab 3.0.14 jupyterlab-pygments 0.1.2 jupyterlab-server 2.4.0 kiwisolver 1.3.1 MarkupSafe 1.1.1 matplotlib 3.4.1 mistune 0.8.4 mpmath 1.2.1 nbclassic 0.2.7 nbclient 0.5.3 nbconvert 6.0.7 nbformat 5.1.3 nest-asyncio 1.5.1 notebook 6.3.0 numpy 1.20.2 oauthlib 3.1.0 packaging 20.9 pandas 1.2.4 pandocfilters 1.4.3 parso 0.8.2 pickleshare 0.7.5 Pillow 8.2.0 pip 21.1 pluggy 0.13.1 prometheus-client 0.10.1 prompt-toolkit 3.0.18 py 1.10.0 pycparser 2.20 Pygments 2.8.1 pyparsing 2.4.7 pyrsistent 0.17.3 pytest 6.2.3 python-dateutil 2.8.1 python-dotenv 0.17.0 pytz 2021.1 pywin32 300 pywinpty 0.5.7 pyzmq 22.0.3 requests 2.25.1 requests-oauthlib 1.3.0 Send2Trash 1.5.0 setuptools 56.0.0 six 1.15.0 sniffio 1.2.0 sympy 1.8 terminado 0.9.4 testpath 0.4.4 toml 0.10.2 tomlkit 0.7.0 tornado 6.1 traitlets 5.0.5 twarc 2.0.10 urllib3 1.26.4 wcwidth 0.2.5 webencodings 0.5.1 wheel 0.36.2

On Fri, Apr 30, 2021 at 11:43 AM Igor Brigadir @.***> wrote:

And what's the exact command you're running and where (Anaconda prompt? cmd.exe?)

What does

pip list

output?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/DocNow/twarc/issues/441#issuecomment-830008039, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATRWO6GQZ6Q6PD7HV7ZESHTTLKCULANCNFSM43M324CA .

-- Kingsley Oladayo Ogunne

Department of Corporate Services Obafemi Awolowo University Teaching Hospitals Complex P.M.B. 5538 Ile-Ife, Nigeria

Telephone: +2348088444325, +2349050054242

And what does this output? (Replacing AAA...zzz with your own bearer token and removing it from the output before posting here)

curl -v -H "Authorization: Bearer AAA...zzz" "https://api.twitter.com/2/tweets/search/recent?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&user.fields=created_at%2Cdescription%2Centities%2Cid%2Clocation%2Cname%2Cpinned_tweet_id%2Cprofile_image_url%2Cprotected%2Cpublic_metrics%2Curl%2Cusername%2Cverified%2Cwithheld&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ctext%2Cpossibly_sensitive%2Creferenced_tweets%2Creply_settings%2Csource%2Cwithheld&media.fields=duration_ms%2Cheight%2Cmedia_key%2Cpreview_image_url%2Ctype%2Curl%2Cwidth%2Cpublic_metrics&poll.fields=duration_minutes%2Cend_datetime%2Cid%2Coptions%2Cvoting_status&place.fields=contained_within%2Ccountry%2Ccountry_code%2Cfull_name%2Cgeo%2Cid%2Cname%2Cplace_type&max_results=10&query=endsars"

and

curl -v -H "Authorization: Bearer AAA...zzz" "https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&user.fields=created_at%2Cdescription%2Centities%2Cid%2Clocation%2Cname%2Cpinned_tweet_id%2Cprofile_image_url%2Cprotected%2Cpublic_metrics%2Curl%2Cusername%2Cverified%2Cwithheld&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ctext%2Cpossibly_sensitive%2Creferenced_tweets%2Creply_settings%2Csource%2Cwithheld&media.fields=duration_ms%2Cheight%2Cmedia_key%2Cpreview_image_url%2Ctype%2Curl%2Cwidth%2Cpublic_metrics&poll.fields=duration_minutes%2Cend_datetime%2Cid%2Coptions%2Cvoting_status&place.fields=contained_within%2Ccountry%2Ccountry_code%2Cfull_name%2Cgeo%2Cid%2Cname%2Cplace_type&max_results=10&query=%23endsars&start_time=2006-03-21T00%3A00%3A00%2B00%3A00"

You may also have to replace curl with curl.exe

I edited it to keep it readable, but it appears that you're getting a response from the API successfully, so the problem must be somewhere in the python environment.

Great, thanks for letting me know. I will get across to a friend in computer science to help me check it out. Thanks so much for your persistent assistance. I am so grateful sir.

On Fri, Apr 30, 2021, 4:09 PM Igor Brigadir @.***> wrote:

I edited it to keep it readable, but it appears that you're getting a response from the API successfully, so the problem must be somewhere in the python environment.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/DocNow/twarc/issues/441#issuecomment-830162265, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATRWO6AS35ZONSUN6UPWUG3TLLBZXANCNFSM43M324CA .

Building on that a bit more to test your Python environment you can run this little program after replacing CHANGEME with your Bearer Token?

https://gist.github.com/edsu/a1a86ff8398edaef3010e3453665e6d6

If that works then it must be something in twarc.

Good day sir. Thank you for your response and time. I sincerely appreciate all your efforts. I have run the above code and it ran successfully. Below is the response.

C:\Users\USER\PycharmProjects\workstation2\venv\Scripts\python.exe C:/Users/USER/PycharmProjects/workstation2/ChechCheck.py 200 {"data":[{"conversation_id":"1389228797975830528","text":"RT @WalleLawal: Let’s not forget Pelumi Onifade, an intern journalist, who filmed a politician shooting into a crowd last year during

EndS…","possibly_sensitive":false,"lang":"en","context_annotations":[{"domain":{"id":"46","name":"Brand

Category","description":"Categories within Brand Verticals that narrow down the scope of Brands"},"entity":{"id":"781974596752842752","name":"Services"}},{"domain":{"id":"47","name":"Brand","description":"Brands and Companies"},"entity":{"id":"10029202045","name":"Facebook"}},{"domain":{"id":"47","name":"Brand","description":"Brands and Companies"},"entity":{"id":"10045225402","name":"Twitter"}}],"entities":{"annotations":[{"start":33,"end":46,"probability":0.8905,"type":"Person","normalized_text":"Pelumi Onifade"}],"mentions":[{"start":3,"end":14,"username":"WalleLawal"}]},"referenced_tweets":[{"type":"retweeted","id":"1388847869894004736"}],"created_at":"2021-05-03T14:42:10.000Z","public_metrics":{"retweet_count":2418,"reply_count":0,"like_count":0,"quote_count":0},"author_id":"920929607116869633","source":"Twitter for iPhone","id":"1389228797975830528","reply_settings":"everyone"},{"conversation_id":"1389228776513495041","text":"RT @DanielMaechi: @NkemdiMary @Blessedceo1 #Terrorists, #thieves, #murderers should not be the ones to assess what is acceptable to people.…","possibly_sensitive":false,"lang":"en","entities":{"mentions":[{"start":3,"end":16,"username":"DanielMaechi"},{"start":18,"end":29,"username":"NkemdiMary"},{"start":30,"end":42,"username":"Blessedceo1"}],"hashtags":[{"start":43,"end":54,"tag":"Terrorists"},{"start":56,"end":64,"tag":"thieves"},{"start":66,"end":76,"tag":"murderers"}]},"referenced_tweets":[{"type":"retweeted","id":"1389228641926647808"}],"created_at":"2021-05-03T14:42:05.000Z","public_metrics":{"retweet_count":1,"reply_count":0,"like_count":0,"quote_count":0},"author_id":"1282482962152460291","source":"Twitter for Android","id":"1389228776513495041","reply_settings":"everyone"},{"conversation_id":"1389228758171848705","text":"RT @firstladyship: Nigeria better as one, we'll not separate. Breakup unacceptable to us — Tinubu\n\nWHO IS WE/US? Just be ready to run to To…","possibly_sensitive":false,"lang":"en","entities":{"annotations":[{"start":19,"end":25,"probability":0.9712,"type":"Place","normalized_text":"Nigeria"},{"start":91,"end":96,"probability":0.8757,"type":"Person","normalized_text":"Tinubu"}],"mentions":[{"start":3,"end":17,"username":"firstladyship"}]},"referenced_tweets":[{"type":"retweeted","id":"1389103728616042498"}],"created_at":"2021-05-03T14:42:01.000Z","public_metrics":{"retweet_count":300,"reply_count":0,"like_count":0,"quote_count":0},"author_id":"1334284601481703424","source":"Twitter for iPhone","id":"1389228758171848705","reply_settings":"everyone"},{"conversation_id":"1389084075168763904","in_reply_to_user_id":"3588986417","text":"@NkemdiMary @Blessedceo1 #Terrorists, #thieves, #murderers should not be the ones to assess what is acceptable to people.#EndSARS","possibly_sensitive":false,"lang":"en","entities":{"mentions":[{"start":0,"end":11,"username":"NkemdiMary"},{"start":12,"end":24,"username":"Blessedceo1"}],"hashtags":[{"start":25,"end":36,"tag":"Terrorists"},{"start":38,"end":46,"tag":"thieves"},{"start":48,"end":58,"tag":"murderers"},{"start":121,"end":129,"tag":"EndSARS"}]},"referenced_tweets":[{"type":"replied_to","id":"1389084075168763904"}],"created_at":"2021-05-03T14:41:33.000Z","public_metrics":{"retweet_count":1,"reply_count":0,"like_count":0,"quote_count":0},"author_id":"1316432551054057472","source":"Twitter Web App","id":"1389228641926647808","reply_settings":"everyone"},{"conversation_id":"1389228627443818504","entities":{"urls":[{"start":85,"end":108,"url":" https://t.co/cRj01Tw4Al","expanded_url":"http://youtu.be/Nd_GRy8SKII ","display_url":"youtu.be/Nd_GRy8SKII","images":[{"url":" https://pbs.twimg.com/news_img/1387233126611554304/QMj1paaJ?format=jpg&name=orig ","width":1280,"height":720},{"url":" https://pbs.twimg.com/news_img/1387233126611554304/QMj1paaJ?format=jpg&name=150x150","width":150,"height":150}],"status":200,"title":"Billy Idol - Don't Need A Gun (Official Music Video)","description":"REMASTERED IN HD!Official video of Billy Idol performing Don’t Need A Gun from the album Whiplash Smile. Buy It Here: http://smarturl.it/pflh9o Like Billy Id...","unwound_url":" https://www.youtube.com/watch?v=Nd_GRy8SKII&feature=youtu.be"}],"annotations":[{"start":17,"end":32,"probability":0.4788,"type":"Other","normalized_text":"Don't Need A Gun"},{"start":36,"end":45,"probability":0.5836,"type":"Person","normalized_text":"Billy Idol"},{"start":76,"end":82,"probability":0.4282,"type":"Product","normalized_text":"YouTube"}],"mentions":[{"start":3,"end":15,"username":"meiklwagner"}],"hashtags":[{"start":110,"end":127,"tag":"FridaysForFuture"},{"start":128,"end":135,"tag":"Berlin"}]},"text":"RT @meiklwagner: Don't Need A Gun - Billy Idol, 1987, Chrysalis Records.\nOn YouTube: https://t.co/cRj01Tw4Al\n\n#FridaysForFuture #Berlin\uD83D\uDC51

C…","possibly_sensitive":false,"lang":"en","referenced_tweets":[{"type":"retweeted","id":"1387233122723434496"}],"created_at":"2021-05-03T14:41:30.000Z","public_metrics":{"retweet_count":15,"reply_count":0,"like_count":0,"quote_count":0},"author_id":"1729193269","source":"My1stNewApp","id":"1389228627443818504","reply_settings":"everyone"},{"conversation_id":"1389228618837106693","text":"RT

@cheremaah: Our celebrities can join #EndSARS but can't join

FixTheCountry.

Interesting","possibly_sensitive":false,"lang":"en","entities":{"mentions":[{"start":3,"end":13,"username":"cheremaah"}],"hashtags":[{"start":40,"end":48,"tag":"EndSARS"},{"start":64,"end":78,"tag":"FixTheCountry"}]},"referenced_tweets":[{"type":"retweeted","id":"1389140980130009088"}],"created_at":"2021-05-03T14:41:28.000Z","public_metrics":{"retweet_count":263,"reply_count":0,"like_count":0,"quote_count":0},"author_id":"898462136665550848","source":"Twitter for iPhone","id":"1389228618837106693","reply_settings":"everyone"},{"conversation_id":"1389228613879443456","text":"RT @ronaldnzimora: When Nigeria breaks up Tinubu, you will be running for your life as you did during #EndSARS.\n\nAl this one is cheap talk.","possibly_sensitive":false,"lang":"en","entities":{"annotations":[{"start":24,"end":30,"probability":0.8554,"type":"Place","normalized_text":"Nigeria"},{"start":42,"end":47,"probability":0.8876,"type":"Person","normalized_text":"Tinubu"}],"mentions":[{"start":3,"end":17,"username":"ronaldnzimora"}],"hashtags":[{"start":102,"end":110,"tag":"EndSARS"}]},"referenced_tweets":[{"type":"retweeted","id":"1388980108640325632"}],"created_at":"2021-05-03T14:41:26.000Z","public_metrics":{"retweet_count":147,"reply_count":0,"like_count":0,"quote_count":0},"author_id":"1351310565210255366","source":"Twitter for iPhone","id":"1389228613879443456","reply_settings":"everyone"},{"conversation_id":"1389228597915922433","text":"RT @RealSeunKuti: Remember @imoleayomichael ?\nThe young computer programmer kidnapped by DSS by 2am at his residence in front of his mum, w…","possibly_sensitive":false,"lang":"en","context_annotations":[{"domain":{"id":"65","name":"Interests and Hobbies Vertical","description":"Top level interests and hobbies groupings, like Food or Travel"},"entity":{"id":"848920371311001600","name":"Technology","description":"Technology and computing"}},{"domain":{"id":"66","name":"Interests and Hobbies Category","description":"A grouping of interests and hobbies entities, like Novelty Food or Destinations"},"entity":{"id":"848921413196984320","name":"Computer programming","description":"Computer programming"}}],"entities":{"annotations":[{"start":89,"end":91,"probability":0.6331,"type":"Person","normalized_text":"DSS"}],"mentions":[{"start":3,"end":16,"username":"RealSeunKuti"},{"start":27,"end":43,"username":"imoleayomichael"}]},"referenced_tweets":[{"type":"retweeted","id":"1389228117701636100"}],"created_at":"2021-05-03T14:41:23.000Z","public_metrics":{"retweet_count":7,"reply_count":0,"like_count":0,"quote_count":0},"author_id":"45812346","source":"Twitter for iPhone","id":"1389228597915922433","reply_settings":"everyone"},{"conversation_id":"1389228581532971009","text":"RT @Amaka_Ekwo:

EndSARS","possibly_sensitive":false,"lang":"und","entities":{"mentions":[{"start":3,"end":14,"username":"Amaka_Ekwo"}],"hashtags":[{"start":16,"end":24,"tag":"EndSARS"}]},"referenced_tweets":[{"type":"retweeted","id":"1389127935945285632"}],"created_at":"2021-05-03T14:41:19.000Z","public_metrics":{"retweet_count":237,"reply_count":0,"like_count":0,"quote_count":0},"author_id":"1297591076174344192","source":"Twitter

for Android","id":"1389228581532971009","reply_settings":"everyone"},{"conversation_id":"1389228569713315848","text":"RT @RealSeunKuti: Remember @imoleayomichael ?\nThe young computer programmer kidnapped by DSS by 2am at his residence in front of his mum, w…","possibly_sensitive":false,"lang":"en","context_annotations":[{"domain":{"id":"65","name":"Interests and Hobbies Vertical","description":"Top level interests and hobbies groupings, like Food or Travel"},"entity":{"id":"848920371311001600","name":"Technology","description":"Technology and computing"}},{"domain":{"id":"66","name":"Interests and Hobbies Category","description":"A grouping of interests and hobbies entities, like Novelty Food or Destinations"},"entity":{"id":"848921413196984320","name":"Computer programming","description":"Computer programming"}}],"entities":{"annotations":[{"start":89,"end":91,"probability":0.6331,"type":"Person","normalized_text":"DSS"}],"mentions":[{"start":3,"end":16,"username":"RealSeunKuti"},{"start":27,"end":43,"username":"imoleayomichael"}]},"referenced_tweets":[{"type":"retweeted","id":"1389228117701636100"}],"created_at":"2021-05-03T14:41:16.000Z","public_metrics":{"retweet_count":7,"reply_count":0,"like_count":0,"quote_count":0},"author_id":"1389217607967035395","source":"Twitter for Android","id":"1389228569713315848","reply_settings":"everyone"}],"includes":{"users":[{"username":"TBadhabbeet","created_at":"2017-10-19T08:28:23.000Z","name":"Titilope \uD83D\uDC80","location":"I have no idea ","public_metrics":{"followers_count":2223,"following_count":2209,"tweet_count":18827,"listedcount":1},"description":"Hot shoe maker\uD83E\uDD75 business page @tsoles follow the story.

wizkidfc","verified":false,"pinned_tweet_id":"1379373013418835968","url":"","protected":false,"profile_image_url":"

https://pbs.twimg.com/profile_images/1379369474567077891/6dqr4GX__normal.jpg","id":"920929607116869633","entities":{"description":{"hashtags":[{"start":57,"end":66,"tag":"wizkidfc"}],"mentions":[{"start":30,"end":38,"username":"tsoles_"}]}}},{"username":"WalleLawal","created_at":"2010-03-19T16:55:44.000Z","name":"Wale Lawal","location":"Lagos, Nigeria","public_metrics":{"followers_count":28403,"following_count":971,"tweet_count":122387,"listed_count":139},"description":"Lean, mean, Nigerian machine. Founder, Editor: @republicjournal. Co-founder: @GatePass. \uD83D\uDCDA: @UniofBath; @LSENews; @UniofOxford","verified":true,"pinned_tweet_id":"1318670169212964864","url":" https://t.co/lJzY8BBRbD","protected":false,"profile_image_url":" https://pbs.twimg.com/profile_images/1377069606746140676/kirjQBkr_normal.jpg ","id":"124513277","entities":{"url":{"urls":[{"start":0,"end":23,"url":" https://t.co/lJzY8BBRbD","expanded_url":"http://www.republic.com.ng ","display_url":"republic.com.ng"}]},"description":{"mentions":[{"start":47,"end":63,"username":"republicjournal"},{"start":77,"end":86,"username":"GatePass"},{"start":91,"end":101,"username":"UniofBath"},{"start":103,"end":111,"username":"LSENews"},{"start":113,"end":125,"username":"UniofOxford"}]}}},{"username":"Blessedceo1","created_at":"2020-07-13T01:12:47.000Z","name":"Blessedceo","public_metrics":{"followers_count":2476,"following_count":4288,"tweet_count":31859,"listed_count":0},"description":"Biafran Activist","verified":false,"url":"","protected":false,"profile_image_url":" https://pbs.twimg.com/profile_images/1363015140715724800/hWmwNb8B_normal.jpg","id":"1282482962152460291"},{"username":"DanielMaechi","created_at":"2020-10-14T17:36:14.000Z","name":"Chiemi Daniel PD.h","public_metrics":{"followers_count":29,"following_count":136,"tweet_count":1665,"listed_count":0},"description":"","verified":false,"url":"","protected":false,"profile_image_url":" https://pbs.twimg.com/profile_images/1364150558429487104/CbXNwCqF_normal.jpg","id":"1316432551054057472"},{"username":"NkemdiMary","created_at":"2015-09-08T15:39:10.000Z","name":"Mary Mkemdi","public_metrics":{"followers_count":27348,"following_count":777,"tweet_count":374234,"listed_count":49},"description":"I am a Biafran campaigning against the killing of Biafrans by occupying Nigerian Govt #StopBiafrakillings #BiafraReferendum #FreedomForBiafra

IPOB","verified":false,"pinned_tweet_id":"924542533593649153","url":"","protected":false,"profile_image_url":"

https://pbs.twimg.com/profile_images/1225845699532726272/tc4EtL99_normal.jpg","id":"3588986417","entities":{"description":{"hashtags":[{"start":86,"end":105,"tag":"StopBiafrakillings"},{"start":106,"end":123,"tag":"BiafraReferendum"},{"start":124,"end":141,"tag":"FreedomForBiafra"},{"start":142,"end":147,"tag":"IPOB"}]}}},{"username":"Billjon92593940","created_at":"2020-12-02T23:54:28.000Z","name":"Bill jones","public_metrics":{"followers_count":74,"following_count":456,"tweet_count":2899,"listed_count":0},"description":"Because I’m rich.","verified":false,"url":"","protected":false,"profile_image_url":" https://pbs.twimg.com/profile_images/1334285046488985602/B7PUP3sh_normal.jpg","id":"1334284601481703424"},{"username":"firstladyship","created_at":"2010-10-11T12:10:42.000Z","name":"NEFERTITI","public_metrics":{"followers_count":32720,"following_count":113,"tweet_count":21733,"listed_count":43},"description":"Abolitionist • ✍️ • RT ≠ Endorsement","verified":false,"pinned_tweet_id":"1327658144504438786","url":"","protected":false,"profile_image_url":" https://pbs.twimg.com/profile_images/1078899423198019584/VVvK4fMh_normal.jpg","id":"201237617"},{"username":"JFSebastian146","created_at":"2013-09-04T15:56:47.000Z","name":"JFSebastian146","public_metrics":{"followers_count":5853,"following_count":3556,"tweet_count":333277,"listed_count":51},"description":"#digitalmarketing

endracism #BLM #climateactionnow

stopcensorship","verified":false,"url":"","protected":false,"profile_image_url":"

https://pbs.twimg.com/profile_images/1237378547225952256/-gpXQWVs_normal.jpg","id":"1729193269","entities":{"description":{"hashtags":[{"start":0,"end":17,"tag":"digitalmarketing"},{"start":18,"end":28,"tag":"endracism"},{"start":29,"end":33,"tag":"BLM"},{"start":34,"end":51,"tag":"climateactionnow"},{"start":52,"end":67,"tag":"stopcensorship"}]}}},{"username":"meiklwagner","created_at":"2015-01-27T07:05:52.000Z","name":"Mei:kl love.™ phil.","location":"Tokio/Berlin/LA","public_metrics":{"followers_count":644,"following_count":4980,"tweet_count":1596,"listed_count":2},"description":"IS&M, Studio Penélope ~ アクエリウスは音楽家として演じる。 ❤️ #Swing Out Sister’s™ #Herren

Bananenrepublik™ #Schokoladenfabrik™ #666000666 Yotabyte™ #BVG™ #BSR™

RsR™ ❤️","verified":false,"pinned_tweet_id":"1389227772439146500","url":"

https://t.co/IHK73FZxh2","protected":false,"profile_image_url":" https://pbs.twimg.com/profile_images/1388878765133082624/rl8b4F08_normal.jpg ","id":"3000985198","entities":{"url":{"urls":[{"start":0,"end":23,"url":" https://t.co/IHK73FZxh2","expanded_url":" http://youtube.com/channel/UCygTz2LfcfehClRtOCh5gNA","display_url":" youtube.com/channel/UCygTz…"}]},"description":{"hashtags":[{"start":46,"end":52,"tag":"Swing"},{"start":67,"end":74,"tag":"Herren"},{"start":75,"end":91,"tag":"Bananenrepublik"},{"start":93,"end":111,"tag":"Schokoladenfabrik"},{"start":136,"end":140,"tag":"BVG"},{"start":142,"end":146,"tag":"BSR"},{"start":148,"end":152,"tag":"RsR"}]}}},{"username":"Benedytte","created_at":"2017-08-18T08:30:40.000Z","name":"KB\uD83C\uDFAF\uD83C\uDDEC\uD83C\uDDED","location":"Bedroom","public_metrics":{"followers_count":4672,"following_count":1220,"tweet_count":27448,"listed_count":16},"description":"Its gonna Hurt Because it Matters\uD83D\uDCDC - John Green Jeremiah 29:11 \uD83D\uDE4F","verified":false,"pinned_tweet_id":"1368229606017425414","url":"","protected":false,"profile_image_url":" https://pbs.twimg.com/profile_images/1388848955455381511/fCzDBGr5_normal.jpg","id":"898462136665550848"},{"username":"cheremaah","created_at":"2013-06-18T14:37:16.000Z","name":"Emerald Bigailz\uD83E\uDDDA\uD83C\uDFFC‍♀️\uD83C\uDF3A\uD83C\uDF39","location":"Ghana, West Africa","public_metrics":{"followers_count":12481,"following_count":4787,"tweet_count":50024,"listed_count":14},"description":"God first\uD83D\uDE4F || Grace personified \uD83D\uDE07 || Serendipity\uD83D\uDE0A || Rad☢️ || Football lover⚽ || Hala Madrid❤️\uD83D\uDE4C","verified":false,"pinned_tweet_id":"1383507974170107909","url":"","protected":false,"profile_image_url":" https://pbs.twimg.com/profile_images/1319214810937044993/D4pM-3aG_normal.jpg","id":"1527923652"},{"username":"Bigsam_Davoclyn","created_at":"2021-01-18T23:28:57.000Z","name":"Sam Davoclyn","location":"Lagos, Nigeria","public_metrics":{"followers_count":233,"following_count":560,"tweet_count":15282,"listed_count":0},"description":"Double Horsepower Cruise.","verified":false,"url":"","protected":false,"profile_image_url":" https://pbs.twimg.com/profile_images/1381621124451217410/w0ANRJKJ_normal.jpg","id":"1351310565210255366"},{"username":"ronaldnzimora","created_at":"2010-02-21T17:16:37.000Z","name":"Ochiagha","location":"Lagos, Nigeria","public_metrics":{"followers_count":68559,"following_count":531,"tweet_count":204940,"listed_count":370},"description":"Businessman & Author\nCo-Founder: #DigitalNexusInteractive #BuyWellPropertiesLtd\n\nMy YouTube: https://t.co/f8SuPjlvH5 ","verified":false,"pinned_tweet_id":"1031116553692082176","url":" https://t.co/lo9IBvLmd8","protected":false,"profile_image_url":" https://pbs.twimg.com/profile_images/964572899620392970/lN_dBH0C_normal.jpg ","id":"116226042","entities":{"url":{"urls":[{"start":0,"end":23,"url":" https://t.co/lo9IBvLmd8","expanded_url":" http://www.IWillTeachYouBusiness.com ","display_url":"IWillTeachYouBusiness.com"}]},"description":{"urls":[{"start":93,"end":116,"url":" https://t.co/f8SuPjlvH5","expanded_url":" http://www.youtube.com/channel/UCMPH5DHEylOnbIL-K2D8igg?sub_confirmation=1 ","display_url":"youtube.com/channel/UCMPH5…"}],"hashtags":[{"start":33,"end":57,"tag":"DigitalNexusInteractive"},{"start":58,"end":79,"tag":"BuyWellPropertiesLtd"}]}}},{"username":"sobere_smg","created_at":"2009-06-09T10:55:02.000Z","name":"Sobere Jr.","public_metrics":{"followers_count":614,"following_count":953,"tweet_count":11294,"listed_count":1},"description":"Sic.Parvis.Magna \uD83D\uDE4F\uD83C\uDFFF...\uD83C\uDFC0Miami Heat Fan\uD83C\uDFC0... ⚽️ChelseaFC Fan⚽️...Burning candles from both sides just to make ENDs meet... Si Vis Pacem ☮️, Para Bellum ☠︎︎","verified":false,"url":"","protected":false,"profile_image_url":" https://pbs.twimg.com/profile_images/1365171494637228033/2w2mpCc__normal.jpg","id":"45812346"},{"username":"RealSeunKuti","created_at":"2011-11-24T15:57:33.000Z","name":"Seun Anikulapo Kuti","location":"Lagos, Nigeria","public_metrics":{"followers_count":150566,"following_count":4081,"tweet_count":207920,"listed_count":338},"description":"GRAMMY NOMINEE \nNight Dreamer is OUT NOW. Listen to it here: https://t.co/GRzne9CPSV ","verified":false,"pinned_tweet_id":"1199727408225632256","url":" https://t.co/5QgvNVEQIz","protected":false,"profile_image_url":" https://pbs.twimg.com/profile_images/1199732523351334912/uliIhuTQ_normal.jpg ","id":"420411751","entities":{"url":{"urls":[{"start":0,"end":23,"url":" https://t.co/5QgvNVEQIz","expanded_url":"https://www.seunkuti.net/ ","display_url":"seunkuti.net "}]},"description":{"urls":[{"start":62,"end":85,"url":" https://t.co/GRzne9CPSV","expanded_url":"http://fanlink.to/nightdreamer ","display_url":"fanlink.to/nightdreamer"}]}}},{"username":"imoleayomichael","created_at":"2017-11-05T11:02:42.000Z","name":"Imoleayo Michael \uD83D\uDC51 {iCode}\uD83D\uDD4A️","location":"192.168.1.1","public_metrics":{"followers_count":9287,"following_count":7701,"tweet_count":26229,"listed_count":8},"description":"CEO, iCode Resources | Tech Guru | Weirdo | Coder | #Programmer #Virgo

Coder","verified":false,"pinned_tweet_id":"1384780512791781376","url":"

https://t.co/9xD9Bb1Olp","protected":false,"profile_image_url":" https://pbs.twimg.com/profile_images/1342557547534966785/jp4DiwSW_normal.jpg ","id":"927129038933626880","entities":{"url":{"urls":[{"start":0,"end":23,"url":" https://t.co/9xD9Bb1Olp","expanded_url":"http://icoderesources.com.ng ","display_url":"icoderesources.com.ng"}]},"description":{"hashtags":[{"start":52,"end":63,"tag":"Programmer"},{"start":64,"end":70,"tag":"Virgo"},{"start":71,"end":77,"tag":"Coder"}]}}},{"username":"Thompso30668006","created_at":"2020-08-23T17:46:58.000Z","name":"Thompson","public_metrics":{"followers_count":201,"following_count":112,"tweet_count":11764,"listed_count":0},"description":"I want to be free","verified":false,"url":"","protected":false,"profile_image_url":" https://pbs.twimg.com/profile_images/1298514497448091653/8lkt6csK_normal.jpg","id":"1297591076174344192"},{"username":"Amaka_Ekwo","created_at":"2014-08-08T07:17:02.000Z","name":"Amaka Ekwo","public_metrics":{"followers_count":120130,"following_count":1979,"tweet_count":212055,"listed_count":234},"description":"Educator | Songwriter |Singer | IPOB Activist | Biafran Activist | Human Rights Activist","verified":false,"pinned_tweet_id":"769573818574700544","url":" https://t.co/bLt3z04nP1","protected":false,"profile_image_url":" https://pbs.twimg.com/profile_images/1137393210144243714/HkYLBfnQ_normal.jpg ","id":"2716396878","entities":{"url":{"urls":[{"start":0,"end":23,"url":" https://t.co/bLt3z04nP1","expanded_url":"http://amakaekwo.com ","display_url":"amakaekwo.com"}]}}},{"username":"Antihat15649589","created_at":"2021-05-03T13:58:10.000Z","name":"Anti_hate","public_metrics":{"followers_count":0,"following_count":129,"tweet_count":13,"listed_count":0},"description":"This page is dedicated to tackling hate on Twitter ng","verified":false,"url":"","protected":false,"profile_image_url":" https://pbs.twimg.com/profile_images/1389220756337434631/xM12iK8d_normal.jpg ","id":"1389217607967035395"}],"tweets":[{"conversation_id":"1388847869894004736","entities":{"urls":[{"start":244,"end":267,"url":" https://t.co/cmBTkZPwmP","expanded_url":" https://twitter.com/pulsenigeria247/status/1388484304699805698 ","display_url":"twitter.com/pulsenigeria24…"}],"annotations":[{"start":17,"end":30,"probability":0.8563,"type":"Person","normalized_text":"Pelumi Onifade"}],"hashtags":[{"start":118,"end":126,"tag":"EndSARS"}]},"text":"Let’s not forget Pelumi Onifade, an intern journalist, who filmed a politician shooting into a crowd last year during #EndSARS and died in police custody for it. No arrests. No justice. Where was this advice then? Would it have saved his life? https://t.co/cmBTkZPwmP","possibly_sensitive":false,"lang":"en","context_annotations":[{"domain":{"id":"46","name":"Brand Category","description":"Categories within Brand Verticals that narrow down the scope of Brands"},"entity":{"id":"781974596752842752","name":"Services"}},{"domain":{"id":"47","name":"Brand","description":"Brands and Companies"},"entity":{"id":"10029202045","name":"Facebook"}},{"domain":{"id":"47","name":"Brand","description":"Brands and Companies"},"entity":{"id":"10045225402","name":"Twitter"}}],"referenced_tweets":[{"type":"quoted","id":"1388484304699805698"}],"created_at":"2021-05-02T13:28:30.000Z","public_metrics":{"retweet_count":2418,"reply_count":19,"like_count":1872,"quote_count":8},"author_id":"124513277","source":"Twitter for iPhone","id":"1388847869894004736","reply_settings":"everyone"},{"conversation_id":"1389084075168763904","in_reply_to_user_id":"3588986417","text":"@NkemdiMary @Blessedceo1 #Terrorists, #thieves, #murderers should not be the ones to assess what is acceptable to people.#EndSARS","possibly_sensitive":false,"lang":"en","entities":{"mentions":[{"start":0,"end":11,"username":"NkemdiMary"},{"start":12,"end":24,"username":"Blessedceo1"}],"hashtags":[{"start":25,"end":36,"tag":"Terrorists"},{"start":38,"end":46,"tag":"thieves"},{"start":48,"end":58,"tag":"murderers"},{"start":121,"end":129,"tag":"EndSARS"}]},"referenced_tweets":[{"type":"replied_to","id":"1389084075168763904"}],"created_at":"2021-05-03T14:41:33.000Z","public_metrics":{"retweet_count":1,"reply_count":0,"like_count":0,"quote_count":0},"author_id":"1316432551054057472","source":"Twitter Web App","id":"1389228641926647808","reply_settings":"everyone"},{"conversation_id":"1389103728616042498","text":"Nigeria better as one, we'll not separate. Breakup unacceptable to us — Tinubu\n\nWHO IS WE/US? Just be ready to run to Togo, bcos Nigeria won’t contain you & #EndSARS victims, after that spilt\n\nTinubu is a Requiem Mass as far as I’m concerned. His 2023 ambition is dead on arrival.","possibly_sensitive":false,"lang":"en","entities":{"annotations":[{"start":0,"end":6,"probability":0.9549,"type":"Place","normalized_text":"Nigeria"},{"start":72,"end":77,"probability":0.8898,"type":"Person","normalized_text":"Tinubu"},{"start":118,"end":121,"probability":0.7707,"type":"Place","normalized_text":"Togo"},{"start":129,"end":135,"probability":0.9617,"type":"Place","normalized_text":"Nigeria"},{"start":193,"end":198,"probability":0.3992,"type":"Person","normalized_text":"Tinubu"}],"hashtags":[{"start":161,"end":169,"tag":"EndSARS"}]},"created_at":"2021-05-03T06:25:11.000Z","public_metrics":{"retweet_count":300,"reply_count":49,"like_count":781,"quote_count":9},"author_id":"201237617","source":"Twitter for iPhone","id":"1389103728616042498","reply_settings":"everyone"},{"conversation_id":"1389084075168763904","entities":{"urls":[{"start":62,"end":85,"url":" https://t.co/E2VIvna8Xz","expanded_url":" https://twitter.com/saharareporters/status/1388952616986681353 ","display_url":"twitter.com/saharareporter…"}],"hashtags":[{"start":45,"end":61,"tag":"BiafraNationNow"}]},"text":"Criminal you don’t have the capacity to stop #BiafraNationNow https://t.co/E2VIvna8Xz","possibly_sensitive":false,"lang":"en","referenced_tweets":[{"type":"quoted","id":"1388952616986681353"}],"created_at":"2021-05-03T05:07:06.000Z","public_metrics":{"retweet_count":26,"reply_count":3,"like_count":11,"quote_count":0},"author_id":"3588986417","source":"Twitter for iPhone","id":"1389084075168763904","reply_settings":"everyone"},{"conversation_id":"1387233122723434496","entities":{"urls":[{"start":68,"end":91,"url":" https://t.co/cRj01Tw4Al","expanded_url":"http://youtu.be/Nd_GRy8SKII ","display_url":"youtu.be/Nd_GRy8SKII"},{"start":272,"end":295,"url":" https://t.co/Sfvu9gL57w","expanded_url":" https://twitter.com/meiklwagner/status/1387233122723434496/photo/1 ","display_url":"pic.twitter.com/Sfvu9gL57w"},{"start":272,"end":295,"url":" https://t.co/Sfvu9gL57w","expanded_url":" https://twitter.com/meiklwagner/status/1387233122723434496/photo/1 ","display_url":"pic.twitter.com/Sfvu9gL57w"},{"start":272,"end":295,"url":" https://t.co/Sfvu9gL57w","expanded_url":" https://twitter.com/meiklwagner/status/1387233122723434496/photo/1 ","display_url":"pic.twitter.com/Sfvu9gL57w"}],"annotations":[{"start":0,"end":15,"probability":0.603,"type":"Other","normalized_text":"Don't Need A Gun"},{"start":19,"end":28,"probability":0.566,"type":"Person","normalized_text":"Billy Idol"},{"start":59,"end":65,"probability":0.4014,"type":"Product","normalized_text":"YouTube"}],"hashtags":[{"start":93,"end":110,"tag":"FridaysForFuture"},{"start":111,"end":118,"tag":"Berlin"},{"start":120,"end":134,"tag":"ClimateChange"},{"start":135,"end":153,"tag":"cinemastrikesback"},{"start":154,"end":157,"tag":"P1"},{"start":158,"end":169,"tag":"Influencer"},{"start":170,"end":192,"tag":"AutismAcceptanceMonth"},{"start":193,"end":197,"tag":"BTC"},{"start":198,"end":215,"tag":"BlackLivesMatter"},{"start":216,"end":227,"tag":"California"},{"start":228,"end":238,"tag":"BMAS_Bund"},{"start":239,"end":260,"tag":"ForaFutureDancefloor"},{"start":263,"end":271,"tag":"EndSARS"}]},"text":"Don't Need A Gun - Billy Idol, 1987, Chrysalis Records.\nOn YouTube: https://t.co/cRj01Tw4Al\n\n#FridaysForFuture #Berlin\uD83D\uDC51

ClimateChange #cinemastrikesback #P1 #Influencer #AutismAcceptanceMonth

BTC #BlackLivesMatter #California #BMAS_Bund

ForaFutureDancefloor\uD83D\uDC83\uD83C\uDFFB #EndSARS

https://t.co/Sfvu9gL57w","possibly_sensitive":false,"lang":"en","context_annotations":[{"domain":{"id":"45","name":"Brand Vertical","description":"Top level entities that describe a Brands industry"},"entity":{"id":"781974596148793345","name":"Business & finance"}},{"domain":{"id":"46","name":"Brand Category","description":"Categories within Brand Verticals that narrow down the scope of Brands"},"entity":{"id":"781974596794716162","name":"Financial services"}},{"domain":{"id":"47","name":"Brand","description":"Brands and Companies"},"entity":{"id":"1007360414114435072","name":"Bitcoin cryptocurrency","description":"Bitcoin Cryptocurrency"}}],"geo":{"place_id":"3078869807f9dd36"},"created_at":"2021-04-28T02:32:04.000Z","public_metrics":{"retweet_count":15,"reply_count":0,"like_count":2,"quote_count":0},"author_id":"3000985198","source":"Twitter for iPad","id":"1387233122723434496","attachments":{"media_keys":["3_1387233110090305538","3_1387233110115356673","3_1387233110115459075"]},"reply_settings":"everyone"},{"conversation_id":"1389140980130009088","text":"Our celebrities can join #EndSARS but can't join #FixTheCountry. Interesting","possibly_sensitive":false,"lang":"en","created_at":"2021-05-03T08:53:13.000Z","public_metrics":{"retweet_count":263,"reply_count":43,"like_count":658,"quote_count":17},"author_id":"1527923652","source":"Twitter for Android","entities":{"hashtags":[{"start":25,"end":33,"tag":"EndSARS"},{"start":49,"end":63,"tag":"FixTheCountry"}]},"id":"1389140980130009088","reply_settings":"everyone"},{"conversation_id":"1388980108640325632","entities":{"urls":[{"start":121,"end":144,"url":" https://t.co/hBKfUlD3MB","expanded_url":" https://twitter.com/thecableng/status/1388944194463539203","display_url":" twitter.com/thecableng/sta…"}],"annotations":[{"start":5,"end":11,"probability":0.7856,"type":"Place","normalized_text":"Nigeria"},{"start":23,"end":28,"probability":0.8866,"type":"Person","normalized_text":"Tinubu"}],"hashtags":[{"start":83,"end":91,"tag":"EndSARS"}]},"text":"When Nigeria breaks up Tinubu, you will be running for your life as you did during #EndSARS.\n\nAl this one is cheap talk. https://t.co/hBKfUlD3MB","possibly_sensitive":false,"lang":"en","referenced_tweets":[{"type":"quoted","id":"1388944194463539203"}],"created_at":"2021-05-02T22:13:58.000Z","public_metrics":{"retweet_count":147,"reply_count":20,"like_count":431,"quote_count":3},"author_id":"116226042","source":"Twitter Web App","id":"1388980108640325632","reply_settings":"everyone"},{"conversation_id":"1389228117701636100","entities":{"urls":[{"start":277,"end":300,"url":" https://t.co/xwdlzaPXEz","expanded_url":" https://twitter.com/RealSeunKuti/status/1389228117701636100/photo/1 ","display_url":"pic.twitter.com/xwdlzaPXEz"}],"annotations":[{"start":71,"end":73,"probability":0.6567,"type":"Person","normalized_text":"DSS"},{"start":167,"end":172,"probability":0.4814,"type":"Person","normalized_text":"41days"}],"mentions":[{"start":9,"end":25,"username":"imoleayomichael"}],"hashtags":[{"start":202,"end":210,"tag":"EndSARS"},{"start":263,"end":276,"tag":"FreeImoleAyo"}]},"text":"Remember @imoleayomichael ?\nThe young computer programmer kidnapped by DSS by 2am at his residence in front of his mum, wife and baby, kept in an underground cell for 41days over his involvement in the #EndSARS protest ?\n\nThe DSS is still bent on convicting him\n\n#FreeImoleAyo https://t.co/xwdlzaPXEz","possibly_sensitive":false,"lang":"en","context_annotations":[{"domain":{"id":"65","name":"Interests and Hobbies Vertical","description":"Top level interests and hobbies groupings, like Food or Travel"},"entity":{"id":"848920371311001600","name":"Technology","description":"Technology and computing"}},{"domain":{"id":"66","name":"Interests and Hobbies Category","description":"A grouping of interests and hobbies entities, like Novelty Food or Destinations"},"entity":{"id":"848921413196984320","name":"Computer programming","description":"Computer programming"}},{"domain":{"id":"65","name":"Interests and Hobbies Vertical","description":"Top level interests and hobbies groupings, like Food or Travel"},"entity":{"id":"864925500627484672","name":"Family and life stages","description":"Family and Life Stages"}},{"domain":{"id":"66","name":"Interests and Hobbies Category","description":"A grouping of interests and hobbies entities, like Novelty Food or Destinations"},"entity":{"id":"864925760624091136","name":"Babies and toddlers","description":"Babies and toddlers"}}],"created_at":"2021-05-03T14:39:28.000Z","public_metrics":{"retweet_count":7,"reply_count":1,"like_count":7,"quote_count":0},"author_id":"420411751","source":"Twitter for iPhone","id":"1389228117701636100","attachments":{"media_keys":["3_1389228112840364043"]},"reply_settings":"everyone"},{"conversation_id":"1389127935945285632","entities":{"urls":[{"start":9,"end":32,"url":" https://t.co/5VmoGDVKCL","expanded_url":" https://twitter.com/saharareporters/status/1389091175525765121 ","display_url":"twitter.com/saharareporter…"}],"hashtags":[{"start":0,"end":8,"tag":"EndSARS"}]},"text":"#EndSARS https://t.co/5VmoGDVKCL","possibly_sensitive":false,"lang":"und","referenced_tweets":[{"type":"quoted","id":"1389091175525765121"}],"created_at":"2021-05-03T08:01:23.000Z","public_metrics":{"retweet_count":237,"reply_count":10,"like_count":165,"quote_count":3},"author_id":"2716396878","source":"Twitter for iPhone","id":"1389127935945285632","reply_settings":"everyone"}]},"meta":{"newest_id":"1389228797975830528","oldest_id":"1389228569713315848","result_count":10,"next_token":"b26v89c19zqg8o3fostuko99iepcowntxfgwukerw43ul"}}

Process finished with exit code 0

On Fri, Apr 30, 2021 at 11:27 PM Ed Summers @.***> wrote:

Building on that a bit more to test your Python environment you can run this little program after replacing CHANGEME with your Bearer Token?

https://gist.github.com/edsu/a1a86ff8398edaef3010e3453665e6d6

If that works then it must be something in twarc.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/DocNow/twarc/issues/441#issuecomment-830433624, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATRWO6B5IB2LP6L6OBQADVTTLMVFJANCNFSM43M324CA .

-- Kingsley Oladayo Ogunne

Department of Corporate Services Obafemi Awolowo University Teaching Hospitals Complex P.M.B. 5538 Ile-Ife, Nigeria

Telephone: +2348088444325, +2349050054242

Wow, so I think this means that there is something in twarc that is causing the problem? @osemele I imagine this is getting tedious but can you upgrade to twarc v2.0.12 and copy/paste what you see when you run a twarc2 search? Also it would be helpful if you could upload the twarc.log file.

pip install --upgrade twarc
twarc2 search "#endsars"

these are the result i get for twarc2 searches:

C:\Users\USER>twarc2 search #endsars ⚡ Unable to parse 400 error as JSON:

C:\Users\USER>twarc2 search '#endsars' ⚡ Unable to parse 400 error as JSON: Bad Request

C:\Users\USER>twarc2 search "#endsars" ⚡ Unable to parse 400 error as JSON: Bad Request

C:\Users\USER>twarc2 search endsars ⚡ Unable to parse 400 error as JSON: Bad Request

C:\Users\USER>twarc2 search endsars --archive ⚡ Unable to parse 400 error as JSON:

Also attached is my twarc log file

On Mon, May 3, 2021 at 4:31 PM Ed Summers @.***> wrote:

Wow, so I think this means that there is something in twarc that is causing the problem? @osemele https://github.com/osemele I imagine this is getting tedious but can you upgrade to twarc v2.0.12 and copy/paste what you see when you run a twarc2 search? Also it would be helpful if you could upload the twarc.log file.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/DocNow/twarc/issues/441#issuecomment-831342012, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATRWO6ECD3MEXDJ5U2H64J3TL26URANCNFSM43M324CA .

-- Kingsley Oladayo Ogunne

Department of Corporate Services Obafemi Awolowo University Teaching Hospitals Complex P.M.B. 5538 Ile-Ife, Nigeria

Telephone: +2348088444325, +2349050054242

2021-04-22 11:17:56,996 INFO Creating HTTP session headers for app auth. 2021-04-22 11:38:30,097 INFO Creating HTTP session headers for app auth. 2021-04-22 11:39:36,748 INFO Creating HTTP session headers for app auth. 2021-04-22 11:41:22,394 INFO Creating HTTP session headers for app auth. 2021-04-22 11:42:36,713 INFO Creating HTTP session headers for app auth. 2021-04-22 11:42:36,713 INFO getting ('https://api.twitter.com/2/tweets/search/all',) {'params': {'expansions': 'author_id,in_reply_to_user_id,referenced_tweets.id,referenced_tweets.id.author_id,entities.mentions.username,attachments.poll_ids,attachments.media_keys,geo.place_id', 'user.fields': 'created_at,description,entities,id,location,name,pinned_tweet_id,profile_image_url,protected,public_metrics,url,username,verified,withheld', 'tweet.fields': 'attachments,author_id,context_annotations,conversation_id,created_at,entities,geo,id,in_reply_to_user_id,lang,public_metrics,text,possibly_sensitive,referenced_tweets,reply_settings,source,withheld', 'media.fields': 'duration_ms,height,media_key,preview_image_url,type,url,width,public_metrics', 'poll.fields': 'duration_minutes,end_datetime,id,options,voting_status', 'place.fields': 'contained_within,country,country_code,full_name,geo,id,name,place_type', 'max_results': 500, 'query': '#endsars', 'start_time': '2006-03-21T00:00:00+00:00'}} 2021-04-22 11:51:54,352 INFO Creating HTTP session headers for app auth. 2021-04-22 11:51:54,352 INFO getting ('https://api.twitter.com/2/tweets/search/recent',) {'params': {'expansions': 'author_id,in_reply_to_user_id,referenced_tweets.id,referenced_tweets.id.author_id,entities.mentions.username,attachments.poll_ids,attachments.media_keys,geo.place_id', 'user.fields': 'created_at,description,entities,id,location,name,pinned_tweet_id,profile_image_url,protected,public_metrics,url,username,verified,withheld', 'tweet.fields': 'attachments,author_id,context_annotations,conversation_id,created_at,entities,geo,id,in_reply_to_user_id,lang,public_metrics,text,possibly_sensitive,referenced_tweets,reply_settings,source,withheld', 'media.fields': 'duration_ms,height,media_key,preview_image_url,type,url,width,public_metrics', 'poll.fields': 'duration_minutes,end_datetime,id,options,voting_status', 'place.fields': 'contained_within,country,country_code,full_name,geo,id,name,place_type', 'max_results': 100, 'query': 'pantami'}} 2021-04-22 11:52:38,516 INFO Creating HTTP session headers for app auth. 2021-04-22 11:52:38,516 INFO getting ('https://api.twitter.com/2/tweets/search/recent',) {'params': {'expansions': 'author_id,in_reply_to_user_id,referenced_tweets.id,referenced_tweets.id.author_id,entities.mentions.username,attachments.poll_ids,attachments.media_keys,geo.place_id', 'user.fields': 'created_at,description,entities,id,location,name,pinned_tweet_id,profile_image_url,protected,public_metrics,url,username,verified,withheld', 'tweet.fields': 'attachments,author_id,context_annotations,conversation_id,created_at,entities,geo,id,in_reply_to_user_id,lang,public_metrics,text,possibly_sensitive,referenced_tweets,reply_settings,source,withheld', 'media.fields': 'duration_ms,height,media_key,preview_image_url,type,url,width,public_metrics', 'poll.fields': 'duration_minutes,end_datetime,id,options,voting_status', 'place.fields': 'contained_within,country,country_code,full_name,geo,id,name,place_type', 'max_results': 100, 'query': 'blacklivesmatter'}} 2021-04-22 11:54:27,526 INFO Creating HTTP session headers for app auth. 2021-04-22 11:54:27,526 INFO getting ('https://api.twitter.com/2/tweets/search/recent',) {'params': {'expansions': 'author_id,in_reply_to_user_id,referenced_tweets.id,referenced_tweets.id.author_id,entities.mentions.username,attachments.poll_ids,attachments.media_keys,geo.place_id', 'user.fields': 'created_at,description,entities,id,location,name,pinned_tweet_id,profile_image_url,protected,public_metrics,url,username,verified,withheld', 'tweet.fields': 'attachments,author_id,context_annotations,conversation_id,created_at,entities,geo,id,in_reply_to_user_id,lang,public_metrics,text,possibly_sensitive,referenced_tweets,reply_settings,source,withheld', 'media.fields': 'duration_ms,height,media_key,preview_image_url,type,url,width,public_metrics', 'poll.fields': 'duration_minutes,end_datetime,id,options,voting_status', 'place.fields': 'contained_within,country,country_code,full_name,geo,id,name,place_type', 'max_results': 100, 'query': 'pantami'}} 2021-04-22 12:00:52,184 INFO Creating HTTP session headers for app auth. 2021-04-22 12:00:52,195 INFO getting ('https://api.twitter.com/2/tweets/search/all',) {'params': {'expansions': 'author_id,in_reply_to_user_id,referenced_tweets.id,referenced_tweets.id.author_id,entities.mentions.username,attachments.poll_ids,attachments.media_keys,geo.place_id', 'user.fields': 'created_at,description,entities,id,location,name,pinned_tweet_id,profile_image_url,protected,public_metrics,url,username,verified,withheld', 'tweet.fields': 'attachments,author_id,context_annotations,conversation_id,created_at,entities,geo,id,in_reply_to_user_id,lang,public_metrics,text,possibly_sensitive,referenced_tweets,reply_settings,source,withheld', 'media.fields': 'duration_ms,height,media_key,preview_image_url,type,url,width,public_metrics', 'poll.fields': 'duration_minutes,end_datetime,id,options,voting_status', 'place.fields': 'contained_within,country,country_code,full_name,geo,id,name,place_type', 'max_results': 500, 'query': "'#ENDSARS'", 'start_time': '2017-12-01T00:00:00+00:00', 'end_time': '2020-11-30T00:00:00+00:00'}} 2021-04-22 12:01:51,193 INFO Creating HTTP session headers for app auth. 2021-04-22 12:01:51,203 INFO getting ('https://api.twitter.com/2/tweets/search/all',) {'params': {'expansions': 'author_id,in_reply_to_user_id,referenced_tweets.id,referenced_tweets.id.author_id,entities.mentions.username,attachments.poll_ids,attachments.media_keys,geo.place_id', 'user.fields': 'created_at,description,entities,id,location,name,pinned_tweet_id,profile_image_url,protected,public_metrics,url,username,verified,withheld', 'tweet.fields': 'attachments,author_id,context_annotations,conversation_id,created_at,entities,geo,id,in_reply_to_user_id,lang,public_metrics,text,possibly_sensitive,referenced_tweets,reply_settings,source,withheld', 'media.fields': 'duration_ms,height,media_key,preview_image_url,type,url,width,public_metrics', 'poll.fields': 'duration_minutes,end_datetime,id,options,voting_status', 'place.fields': 'contained_within,country,country_code,full_name,geo,id,name,place_type', 'max_results': 500, 'query': "'#ENDSARS'", 'start_time': '2017-12-01T00:00:00+00:00', 'end_time': '2020-11-30T00:00:00+00:00'}} 2021-04-22 12:46:36,833 INFO Creating HTTP session headers for app auth. 2021-04-22 12:47:56,472 INFO Creating HTTP session headers for app auth. 2021-04-22 12:48:29,895 INFO Creating HTTP session headers for app auth. 2021-04-22 12:48:29,895 INFO getting ('https://api.twitter.com/2/tweets/search/recent',) {'params': {'expansions': 'author_id,in_reply_to_user_id,referenced_tweets.id,referenced_tweets.id.author_id,entities.mentions.username,attachments.poll_ids,attachments.media_keys,geo.place_id', 'user.fields': 'created_at,description,entities,id,location,name,pinned_tweet_id,profile_image_url,protected,public_metrics,url,username,verified,withheld', 'tweet.fields': 'attachments,author_id,context_annotations,conversation_id,created_at,entities,geo,id,in_reply_to_user_id,lang,public_metrics,text,possibly_sensitive,referenced_tweets,reply_settings,source,withheld', 'media.fields': 'duration_ms,height,media_key,preview_image_url,type,url,width,public_metrics', 'poll.fields': 'duration_minutes,end_datetime,id,options,voting_status', 'place.fields': 'contained_within,country,country_code,full_name,geo,id,name,place_type', 'max_results': 100, 'query': 'blacklivesmatter'}} 2021-04-22 12:49:59,637 INFO Creating HTTP session headers for app auth. 2021-04-22 12:50:50,515 INFO Creating HTTP session headers for app auth. 2021-04-22 12:50:50,517 INFO getting ('https://api.twitter.com/2/tweets/search/all',) {'params': {'expansions': 'author_id,in_reply_to_user_id,referenced_tweets.id,referenced_tweets.id.author_id,entities.mentions.username,attachments.poll_ids,attachments.media_keys,geo.place_id', 'user.fields': 'created_at,description,entities,id,location,name,pinned_tweet_id,profile_image_url,protected,public_metrics,url,username,verified,withheld', 'tweet.fields': 'attachments,author_id,context_annotations,conversation_id,created_at,entities,geo,id,in_reply_to_user_id,lang,public_metrics,text,possibly_sensitive,referenced_tweets,reply_settings,source,withheld', 'media.fields': 'duration_ms,height,media_key,preview_image_url,type,url,width,public_metrics', 'poll.fields': 'duration_minutes,end_datetime,id,options,voting_status', 'place.fields': 'contained_within,country,country_code,full_name,geo,id,name,place_type', 'max_results': 500, 'query': "'#ENDSARS-is:retweet'", 'start_time': '2017-12-01T00:00:00+00:00', 'end_time': '2020-11-30T00:00:00+00:00'}} 2021-04-22 17:56:29,159 INFO Creating HTTP session headers for app auth. 2021-04-22 17:56:29,163 INFO getting ('https://api.twitter.com/2/tweets/search/all',) {'params': {'expansions': 'author_id,in_reply_to_user_id,referenced_tweets.id,referenced_tweets.id.author_id,entities.mentions.username,attachments.poll_ids,attachments.media_keys,geo.place_id', 'user.fields': 'created_at,description,entities,id,location,name,pinned_tweet_id,profile_image_url,protected,public_metrics,url,username,verified,withheld', 'tweet.fields': 'attachments,author_id,context_annotations,conversation_id,created_at,entities,geo,id,in_reply_to_user_id,lang,public_metrics,text,possibly_sensitive,referenced_tweets,reply_settings,source,withheld', 'media.fields': 'duration_ms,height,media_key,preview_image_url,type,url,width,public_metrics', 'poll.fields': 'duration_minutes,end_datetime,id,options,voting_status', 'place.fields': 'contained_within,country,country_code,full_name,geo,id,name,place_type', 'max_results': 500, 'query': "'#ENDSARS-is:retweet'", 'start_time': '2017-12-01T00:00:00+00:00', 'end_time': '2020-11-30T00:00:00+00:00'}} 2021-04-22 17:59:15,105 INFO Creating HTTP session headers for app auth. 2021-04-22 17:59:15,115 INFO getting ('https://api.twitter.com/2/tweets/search/all',) {'params': {'expansions': 'author_id,in_reply_to_user_id,referenced_tweets.id,referenced_tweets.id.author_id,entities.mentions.username,attachments.poll_ids,attachments.media_keys,geo.place_id', 'user.fields': 'created_at,description,entities,id,location,name,pinned_tweet_id,profile_image_url,protected,public_metrics,url,username,verified,withheld', 'tweet.fields': 'attachments,author_id,context_annotations,conversation_id,created_at,entities,geo,id,in_reply_to_user_id,lang,public_metrics,text,possibly_sensitive,referenced_tweets,reply_settings,source,withheld', 'media.fields': 'duration_ms,height,media_key,preview_image_url,type,url,width,public_metrics', 'poll.fields': 'duration_minutes,end_datetime,id,options,voting_status', 'place.fields': 'contained_within,country,country_code,full_name,geo,id,name,place_type', 'max_results': 500, 'query': "'#ENDSARS-is:retweet'", 'start_time': '2017-12-01T00:00:00+00:00', 'end_time': '2020-11-30T00:00:00+00:00'}} 2021-04-22 17:59:52,521 INFO Creating HTTP session headers for app auth. 2021-04-22 17:59:52,532 INFO getting ('https://api.twitter.com/2/tweets/search/all',) {'params': {'expansions': 'author_id,in_reply_to_user_id,referenced_tweets.id,referenced_tweets.id.author_id,entities.mentions.username,attachments.poll_ids,attachments.media_keys,geo.place_id', 'user.fields': 'created_at,description,entities,id,location,name,pinned_tweet_id,profile_image_url,protected,public_metrics,url,username,verified,withheld', 'tweet.fields': 'attachments,author_id,context_annotations,conversation_id,created_at,entities,geo,id,in_reply_to_user_id,lang,public_metrics,text,possibly_sensitive,referenced_tweets,reply_settings,source,withheld', 'media.fields': 'duration_ms,height,media_key,preview_image_url,type,url,width,public_metrics', 'poll.fields': 'duration_minutes,end_datetime,id,options,voting_status', 'place.fields': 'contained_within,country,country_code,full_name,geo,id,name,place_type', 'max_results': 500, 'query': "'#ENDSARS-is:retweet'", 'start_time': '2017-12-01T00:00:00+00:00', 'end_time': '2020-11-30T00:00:00+00:00'}} 2021-04-22 18:01:32,146 INFO Creating HTTP session headers for app auth. 2021-04-22 18:01:32,146 INFO getting ('https://api.twitter.com/2/tweets/search/all',) {'params': {'expansions': 'author_id,in_reply_to_user_id,referenced_tweets.id,referenced_tweets.id.author_id,entities.mentions.username,attachments.poll_ids,attachments.media_keys,geo.place_id', 'user.fields': 'created_at,description,entities,id,location,name,pinned_tweet_id,profile_image_url,protected,public_metrics,url,username,verified,withheld', 'tweet.fields': 'attachments,author_id,context_annotations,conversation_id,created_at,entities,geo,id,in_reply_to_user_id,lang,public_metrics,text,possibly_sensitive,referenced_tweets,reply_settings,source,withheld', 'media.fields': 'duration_ms,height,media_key,preview_image_url,type,url,width,public_metrics', 'poll.fields': 'duration_minutes,end_datetime,id,options,voting_status', 'place.fields': 'contained_within,country,country_code,full_name,geo,id,name,place_type', 'max_results': 500, 'query': "'#ENDSARS-is:retweet'", 'start_time': '2017-12-01T00:00:00+00:00', 'end_time': '2020-11-30T00:00:00+00:00'}} 2021-04-22 18:02:42,421 INFO Creating HTTP session headers for app auth. 2021-04-22 18:02:42,430 INFO getting ('https://api.twitter.com/2/tweets/search/all',) {'params': {'expansions': 'author_id,in_reply_to_user_id,referenced_tweets.id,referenced_tweets.id.author_id,entities.mentions.username,attachments.poll_ids,attachments.media_keys,geo.place_id', 'user.fields': 'created_at,description,entities,id,location,name,pinned_tweet_id,profile_image_url,protected,public_metrics,url,username,verified,withheld', 'tweet.fields': 'attachments,author_id,context_annotations,conversation_id,created_at,entities,geo,id,in_reply_to_user_id,lang,public_metrics,text,possibly_sensitive,referenced_tweets,reply_settings,source,withheld', 'media.fields': 'duration_ms,height,media_key,preview_image_url,type,url,width,public_metrics', 'poll.fields': 'duration_minutes,end_datetime,id,options,voting_status', 'place.fields': 'contained_within,country,country_code,full_name,geo,id,name,place_type', 'max_results': 500, 'query': "'#ENDSARS-is:retweet'", 'start_time': '2017-12-01T00:00:00+00:00', 'end_time': '2020-11-30T00:00:00+00:00'}} 2021-04-23 02:28:11,502 INFO Creating HTTP session headers for app auth. 2021-04-23 02:28:11,556 INFO getting ('https://api.twitter.com/2/tweets/search/all',) {'params': {'expansions': 'author_id,in_reply_to_user_id,referenced_tweets.id,referenced_tweets.id.author_id,entities.mentions.username,attachments.poll_ids,attachments.media_keys,geo.place_id', 'user.fields': 'created_at,description,entities,id,location,name,pinned_tweet_id,profile_image_url,protected,public_metrics,url,username,verified,withheld', 'tweet.fields': 'attachments,author_id,context_annotations,conversation_id,created_at,entities,geo,id,in_reply_to_user_id,lang,public_metrics,text,possibly_sensitive,referenced_tweets,reply_settings,source,withheld', 'media.fields': 'duration_ms,height,media_key,preview_image_url,type,url,width,public_metrics', 'poll.fields': 'duration_minutes,end_datetime,id,options,voting_status', 'place.fields': 'contained_within,country,country_code,full_name,geo,id,name,place_type', 'max_results': 500, 'query': '#ENDSARS -is:retweet', 'start_time': '2017-12-01T00:00:00+00:00', 'end_time': '2020-11-30T00:00:00+00:00'}} 2021-04-24 15:17:32,057 INFO loading None profile from config C:\Users\USER.twarc 2021-04-24 15:18:50,736 INFO loading None profile from config C:\Users\USER.twarc 2021-04-24 15:20:11,140 INFO loading None profile from config C:\Users\USER.twarc 2021-04-24 15:20:11,141 INFO creating http session 2021-04-24 15:20:11,141 INFO creating OAuth1 user authentication 2021-04-24 15:20:11,141 INFO getting ('https://api.twitter.com/1.1/account/verify_credentials.json',) {'params': {'tweet_mode': 'extended'}} 2021-04-24 15:20:12,210 INFO getting ('https://api.twitter.com/1.1/search/tweets.json',) {'params': {'count': 100, 'q': 'blacklivesmatter', 'include_ext_alt_text': 'true', 'include_entities': 'true', 'result_type': 'recent', 'tweet_mode': 'extended'}} 2021-04-24 15:20:13,263 INFO archived 1385961765792530433 2021-04-24 15:20:13,265 INFO archived 1385961752773398532 2021-04-24 15:20:13,266 INFO archived 1385961743944409094 2021-04-24 15:20:13,267 INFO archived 1385961734243033090 2021-04-24 15:20:13,269 INFO archived 1385961732661731329 2021-04-24 15:20:13,270 INFO archived 1385961722683564035 2021-04-24 15:20:13,276 INFO archived 1385961718204059651 2021-04-24 15:20:13,277 INFO archived 1385961632292032512 2021-04-24 15:20:13,279 INFO archived 1385961471780216834 2021-04-24 15:20:13,280 INFO archived 1385961447277006852 2021-04-24 15:20:13,282 INFO archived 1385961403756994560 2021-04-24 15:20:13,283 INFO archived 1385961320097460229 2021-04-24 15:20:13,285 INFO archived 1385961312107311104 2021-04-24 15:20:13,287 INFO archived 1385961300656893952 2021-04-24 15:20:13,295 INFO archived 1385961288468160518 2021-04-24 15:20:13,298 INFO archived 1385961274853449728 2021-04-24 15:20:13,300 INFO archived 1385961273809121281 2021-04-24 15:20:13,303 INFO archived 1385961159178686465 2021-04-24 15:20:13,311 INFO archived 1385961132779786244 2021-04-24 15:20:13,313 INFO archived 1385961112915652610 2021-04-24 15:20:13,316 INFO archived 1385961112772956162 2021-04-24 15:20:13,318 INFO archived 1385961038558814217 2021-04-24 15:20:13,327 INFO archived 1385960990009876486 2021-04-24 15:20:13,328 INFO archived 1385960933600763906 2021-04-24 15:20:13,331 INFO archived 1385960875232796674 2021-04-24 15:20:13,334 INFO archived 1385960791413719049 2021-04-24 15:20:13,345 INFO archived 1385960745586810885 2021-04-24 15:20:13,347 INFO archived 1385960734786473988 2021-04-24 15:20:13,358 INFO archived 1385960732248973312 2021-04-24 15:20:13,360 INFO archived 1385960697083871237 2021-04-24 15:20:13,362 INFO archived 1385960627202633728 2021-04-24 15:20:13,364 INFO archived 1385960616624492551 2021-04-24 15:20:13,367 INFO archived 1385960613491343360 2021-04-24 15:20:13,370 INFO archived 1385960612308602887 2021-04-24 15:20:13,373 INFO archived 1385960610559578113 2021-04-24 15:20:13,378 INFO archived 1385960550882897925 2021-04-24 15:20:13,381 INFO archived 1385960547280166912 2021-04-24 15:20:13,388 INFO archived 1385960495623118851 2021-04-24 15:20:13,392 INFO archived 1385960458910326785 2021-04-24 15:20:13,396 INFO archived 1385960440350576644 2021-04-24 15:20:13,406 INFO archived 1385960420763217928 2021-04-24 15:20:13,409 INFO archived 1385960400588521476 2021-04-24 15:20:13,413 INFO archived 1385960394137608196 2021-04-24 15:20:13,416 INFO archived 1385960380074119175 2021-04-24 15:20:13,419 INFO archived 1385960365125558280 2021-04-24 15:20:13,424 INFO archived 1385960351036952576 2021-04-24 15:20:13,426 INFO archived 1385960301716295682 2021-04-24 15:20:13,437 INFO archived 1385960290777329668 2021-04-24 15:20:13,440 INFO archived 1385960283882065921 2021-04-24 15:20:13,442 INFO archived 1385960249404706828 2021-04-24 15:20:13,445 INFO archived 1385960139535101952 2021-04-24 15:20:13,447 INFO archived 1385960134703190019 2021-04-24 15:20:13,450 INFO archived 1385960123009536001 2021-04-24 15:20:13,452 INFO archived 1385960109688463361 2021-04-24 15:20:13,456 INFO archived 1385960092437200906 2021-04-24 15:20:13,458 INFO archived 1385960086552543237 2021-04-24 15:20:13,461 INFO archived 1385960079472664585 2021-04-24 15:20:13,472 INFO archived 1385960017031962625 2021-04-24 15:20:13,474 INFO archived 1385959981799849984 2021-04-24 15:20:13,484 INFO archived 1385959981518934022 2021-04-24 15:20:13,489 INFO archived 1385959968843735050 2021-04-24 15:20:13,491 INFO archived 1385959968176750600 2021-04-24 15:20:13,493 INFO archived 1385959945225572354 2021-04-24 15:20:13,496 INFO archived 1385959867936960522 2021-04-24 15:20:13,498 INFO archived 1385959843278770177 2021-04-24 15:20:13,500 INFO archived 1385959828405723137 2021-04-24 15:20:13,506 INFO archived 1385959811930640391 2021-04-24 15:20:13,508 INFO archived 1385959727130189825 2021-04-24 15:20:13,516 INFO archived 1385959677695909896 2021-04-24 15:20:13,518 INFO archived 1385959662269304834 2021-04-24 15:20:13,521 INFO archived 1385959588361609220 2021-04-24 15:20:13,524 INFO archived 1385959566635061251 2021-04-24 15:20:13,532 INFO archived 1385959506572623874 2021-04-24 15:20:13,534 INFO archived 1385959494358818818 2021-04-24 15:20:13,537 INFO archived 1385959488063098889 2021-04-24 15:20:13,547 INFO archived 1385959456836554752 2021-04-24 15:20:13,552 INFO archived 1385959439468007431 2021-04-24 15:20:13,554 INFO archived 1385959424993337350 2021-04-24 15:20:13,556 INFO archived 1385959412280532996 2021-04-24 15:20:13,564 INFO archived 1385959369926320129 2021-04-24 15:20:13,566 INFO archived 1385959333557637121 2021-04-24 15:20:13,569 INFO archived 1385959315824066560 2021-04-24 15:20:13,572 INFO archived 1385959309805342722 2021-04-24 15:20:13,580 INFO archived 1385959245103968265 2021-04-24 15:20:13,582 INFO archived 1385959170252419085 2021-04-24 15:20:13,585 INFO archived 1385959169501671425 2021-04-24 15:20:13,587 INFO archived 1385959126312837122 2021-04-24 15:20:13,597 INFO archived 1385959117932670977 2021-04-24 15:20:13,599 INFO archived 1385959107446775811 2021-04-24 15:20:13,602 INFO archived 1385959043454414852 2021-04-24 15:20:13,605 INFO archived 1385958998353055744 2021-04-24 15:20:13,615 INFO archived 1385958990400692224 2021-04-24 15:20:13,618 INFO archived 1385958980678205440 2021-04-24 15:20:13,620 INFO archived 1385958935165812738 2021-04-24 15:20:13,628 INFO archived 1385958916400553987 2021-04-24 15:20:13,630 INFO archived 1385958884624457728 2021-04-24 15:20:13,633 INFO archived 1385958882862792707 2021-04-24 15:20:13,636 INFO archived 1385958872976740355 2021-04-24 15:20:13,644 INFO archived 1385958842157125637 2021-04-24 15:20:13,646 INFO archived 1385958838025834497 2021-04-24 15:20:13,647 INFO getting ('https://api.twitter.com/1.1/search/tweets.json',) {'params': {'count': 100, 'q': 'blacklivesmatter', 'include_ext_alt_text': 'true', 'include_entities': 'true', 'result_type': 'recent', 'tweet_mode': 'extended', 'max_id': '1385958838025834496'}} 2021-04-24 15:20:14,449 INFO archived 1385958816630542338 2021-04-24 15:20:14,453 INFO archived 1385958792979009537 2021-04-24 15:20:14,455 INFO archived 1385958755133648909 2021-04-24 15:20:14,456 INFO archived 1385958747802062852 2021-04-24 15:20:14,458 INFO archived 1385958741292560391 2021-04-24 15:20:14,460 INFO archived 1385958728210567174 2021-04-24 15:20:14,461 INFO archived 1385958684988170242 2021-04-24 15:20:14,464 INFO archived 1385958635289907200 2021-04-24 15:20:14,465 INFO archived 1385958627564040193 2021-04-24 15:20:14,466 INFO archived 1385958602263998469 2021-04-24 15:20:14,469 INFO archived 1385958573516017670 2021-04-24 15:20:14,470 INFO archived 1385958567300194305 2021-04-24 15:20:14,472 INFO archived 1385958544512405506 2021-04-24 15:20:14,473 INFO archived 1385958526930010116 2021-04-24 15:20:14,477 INFO archived 1385958502565253122 2021-04-24 15:20:14,478 INFO archived 1385958487327391751 2021-04-24 15:20:14,480 INFO archived 1385958480985657348 2021-04-24 15:20:14,481 INFO archived 1385958471430987779 2021-04-24 15:20:14,483 INFO archived 1385958464443330563 2021-04-24 15:20:14,484 INFO archived 1385958454595047424 2021-04-24 15:20:14,487 INFO archived 1385958369232519179 2021-04-24 15:20:14,488 INFO archived 1385958347850096647 2021-04-24 15:20:14,489 INFO archived 1385958337163022340 2021-04-24 15:20:14,494 INFO archived 1385958309874839552 2021-04-24 15:20:14,497 INFO archived 1385958256279842818 2021-04-24 15:20:14,498 INFO archived 1385958210595704834 2021-04-24 15:20:14,501 INFO archived 1385958195101945858 2021-04-24 15:20:14,503 INFO archived 1385958095298469889 2021-04-24 15:20:14,504 INFO archived 1385958043981164546 2021-04-24 15:20:14,506 INFO archived 1385958034283896832 2021-04-24 15:20:14,510 INFO archived 1385958029955411974 2021-04-24 15:20:14,512 INFO archived 1385957991023890432 2021-04-24 15:20:14,513 INFO archived 1385957983797059586 2021-04-24 15:20:14,515 INFO archived 1385957952780132353 2021-04-24 15:20:14,516 INFO archived 1385957941031981058 2021-04-24 15:20:14,518 INFO archived 1385957901035085829 2021-04-24 15:20:14,519 INFO archived 1385957845414424576 2021-04-24 15:20:14,521 INFO archived 1385957809913831424 2021-04-24 15:20:14,525 INFO archived 1385957800392671232 2021-04-24 15:20:14,527 INFO archived 1385957792868147202 2021-04-24 15:20:14,529 INFO archived 1385957767022878722 2021-04-24 15:20:14,530 INFO archived 1385957766624317440 2021-04-24 15:20:14,532 INFO archived 1385957766116827137 2021-04-24 15:20:14,533 INFO archived 1385957609698742272 2021-04-24 15:20:14,534 INFO archived 1385957606779498503 2021-04-24 15:20:14,537 INFO archived 1385957600920023041 2021-04-24 15:20:14,541 INFO archived 1385957564870021121 2021-04-24 15:20:14,541 INFO archived 1385957520662044672 2021-04-24 15:20:14,543 INFO archived 1385957516736176128 2021-04-24 15:20:14,545 INFO archived 1385957481755680770 2021-04-24 15:20:14,546 INFO archived 1385957467280920579 2021-04-24 15:20:14,549 INFO archived 1385957409059913736 2021-04-24 15:20:14,550 INFO archived 1385957364835160065 2021-04-24 15:20:14,551 INFO archived 1385957291149697026 2021-04-24 15:20:14,552 INFO archived 1385957274661888000 2021-04-24 15:20:14,557 INFO archived 1385957272099037187 2021-04-24 15:20:14,558 INFO archived 1385957240620847104 2021-04-24 15:20:14,561 INFO archived 1385957238334918660 2021-04-24 15:20:14,562 INFO archived 1385957201827794945 2021-04-24 15:20:14,563 INFO archived 1385957127831818243 2021-04-24 15:20:14,564 INFO archived 1385957100522704898 2021-04-24 15:20:14,566 INFO archived 1385957093056806924 2021-04-24 15:20:14,567 INFO archived 1385957077147848707 2021-04-24 15:20:14,571 INFO archived 1385957000492769280 2021-04-24 15:20:14,573 INFO archived 1385956974223843331 2021-04-24 15:20:14,574 INFO archived 1385956904401215490 2021-04-24 15:20:14,575 INFO archived 1385956897212272644 2021-04-24 15:20:14,577 INFO archived 1385956874886029314 2021-04-24 15:20:14,578 INFO archived 1385956874781134849 2021-04-24 15:20:14,580 INFO archived 1385956860235235329 2021-04-24 15:20:14,581 INFO archived 1385956848688316418 2021-04-24 15:20:14,583 INFO archived 1385956844879990794 2021-04-24 15:20:14,587 INFO archived 1385956806602678272 2021-04-24 15:20:14,589 INFO archived 1385956768384262147 2021-04-24 15:20:14,590 INFO archived 1385956718493016067 2021-04-24 15:20:14,591 INFO archived 1385956700943908873 2021-04-24 15:20:14,592 INFO archived 1385956699857694721 2021-04-24 15:20:14,593 INFO archived 1385956697215275008 2021-04-24 15:20:14,594 INFO archived 1385956582723260419 2021-04-24 15:20:14,596 INFO archived 1385956527102648327 2021-04-24 15:20:14,597 INFO archived 1385956518592499717 2021-04-24 15:20:14,598 INFO archived 1385956309095354370 2021-04-24 15:20:14,602 INFO archived 1385956257073405952 2021-04-24 15:20:14,604 INFO archived 1385956207274434567 2021-04-24 15:20:14,605 INFO archived 1385956190237208580 2021-04-24 15:20:14,606 INFO archived 1385956185589882882 2021-04-24 15:20:14,607 INFO archived 1385956141419618304 2021-04-24 15:20:14,609 INFO archived 1385956103494664208 2021-04-24 15:20:14,610 INFO archived 1385956092195246081 2021-04-24 15:20:14,611 INFO archived 1385956048528453639 2021-04-24 15:20:14,612 INFO archived 1385956016160976896 2021-04-24 15:20:14,613 INFO archived 1385956012851671041 2021-04-24 15:20:14,614 INFO archived 1385955939203772421 2021-04-24 15:20:14,619 INFO archived 1385955927799439365 2021-04-24 15:20:14,620 INFO archived 1385955916193878020 2021-04-24 15:20:14,621 INFO archived 1385955912804876288 2021-04-24 15:20:14,624 INFO archived 1385955894979084292 2021-04-24 15:20:14,627 INFO archived 1385955872732422147 2021-04-24 15:20:14,628 INFO archived 1385955865451171842 2021-04-24 15:20:14,630 INFO archived 1385955799676055557 2021-04-24 15:20:14,630 INFO getting ('https://api.twitter.com/1.1/search/tweets.json',) {'params': {'count': 100, 'q': 'blacklivesmatter', 'include_ext_alt_text': 'true', 'include_entities': 'true', 'result_type': 'recent', 'tweet_mode': 'extended', 'max_id': '1385955799676055556'}} 2021-04-24 15:20:15,316 INFO archived 1385955782785708032 2021-04-24 15:20:15,321 INFO archived 1385955777375096834 2021-04-24 15:20:15,324 INFO archived 1385955770253156353 2021-04-24 15:20:15,325 INFO archived 1385955738623913987 2021-04-24 15:20:15,327 INFO archived 1385955692457218052 2021-04-24 15:20:15,328 INFO archived 1385955641156640768 2021-04-24 15:20:15,329 INFO archived 1385955636806971394 2021-04-24 15:20:15,331 INFO archived 1385955538576547840 2021-04-24 15:20:15,338 INFO archived 1385955526735970306 2021-04-24 15:20:15,341 INFO archived 1385955499095609347 2021-04-24 15:20:15,343 INFO archived 1385955434436218891 2021-04-24 15:20:15,343 INFO archived 1385955431240065024 2021-04-24 15:20:15,345 INFO archived 1385955361379782656 2021-04-24 15:20:15,346 INFO archived 1385955347693596673 2021-04-24 15:20:15,347 INFO archived 1385955345240109057 2021-04-24 15:20:15,351 INFO archived 1385955338613055490 2021-04-24 15:20:15,352 INFO archived 1385955329897283587 2021-04-24 15:20:15,353 INFO archived 1385955237538697216 2021-04-24 15:20:15,354 INFO archived 1385955188851105794 2021-04-24 15:20:15,355 INFO archived 1385955137773056001 2021-04-24 15:20:15,357 INFO archived 1385955046823583748 2021-04-24 15:20:15,358 INFO archived 1385955032827404290 2021-04-24 15:20:15,359 INFO archived 1385954969040216068 2021-04-24 15:20:15,360 INFO archived 1385954968990015489 2021-04-24 15:20:15,361 INFO archived 1385954937738305537 2021-04-24 15:20:15,362 INFO archived 1385954922676510720 2021-04-24 15:20:15,363 INFO archived 1385954912228499456 2021-04-24 15:20:15,367 INFO archived 1385954857715109888 2021-04-24 15:20:15,368 INFO archived 1385954845388066820 2021-04-24 15:20:15,369 INFO archived 1385954833606352901 2021-04-24 15:20:15,370 INFO archived 1385954830217322505 2021-04-24 15:20:15,371 INFO archived 1385954789662629895 2021-04-24 15:20:15,371 INFO archived 1385954774059819008 2021-04-24 15:20:15,372 INFO archived 1385954762135416840 2021-04-24 15:20:15,373 INFO archived 1385954759161651204 2021-04-24 15:20:15,376 INFO archived 1385954739536515075 2021-04-24 15:20:15,376 INFO archived 1385954595395022848 2021-04-24 15:20:15,377 INFO archived 1385954484623265793 2021-04-24 15:20:15,378 INFO archived 1385954477598027776 2021-04-24 15:20:15,382 INFO archived 1385954428725829633 2021-04-24 15:20:15,384 INFO archived 1385954411072172034 2021-04-24 15:20:15,385 INFO archived 1385954333766914048 2021-04-24 15:20:15,386 INFO archived 1385954317090369544 2021-04-24 15:20:15,388 INFO archived 1385954287306612739 2021-04-24 15:20:15,389 INFO archived 1385954220537430029 2021-04-24 15:20:15,391 INFO archived 1385954177055019013 2021-04-24 15:20:15,393 INFO archived 1385954007248670723 2021-04-24 15:20:15,394 INFO archived 1385953856035729410 2021-04-24 15:20:15,398 INFO archived 1385953835932426244 2021-04-24 15:20:15,399 INFO archived 1385953827723956224 2021-04-24 15:20:15,400 INFO archived 1385953785156100096 2021-04-24 15:20:15,401 INFO archived 1385953742730633216 2021-04-24 15:20:15,402 INFO archived 1385953710858145795 2021-04-24 15:20:15,404 INFO archived 1385953659243139076 2021-04-24 15:20:15,406 INFO archived 1385953656567070720 2021-04-24 15:20:15,408 INFO archived 1385953625751572481 2021-04-24 15:20:15,409 INFO archived 1385953612606672901 2021-04-24 15:20:15,413 INFO archived 1385953560106467330 2021-04-24 15:20:15,415 INFO archived 1385953549142593538 2021-04-24 15:20:15,416 INFO archived 1385953548677042178 2021-04-24 15:20:15,417 INFO archived 1385953536580673539 2021-04-24 15:20:15,419 INFO archived 1385953514573074432 2021-04-24 15:20:15,421 INFO archived 1385953488857821190 2021-04-24 15:20:15,423 INFO archived 1385953400727146501 2021-04-24 15:20:15,424 INFO archived 1385953353314848769 2021-04-24 15:20:15,425 INFO archived 1385953347874684928 2021-04-24 15:20:15,426 INFO archived 1385953342191513604 2021-04-24 15:20:15,430 INFO archived 1385953300340690945 2021-04-24 15:20:15,432 INFO archived 1385953297450905605 2021-04-24 15:20:15,432 INFO archived 1385953274818355202 2021-04-24 15:20:15,434 INFO archived 1385953172628328450 2021-04-24 15:20:15,435 INFO archived 1385953134053265411 2021-04-24 15:20:15,437 INFO archived 1385953068466982912 2021-04-24 15:20:15,438 INFO archived 1385953059214348289 2021-04-24 15:20:15,440 INFO archived 1385953055636697089 2021-04-24 15:20:15,442 INFO archived 1385953053539450880 2021-04-24 15:20:15,445 INFO archived 1385953004541685763 2021-04-24 15:20:15,446 INFO archived 1385952993862881284 2021-04-24 15:20:15,447 INFO archived 1385952973419958272 2021-04-24 15:20:15,448 INFO archived 1385952933892788224 2021-04-24 15:20:15,450 INFO archived 1385952909913907203 2021-04-24 15:20:15,451 INFO archived 1385952894567034890 2021-04-24 15:20:15,452 INFO archived 1385952828913553413 2021-04-24 15:20:15,453 INFO archived 1385952817123414019 2021-04-24 15:20:15,454 INFO archived 1385952805949558787 2021-04-24 15:20:15,455 INFO archived 1385952758675746816 2021-04-24 15:20:15,457 INFO archived 1385952746172473345 2021-04-24 15:20:15,461 INFO archived 1385952703621308417 2021-04-24 15:20:15,462 INFO archived 1385952685187239937 2021-04-24 15:20:15,463 INFO archived 1385952668724600832 2021-04-24 15:20:15,465 INFO archived 1385952652903735298 2021-04-24 15:20:15,467 INFO archived 1385952645723131908 2021-04-24 15:20:15,468 INFO archived 1385952596427370504 2021-04-24 15:20:15,470 INFO archived 1385952590626689027 2021-04-24 15:20:15,472 INFO archived 1385952567016972290 2021-04-24 15:20:15,475 INFO archived 1385952538629853186 2021-04-24 15:20:15,477 INFO archived 1385952530782425092 2021-04-24 15:20:15,477 INFO archived 1385952524998516740 2021-04-24 15:20:15,478 INFO archived 1385952515728936965 2021-04-24 15:20:15,479 INFO archived 1385952472565522438 2021-04-24 15:20:15,480 INFO getting ('https://api.twitter.com/1.1/search/tweets.json',) {'params': {'count': 100, 'q': 'blacklivesmatter', 'include_ext_alt_text': 'true', 'include_entities': 'true', 'result_type': 'recent', 'tweet_mode': 'extended', 'max_id': '1385952472565522437'}} 2021-04-24 15:20:16,002 WARNING process received SIGNT, stopping 2021-04-24 15:21:08,985 INFO loading None profile from config C:\Users\USER.twarc 2021-04-24 15:21:08,985 INFO creating http session 2021-04-24 15:21:08,985 INFO creating OAuth1 user authentication 2021-04-24 15:21:08,985 INFO getting ('https://api.twitter.com/1.1/account/verify_credentials.json',) {'params': {'tweet_mode': 'extended'}} 2021-04-24 15:21:10,063 INFO getting ('https://api.twitter.com/1.1/search/tweets.json',) {'params': {'count': 100, 'q': '#pantami', 'include_ext_alt_text': 'true', 'include_entities': 'true', 'result_type': 'recent', 'tweet_mode': 'extended'}} 2021-04-24 15:21:10,791 INFO archived 1385962011360743426 2021-04-24 15:21:10,794 INFO archived 1385961892666040322 2021-04-24 15:21:10,795 INFO archived 1385961429031952391 2021-04-24 15:21:10,797 INFO archived 1385961306726047744 2021-04-24 15:21:10,798 INFO archived 1385961235896848388 2021-04-24 15:21:10,799 INFO archived 1385961052609843201 2021-04-24 15:21:10,800 INFO archived 1385960963938177029 2021-04-24 15:21:10,801 INFO archived 1385960494419390466 2021-04-24 15:21:10,802 INFO archived 1385960289112317955 2021-04-24 15:21:10,802 INFO archived 1385960273551495170 2021-04-24 15:21:10,803 INFO archived 1385960223005974530 2021-04-24 15:21:10,805 INFO archived 1385960174377181187 2021-04-24 15:21:10,805 INFO archived 1385959775221977091 2021-04-24 15:21:10,806 INFO archived 1385959645370540038 2021-04-24 15:21:10,807 INFO archived 1385959491624128515 2021-04-24 15:21:10,811 INFO archived 1385959437240868866 2021-04-24 15:21:10,812 INFO archived 1385959142322589698 2021-04-24 15:21:10,812 INFO archived 1385959092125061129 2021-04-24 15:21:10,813 INFO archived 1385958915389771781 2021-04-24 15:21:10,814 INFO archived 1385958769390198785 2021-04-24 15:21:10,815 INFO archived 1385958741615517701 2021-04-24 15:21:10,816 INFO archived 1385958566327107590 2021-04-24 15:21:10,817 INFO archived 1385957914792374278 2021-04-24 15:21:10,819 INFO archived 1385957661708111873 2021-04-24 15:21:10,821 INFO archived 1385957598462103552 2021-04-24 15:21:10,823 INFO archived 1385957287139893248 2021-04-24 15:21:10,830 INFO archived 1385957148128018435 2021-04-24 15:21:10,832 INFO archived 1385957073167388675 2021-04-24 15:21:10,834 INFO archived 1385956260684521477 2021-04-24 15:21:10,836 INFO archived 1385956084666490882 2021-04-24 15:21:10,839 INFO archived 1385956077368446978 2021-04-24 15:21:10,841 INFO archived 1385956023559770116 2021-04-24 15:21:10,847 INFO archived 1385955908027510788 2021-04-24 15:21:10,849 INFO archived 1385955889333645317 2021-04-24 15:21:10,851 INFO archived 1385955485006848008 2021-04-24 15:21:10,853 INFO archived 1385955369994780676 2021-04-24 15:21:10,855 INFO archived 1385955046282649601 2021-04-24 15:21:10,863 INFO archived 1385954993279225857 2021-04-24 15:21:10,865 INFO archived 1385954897930113025 2021-04-24 15:21:10,867 INFO archived 1385954819739955200 2021-04-24 15:21:10,870 INFO archived 1385954723925217280 2021-04-24 15:21:10,872 INFO archived 1385954639095476225 2021-04-24 15:21:10,879 INFO archived 1385954573521670145 2021-04-24 15:21:10,882 INFO archived 1385954533520650250 2021-04-24 15:21:10,885 INFO archived 1385954461705723906 2021-04-24 15:21:10,886 INFO archived 1385953969244082177 2021-04-24 15:21:10,896 INFO archived 1385953735155884032 2021-04-24 15:21:10,899 INFO archived 1385953413557587968 2021-04-24 15:21:10,901 INFO archived 1385953396935507971 2021-04-24 15:21:10,905 INFO archived 1385953182459863041 2021-04-24 15:21:10,914 INFO archived 1385953156874612743 2021-04-24 15:21:10,917 INFO archived 1385953146674032640 2021-04-24 15:21:10,919 INFO archived 1385953134883786760 2021-04-24 15:21:10,922 INFO archived 1385953129657667586 2021-04-24 15:21:10,925 INFO archived 1385952901042999296 2021-04-24 15:21:10,928 INFO archived 1385952795984072706 2021-04-24 15:21:10,931 INFO archived 1385952346031771653 2021-04-24 15:21:10,933 INFO archived 1385952324653363201 2021-04-24 15:21:10,936 INFO archived 1385952255636082695 2021-04-24 15:21:10,946 INFO archived 1385952227748155393 2021-04-24 15:21:10,949 INFO archived 1385952170617581568 2021-04-24 15:21:10,953 INFO archived 1385952060542226437 2021-04-24 15:21:10,956 INFO archived 1385952035422547974 2021-04-24 15:21:10,959 INFO archived 1385951951305773059 2021-04-24 15:21:10,962 INFO archived 1385951659847786497 2021-04-24 15:21:10,966 INFO archived 1385951584832589825 2021-04-24 15:21:10,978 INFO archived 1385951487084400641 2021-04-24 15:21:10,981 INFO archived 1385951216526663681 2021-04-24 15:21:10,984 INFO archived 1385950732160016385 2021-04-24 15:21:10,987 INFO archived 1385950254256766976 2021-04-24 15:21:10,989 INFO archived 1385950096928411649 2021-04-24 15:21:10,993 INFO archived 1385949941202305025 2021-04-24 15:21:10,996 INFO archived 1385949938660564992 2021-04-24 15:21:11,008 INFO archived 1385949717062901763 2021-04-24 15:21:11,011 INFO archived 1385949560946806786 2021-04-24 15:21:11,014 INFO archived 1385949255148388352 2021-04-24 15:21:11,017 INFO archived 1385949231790366722 2021-04-24 15:21:11,020 INFO archived 1385949121140383745 2021-04-24 15:21:11,024 INFO archived 1385949051372322818 2021-04-24 15:21:11,027 INFO archived 1385948778172014595 2021-04-24 15:21:11,030 INFO archived 1385948670760259593 2021-04-24 15:21:11,040 INFO archived 1385948313179107329 2021-04-24 15:21:11,043 INFO archived 1385948312138833927 2021-04-24 15:21:11,047 INFO archived 1385948142630227969 2021-04-24 15:21:11,049 INFO archived 1385948108660658179 2021-04-24 15:21:11,052 INFO archived 1385947821698867201 2021-04-24 15:21:11,055 INFO archived 1385947526344359945 2021-04-24 15:21:11,058 INFO archived 1385947509927944193 2021-04-24 15:21:11,062 INFO archived 1385947287319371776 2021-04-24 15:21:11,072 INFO archived 1385946965310152705 2021-04-24 15:21:11,076 INFO archived 1385946751983575043 2021-04-24 15:21:11,078 INFO archived 1385946432516067331 2021-04-24 15:21:11,081 INFO archived 1385946243998826501 2021-04-24 15:21:11,084 INFO archived 1385946050469453826 2021-04-24 15:21:11,087 INFO archived 1385945924548055040 2021-04-24 15:21:11,090 INFO archived 1385945885448671234 2021-04-24 15:21:11,094 INFO archived 1385945806792925188 2021-04-24 15:21:11,105 INFO archived 1385945376281223172 2021-04-24 15:21:11,108 INFO archived 1385945334938054659 2021-04-24 15:21:11,110 INFO archived 1385945226397851650 2021-04-24 15:21:11,111 INFO getting ('https://api.twitter.com/1.1/search/tweets.json',) {'params': {'count': 100, 'q': '#pantami', 'include_ext_alt_text': 'true', 'include_entities': 'true', 'result_type': 'recent', 'tweet_mode': 'extended', 'max_id': '1385945226397851649'}} 2021-04-24 15:21:11,722 INFO archived 1385945191316606980 2021-04-24 15:21:11,722 INFO archived 1385945143367413761 2021-04-24 15:21:11,722 INFO archived 1385944937087356930 2021-04-24 15:21:11,722 INFO archived 1385944919261523969 2021-04-24 15:21:11,738 INFO archived 1385944734301097986 2021-04-24 15:21:11,738 INFO archived 1385944641099423747 2021-04-24 15:21:11,738 INFO archived 1385944530814447622 2021-04-24 15:21:11,738 INFO archived 1385944371888115714 2021-04-24 15:21:11,738 INFO archived 1385944309032263680 2021-04-24 15:21:11,738 INFO archived 1385943927807750146 2021-04-24 15:21:11,738 INFO archived 1385943635628232709 2021-04-24 15:21:11,738 INFO archived 1385943461292085249 2021-04-24 15:21:11,738 INFO archived 1385943423501361155 2021-04-24 15:21:11,753 INFO archived 1385943244782067712 2021-04-24 15:21:11,753 INFO archived 1385943062023659520 2021-04-24 15:21:11,753 INFO archived 1385943045921722371 2021-04-24 15:21:11,769 INFO archived 1385942964229267456 2021-04-24 15:21:11,776 INFO archived 1385942928690978819 2021-04-24 15:21:11,776 INFO archived 1385942899041439748 2021-04-24 15:21:11,776 INFO archived 1385942869517737989 2021-04-24 15:21:11,776 INFO archived 1385942751867441154 2021-04-24 15:21:11,776 INFO archived 1385942598414647296 2021-04-24 15:21:11,791 INFO archived 1385942449118486531 2021-04-24 15:21:11,791 INFO archived 1385942341048053764 2021-04-24 15:21:11,807 INFO archived 1385942285318303746 2021-04-24 15:21:11,807 INFO archived 1385942022440239107 2021-04-24 15:21:11,807 INFO archived 1385941880442179584 2021-04-24 15:21:11,807 INFO archived 1385941843700068356 2021-04-24 15:21:11,823 INFO archived 1385941817032597507 2021-04-24 15:21:11,823 INFO archived 1385941774175285248 2021-04-24 15:21:11,838 INFO archived 1385941651340865537 2021-04-24 15:21:11,838 INFO archived 1385941630096715781 2021-04-24 15:21:11,838 INFO archived 1385941515499937793 2021-04-24 15:21:11,838 INFO archived 1385941277364129792 2021-04-24 15:21:11,854 INFO archived 1385941232992636928 2021-04-24 15:21:11,854 INFO archived 1385941111953297409 2021-04-24 15:21:11,869 INFO archived 1385941110007255043 2021-04-24 15:21:11,869 INFO archived 1385940908131110913 2021-04-24 15:21:11,876 INFO archived 1385940762647465984 2021-04-24 15:21:11,876 INFO archived 1385940753122222081 2021-04-24 15:21:11,876 INFO archived 1385940750182068230 2021-04-24 15:21:11,876 INFO archived 1385940483873017862 2021-04-24 15:21:11,892 INFO archived 1385940404026150917 2021-04-24 15:21:11,892 INFO archived 1385940340813844482 2021-04-24 15:21:11,907 INFO archived 1385940204704370693 2021-04-24 15:21:11,907 INFO archived 1385939827271639040 2021-04-24 15:21:11,907 INFO archived 1385939543392665602 2021-04-24 15:21:11,907 INFO archived 1385939430658224130 2021-04-24 15:21:11,923 INFO archived 1385939294716669954 2021-04-24 15:21:11,923 INFO archived 1385939130341859328 2021-04-24 15:21:11,938 INFO archived 1385939026994155531 2021-04-24 15:21:11,938 INFO archived 1385938998632275974 2021-04-24 15:21:11,938 INFO archived 1385938745535438849 2021-04-24 15:21:11,938 INFO archived 1385938471143964678 2021-04-24 15:21:11,954 INFO archived 1385938444145369088 2021-04-24 15:21:11,954 INFO archived 1385938428437700608 2021-04-24 15:21:11,970 INFO archived 1385938410045677568 2021-04-24 15:21:11,970 INFO archived 1385938223164272643 2021-04-24 15:21:11,976 INFO archived 1385938199193821188 2021-04-24 15:21:11,976 INFO archived 1385938142218399749 2021-04-24 15:21:11,976 INFO archived 1385938052992970753 2021-04-24 15:21:11,976 INFO archived 1385937999163166722 2021-04-24 15:21:11,992 INFO archived 1385937949464924162 2021-04-24 15:21:11,992 INFO archived 1385937744975773699 2021-04-24 15:21:11,992 INFO archived 1385937587009896450 2021-04-24 15:21:11,992 INFO archived 1385937513995513857 2021-04-24 15:21:11,992 INFO archived 1385937413860700163 2021-04-24 15:21:12,007 INFO archived 1385937356558057472 2021-04-24 15:21:12,007 INFO archived 1385937340070305792 2021-04-24 15:21:12,007 INFO archived 1385937240694603780 2021-04-24 15:21:12,007 INFO archived 1385937227411243012 2021-04-24 15:21:12,007 INFO archived 1385937182498623492 2021-04-24 15:21:12,023 INFO archived 1385937029750525954 2021-04-24 15:21:12,023 INFO archived 1385936814666625024 2021-04-24 15:21:12,023 INFO archived 1385936789853048832 2021-04-24 15:21:12,039 INFO archived 1385936760924946444 2021-04-24 15:21:12,039 INFO archived 1385936749310922752 2021-04-24 15:21:12,039 INFO archived 1385936670558674946 2021-04-24 15:21:12,039 INFO archived 1385936626304618498 2021-04-24 15:21:12,039 INFO archived 1385936474990862336 2021-04-24 15:21:12,039 INFO archived 1385936405453578240 2021-04-24 15:21:12,039 INFO archived 1385936351321804809 2021-04-24 15:21:12,054 INFO archived 1385936298846916612 2021-04-24 15:21:12,054 INFO archived 1385936268224237571 2021-04-24 15:21:12,054 INFO archived 1385936134413426689 2021-04-24 15:21:12,054 INFO archived 1385936072509636611 2021-04-24 15:21:12,054 INFO archived 1385935881970896899 2021-04-24 15:21:12,070 INFO archived 1385935879844384769 2021-04-24 15:21:12,076 INFO archived 1385935867768868866 2021-04-24 15:21:12,076 INFO archived 1385935750336757763 2021-04-24 15:21:12,076 INFO archived 1385935645349236740 2021-04-24 15:21:12,076 INFO archived 1385935567037374470 2021-04-24 15:21:12,092 INFO archived 1385935537564012547 2021-04-24 15:21:12,092 INFO archived 1385935353811460096 2021-04-24 15:21:12,092 INFO archived 1385935265718542340 2021-04-24 15:21:12,092 INFO archived 1385935248802861060 2021-04-24 15:21:12,092 INFO archived 1385935091998806020 2021-04-24 15:21:12,108 INFO archived 1385935057009979395 2021-04-24 15:21:12,108 INFO archived 1385935000802058245 2021-04-24 15:21:12,108 INFO archived 1385934988558934019 2021-04-24 15:21:12,108 INFO getting ('https://api.twitter.com/1.1/search/tweets.json',) {'params': {'count': 100, 'q': '#pantami', 'include_ext_alt_text': 'true', 'include_entities': 'true', 'result_type': 'recent', 'tweet_mode': 'extended', 'max_id': '1385934988558934018'}} 2021-04-24 15:21:12,658 WARNING process received SIGNT, stopping 2021-04-24 15:23:20,322 INFO Creating HTTP session headers for app auth. 2021-04-24 15:23:20,323 INFO getting ('https://api.twitter.com/2/tweets/search/recent',) {'params': {'expansions': 'author_id,in_reply_to_user_id,referenced_tweets.id,referenced_tweets.id.author_id,entities.mentions.username,attachments.poll_ids,attachments.media_keys,geo.place_id', 'user.fields': 'created_at,description,entities,id,location,name,pinned_tweet_id,profile_image_url,protected,public_metrics,url,username,verified,withheld', 'tweet.fields': 'attachments,author_id,context_annotations,conversation_id,created_at,entities,geo,id,in_reply_to_user_id,lang,public_metrics,text,possibly_sensitive,referenced_tweets,reply_settings,source,withheld', 'media.fields': 'duration_ms,height,media_key,preview_image_url,type,url,width,public_metrics', 'poll.fields': 'duration_minutes,end_datetime,id,options,voting_status', 'place.fields': 'contained_within,country,country_code,full_name,geo,id,name,place_type', 'max_results': 100, 'query': '#pantami'}} 2021-04-24 15:23:58,442 INFO loading None profile from config C:\Users\USER.twarc 2021-04-24 15:23:58,443 INFO creating http session 2021-04-24 15:23:58,443 INFO creating OAuth1 user authentication 2021-04-24 15:23:58,443 INFO getting ('https://api.twitter.com/1.1/account/verify_credentials.json',) {'params': {'tweet_mode': 'extended'}} 2021-04-24 15:23:59,586 INFO getting ('https://api.twitter.com/1.1/search/tweets.json',) {'params': {'count': 100, 'q': '#pantami', 'include_ext_alt_text': 'true', 'include_entities': 'true', 'result_type': 'recent', 'tweet_mode': 'extended'}} 2021-04-24 15:24:00,589 INFO archived 1385962726124630022 2021-04-24 15:24:00,593 INFO archived 1385962516182884355 2021-04-24 15:24:00,595 INFO archived 1385962513771159556 2021-04-24 15:24:00,596 INFO archived 1385962500483690497 2021-04-24 15:24:00,597 INFO archived 1385962105409474566 2021-04-24 15:24:00,598 INFO archived 1385962011360743426 2021-04-24 15:24:00,599 INFO archived 1385961892666040322 2021-04-24 15:24:00,600 INFO archived 1385961429031952391 2021-04-24 15:24:00,602 INFO archived 1385961306726047744 2021-04-24 15:24:00,603 INFO archived 1385961235896848388 2021-04-24 15:24:00,604 INFO archived 1385961052609843201 2021-04-24 15:24:00,605 INFO archived 1385960963938177029 2021-04-24 15:24:00,606 INFO archived 1385960494419390466 2021-04-24 15:24:00,608 INFO archived 1385960289112317955 2021-04-24 15:24:00,618 INFO archived 1385960273551495170 2021-04-24 15:24:00,619 INFO archived 1385960223005974530 2021-04-24 15:24:00,620 INFO archived 1385960174377181187 2021-04-24 15:24:00,621 INFO archived 1385959775221977091 2021-04-24 15:24:00,623 INFO archived 1385959645370540038 2021-04-24 15:24:00,624 INFO archived 1385959491624128515 2021-04-24 15:24:00,625 INFO archived 1385959437240868866 2021-04-24 15:24:00,626 INFO archived 1385959142322589698 2021-04-24 15:24:00,627 INFO archived 1385959092125061129 2021-04-24 15:24:00,628 INFO archived 1385958915389771781 2021-04-24 15:24:00,629 INFO archived 1385958769390198785 2021-04-24 15:24:00,630 INFO archived 1385958741615517701 2021-04-24 15:24:00,632 INFO archived 1385958566327107590 2021-04-24 15:24:00,633 INFO archived 1385957914792374278 2021-04-24 15:24:00,634 INFO archived 1385957661708111873 2021-04-24 15:24:00,635 INFO archived 1385957598462103552 2021-04-24 15:24:00,636 INFO archived 1385957287139893248 2021-04-24 15:24:00,637 INFO archived 1385957148128018435 2021-04-24 15:24:00,639 INFO archived 1385957073167388675 2021-04-24 15:24:00,640 INFO archived 1385956260684521477 2021-04-24 15:24:00,644 INFO archived 1385956084666490882 2021-04-24 15:24:00,645 INFO archived 1385956077368446978 2021-04-24 15:24:00,646 INFO archived 1385956023559770116 2021-04-24 15:24:00,648 INFO archived 1385955908027510788 2021-04-24 15:24:00,649 INFO archived 1385955889333645317 2021-04-24 15:24:00,650 INFO archived 1385955485006848008 2021-04-24 15:24:00,651 INFO archived 1385955369994780676 2021-04-24 15:24:00,652 INFO archived 1385955046282649601 2021-04-24 15:24:00,654 INFO archived 1385954993279225857 2021-04-24 15:24:00,655 INFO archived 1385954897930113025 2021-04-24 15:24:00,657 INFO archived 1385954819739955200 2021-04-24 15:24:00,671 INFO archived 1385954723925217280 2021-04-24 15:24:00,672 INFO archived 1385954639095476225 2021-04-24 15:24:00,673 INFO archived 1385954573521670145 2021-04-24 15:24:00,675 INFO archived 1385954533520650250 2021-04-24 15:24:00,676 INFO archived 1385954461705723906 2021-04-24 15:24:00,677 INFO archived 1385953969244082177 2021-04-24 15:24:00,678 INFO archived 1385953735155884032 2021-04-24 15:24:00,679 INFO archived 1385953413557587968 2021-04-24 15:24:00,680 INFO archived 1385953396935507971 2021-04-24 15:24:00,682 INFO archived 1385953182459863041 2021-04-24 15:24:00,683 INFO archived 1385953156874612743 2021-04-24 15:24:00,684 INFO archived 1385953146674032640 2021-04-24 15:24:00,685 INFO archived 1385953134883786760 2021-04-24 15:24:00,687 INFO archived 1385953129657667586 2021-04-24 15:24:00,688 INFO archived 1385952901042999296 2021-04-24 15:24:00,692 INFO archived 1385952795984072706 2021-04-24 15:24:00,693 INFO archived 1385952346031771653 2021-04-24 15:24:00,695 INFO archived 1385952324653363201 2021-04-24 15:24:00,696 INFO archived 1385952255636082695 2021-04-24 15:24:00,697 INFO archived 1385952227748155393 2021-04-24 15:24:00,698 INFO archived 1385952170617581568 2021-04-24 15:24:00,699 INFO archived 1385952060542226437 2021-04-24 15:24:00,700 INFO archived 1385952035422547974 2021-04-24 15:24:00,702 INFO archived 1385951951305773059 2021-04-24 15:24:00,703 INFO archived 1385951659847786497 2021-04-24 15:24:00,704 INFO archived 1385951584832589825 2021-04-24 15:24:00,718 INFO archived 1385951487084400641 2021-04-24 15:24:00,719 INFO archived 1385951216526663681 2021-04-24 15:24:00,720 INFO archived 1385950732160016385 2021-04-24 15:24:00,722 INFO archived 1385950254256766976 2021-04-24 15:24:00,722 INFO archived 1385950096928411649 2021-04-24 15:24:00,724 INFO archived 1385949941202305025 2021-04-24 15:24:00,725 INFO archived 1385949938660564992 2021-04-24 15:24:00,726 INFO archived 1385949717062901763 2021-04-24 15:24:00,728 INFO archived 1385949560946806786 2021-04-24 15:24:00,729 INFO archived 1385949255148388352 2021-04-24 15:24:00,730 INFO archived 1385949231790366722 2021-04-24 15:24:00,731 INFO archived 1385949121140383745 2021-04-24 15:24:00,732 INFO archived 1385949051372322818 2021-04-24 15:24:00,734 INFO archived 1385948778172014595 2021-04-24 15:24:00,734 INFO archived 1385948670760259593 2021-04-24 15:24:00,736 INFO archived 1385948313179107329 2021-04-24 15:24:00,739 INFO archived 1385948312138833927 2021-04-24 15:24:00,741 INFO archived 1385948142630227969 2021-04-24 15:24:00,742 INFO archived 1385948108660658179 2021-04-24 15:24:00,743 INFO archived 1385947821698867201 2021-04-24 15:24:00,744 INFO archived 1385947526344359945 2021-04-24 15:24:00,746 INFO archived 1385947509927944193 2021-04-24 15:24:00,747 INFO archived 1385947287319371776 2021-04-24 15:24:00,748 INFO archived 1385946965310152705 2021-04-24 15:24:00,749 INFO archived 1385946751983575043 2021-04-24 15:24:00,750 INFO archived 1385946432516067331 2021-04-24 15:24:00,752 INFO archived 1385946243998826501 2021-04-24 15:24:00,755 INFO archived 1385946050469453826 2021-04-24 15:24:00,757 INFO archived 1385945924548055040 2021-04-24 15:24:00,757 INFO getting ('https://api.twitter.com/1.1/search/tweets.json',) {'params': {'count': 100, 'q': '#pantami', 'include_ext_alt_text': 'true', 'include_entities': 'true', 'result_type': 'recent', 'tweet_mode': 'extended', 'max_id': '1385945924548055039'}} 2021-04-24 15:24:01,673 INFO archived 1385945885448671234 2021-04-24 15:24:01,681 INFO archived 1385945806792925188 2021-04-24 15:24:01,683 INFO archived 1385945376281223172 2021-04-24 15:24:01,683 INFO archived 1385945334938054659 2021-04-24 15:24:01,683 INFO archived 1385945226397851650 2021-04-24 15:24:01,683 INFO archived 1385945191316606980 2021-04-24 15:24:01,683 INFO archived 1385945143367413761 2021-04-24 15:24:01,683 INFO archived 1385944937087356930 2021-04-24 15:24:01,683 INFO archived 1385944919261523969 2021-04-24 15:24:01,691 INFO archived 1385944734301097986 2021-04-24 15:24:01,691 INFO archived 1385944641099423747 2021-04-24 15:24:01,693 INFO archived 1385944530814447622 2021-04-24 15:24:01,693 INFO archived 1385944371888115714 2021-04-24 15:24:01,693 INFO archived 1385944309032263680 2021-04-24 15:24:01,693 INFO archived 1385943927807750146 2021-04-24 15:24:01,693 INFO archived 1385943635628232709 2021-04-24 15:24:01,693 INFO archived 1385943461292085249 2021-04-24 15:24:01,693 INFO archived 1385943423501361155 2021-04-24 15:24:01,701 INFO archived 1385943244782067712 2021-04-24 15:24:01,703 INFO archived 1385943062023659520 2021-04-24 15:24:01,703 INFO archived 1385943045921722371 2021-04-24 15:24:01,703 INFO archived 1385942964229267456 2021-04-24 15:24:01,703 INFO archived 1385942928690978819 2021-04-24 15:24:01,703 INFO archived 1385942899041439748 2021-04-24 15:24:01,703 INFO archived 1385942869517737989 2021-04-24 15:24:01,703 INFO archived 1385942751867441154 2021-04-24 15:24:01,711 INFO archived 1385942598414647296 2021-04-24 15:24:01,711 INFO archived 1385942449118486531 2021-04-24 15:24:01,713 INFO archived 1385942341048053764 2021-04-24 15:24:01,713 INFO archived 1385942285318303746 2021-04-24 15:24:01,713 INFO archived 1385942022440239107 2021-04-24 15:24:01,713 INFO archived 1385941880442179584 2021-04-24 15:24:01,713 INFO archived 1385941843700068356 2021-04-24 15:24:01,713 INFO archived 1385941817032597507 2021-04-24 15:24:01,713 INFO archived 1385941774175285248 2021-04-24 15:24:01,713 INFO archived 1385941651340865537 2021-04-24 15:24:01,713 INFO archived 1385941630096715781 2021-04-24 15:24:01,721 INFO archived 1385941515499937793 2021-04-24 15:24:01,723 INFO archived 1385941277364129792 2021-04-24 15:24:01,723 INFO archived 1385941232992636928 2021-04-24 15:24:01,723 INFO archived 1385941111953297409 2021-04-24 15:24:01,723 INFO archived 1385941110007255043 2021-04-24 15:24:01,723 INFO archived 1385940908131110913 2021-04-24 15:24:01,723 INFO archived 1385940762647465984 2021-04-24 15:24:01,723 INFO archived 1385940753122222081 2021-04-24 15:24:01,731 INFO archived 1385940750182068230 2021-04-24 15:24:01,731 INFO archived 1385940483873017862 2021-04-24 15:24:01,733 INFO archived 1385940404026150917 2021-04-24 15:24:01,733 INFO archived 1385940340813844482 2021-04-24 15:24:01,733 INFO archived 1385940204704370693 2021-04-24 15:24:01,733 INFO archived 1385939827271639040 2021-04-24 15:24:01,733 INFO archived 1385939543392665602 2021-04-24 15:24:01,733 INFO archived 1385939430658224130 2021-04-24 15:24:01,733 INFO archived 1385939294716669954 2021-04-24 15:24:01,733 INFO archived 1385939130341859328 2021-04-24 15:24:01,733 INFO archived 1385939026994155531 2021-04-24 15:24:01,743 INFO archived 1385938998632275974 2021-04-24 15:24:01,752 INFO archived 1385938745535438849 2021-04-24 15:24:01,752 INFO archived 1385938471143964678 2021-04-24 15:24:01,752 INFO archived 1385938444145369088 2021-04-24 15:24:01,752 INFO archived 1385938428437700608 2021-04-24 15:24:01,752 INFO archived 1385938410045677568 2021-04-24 15:24:01,752 INFO archived 1385938223164272643 2021-04-24 15:24:01,752 INFO archived 1385938199193821188 2021-04-24 15:24:01,752 INFO archived 1385938142218399749 2021-04-24 15:24:01,752 INFO archived 1385938052992970753 2021-04-24 15:24:01,752 INFO archived 1385937999163166722 2021-04-24 15:24:01,762 INFO archived 1385937949464924162 2021-04-24 15:24:01,762 INFO archived 1385937744975773699 2021-04-24 15:24:01,762 INFO archived 1385937587009896450 2021-04-24 15:24:01,762 INFO archived 1385937513995513857 2021-04-24 15:24:01,762 INFO archived 1385937413860700163 2021-04-24 15:24:01,762 INFO archived 1385937356558057472 2021-04-24 15:24:01,762 INFO archived 1385937340070305792 2021-04-24 15:24:01,762 INFO archived 1385937240694603780 2021-04-24 15:24:01,762 INFO archived 1385937227411243012 2021-04-24 15:24:01,762 INFO archived 1385937182498623492 2021-04-24 15:24:01,762 INFO archived 1385937029750525954 2021-04-24 15:24:01,777 INFO archived 1385936814666625024 2021-04-24 15:24:01,777 INFO archived 1385936789853048832 2021-04-24 15:24:01,777 INFO archived 1385936760924946444 2021-04-24 15:24:01,777 INFO archived 1385936749310922752 2021-04-24 15:24:01,777 INFO archived 1385936670558674946 2021-04-24 15:24:01,777 INFO archived 1385936626304618498 2021-04-24 15:24:01,777 INFO archived 1385936474990862336 2021-04-24 15:24:01,777 INFO archived 1385936405453578240 2021-04-24 15:24:01,777 INFO archived 1385936351321804809 2021-04-24 15:24:01,793 INFO archived 1385936298846916612 2021-04-24 15:24:01,793 INFO archived 1385936268224237571 2021-04-24 15:24:01,793 INFO archived 1385936134413426689 2021-04-24 15:24:01,793 INFO archived 1385936072509636611 2021-04-24 15:24:01,793 INFO archived 1385935881970896899 2021-04-24 15:24:01,793 INFO archived 1385935879844384769 2021-04-24 15:24:01,793 INFO archived 1385935867768868866 2021-04-24 15:24:01,808 INFO archived 1385935750336757763 2021-04-24 15:24:01,808 INFO archived 1385935645349236740 2021-04-24 15:24:01,808 INFO archived 1385935567037374470 2021-04-24 15:24:01,808 INFO archived 1385935537564012547 2021-04-24 15:24:01,808 INFO archived 1385935353811460096 2021-04-24 15:24:01,808 INFO archived 1385935265718542340 2021-04-24 15:24:01,808 INFO getting ('https://api.twitter.com/1.1/search/tweets.json',) {'params': {'count': 100, 'q': '#pantami', 'include_ext_alt_text': 'true', 'include_entities': 'true', 'result_type': 'recent', 'tweet_mode': 'extended', 'max_id': '1385935265718542339'}} 2021-04-24 15:24:02,723 INFO archived 1385935248802861060 2021-04-24 15:24:02,728 INFO archived 1385935091998806020 2021-04-24 15:24:02,730 INFO archived 1385935057009979395 2021-04-24 15:24:02,731 INFO archived 1385935000802058245 2021-04-24 15:24:02,733 INFO archived 1385934988558934019 2021-04-24 15:24:02,735 INFO archived 1385934934121009160 2021-04-24 15:24:02,736 INFO archived 1385934842261647360 2021-04-24 15:24:02,741 INFO archived 1385934596626395136 2021-04-24 15:24:02,742 INFO archived 1385934467232055301 2021-04-24 15:24:02,744 INFO archived 1385934443001442310 2021-04-24 15:24:02,745 INFO archived 1385934397342429185 2021-04-24 15:24:02,747 INFO archived 1385934373619441664 2021-04-24 15:24:02,750 INFO archived 1385934338940940288 2021-04-24 15:24:02,769 INFO archived 1385934304514084868 2021-04-24 15:24:02,774 INFO archived 1385934301833961474 2021-04-24 15:24:02,778 INFO archived 1385934217230565381 2021-04-24 15:24:02,781 INFO archived 1385934004533309443 2021-04-24 15:24:02,794 INFO archived 1385934003325313026 2021-04-24 15:24:02,798 INFO archived 1385933983721172993 2021-04-24 15:24:02,803 INFO archived 1385933907611328516 2021-04-24 15:24:02,805 INFO archived 1385933860106653696 2021-04-24 15:24:02,807 INFO archived 1385933684654628864 2021-04-24 15:24:02,811 INFO archived 1385933539846283269 2021-04-24 15:24:02,816 INFO archived 1385933341510316033 2021-04-24 15:24:02,827 INFO archived 1385933159934615552 2021-04-24 15:24:02,831 INFO archived 1385933095996694528 2021-04-24 15:24:02,835 INFO archived 1385932990518337538 2021-04-24 15:24:02,839 INFO archived 1385932987301310465 2021-04-24 15:24:02,843 INFO archived 1385932905822756866 2021-04-24 15:24:02,847 INFO archived 1385932467035676674 2021-04-24 15:24:02,858 INFO archived 1385932314299994112 2021-04-24 15:24:02,863 INFO archived 13859322903254548

@osemele Thanks! - unfortunately github cannot read attachments via email, you'll have to go to github.com and attach it there.

I still have a suspicion this is still something to do with your network / firewall or something like that. Since running the python code directly seemed to work, i would look to see if twarc2.exe is being blocked by a firewall or something. It's the only thing i can think of - because the python code you ran that worked, is exactly the code that's called by the command line tool. But there's a bunch of other things inside twarc that could go wrong too, so if it is a bug, it would be great to identify and fix!

Here's another example to try, this uses the twarc implementation:

import datetime
import itertools

from twarc.client2 import Twarc2
from twarc.expansions import flatten

# Your bearer token here
t = Twarc2(bearer_token="A...z")

# Start and end times must be in UTC
start_time = datetime.datetime(2006, 3, 21, 0, 0, 0, 0, datetime.timezone.utc)
end_time = datetime.datetime(2021, 4, 27, 0, 0, 0, 0, datetime.timezone.utc)

# search_results is a generator, max_results is max tweets per page, 500 max for full archive search.
search_results = t.search_all(query="dogs lang:en -is:retweet", start_time=start_time, end_time=end_time, max_results=10)

# Get just 1 page of results instead of iterating over everything in search_results:
for page in itertools.islice(search_results, 1):
    for tweet in flatten(page)['data']:
        # Do something with the tweet
        print(tweet)

If you run that same way as the test_api.py earlier it should also work - or fail with a descriptive error.

This also ran perfectly without errors. So, what can i do next?

On Tue, May 4, 2021 at 1:21 PM Igor Brigadir @.***> wrote:

@osemele https://github.com/osemele Thanks! - unfortunately github cannot read attachments via email, you'll have to go to github.com and attach it there.

I still have a suspicion this is still something to do with your network / firewall or something like that. Since running the python code directly seemed to work, i would look to see if twarc2.exe is being blocked by a firewall or something. It's the only thing i can think of - because the python code you ran that worked, is exactly the code that's called by the command line tool. But there's a bunch of other things inside twarc that could go wrong too, so if it is a bug, it would be great to identify and fix!

Here's another example to try, this uses the twarc implementation:

import datetimeimport itertools from twarc.client2 import Twarc2from twarc.expansions import flatten

Your bearer token heret = Twarc2(bearer_token="A...z")

Start and end times must be in UTCstart_time = datetime.datetime(2006, 3, 21, 0, 0, 0, 0, datetime.timezone.utc)end_time = datetime.datetime(2021, 4, 27, 0, 0, 0, 0, datetime.timezone.utc)

search_results is a generator, max_results is max tweets per page, 500 max for full archive search.search_results = t.search_all(query="dogs lang:en -is:retweet", start_time=start_time, end_time=end_time, max_results=10)

Get just 1 page of results instead of iterating over everything in search_results:for page in itertools.islice(search_results, 1):
for tweet in flatten(page)['data']:
    # Do something with the tweet
    print(tweet)
If you run that same way as the test_api.py earlier it should also work - or fail with a descriptive error.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/DocNow/twarc/issues/441#issuecomment-831899575, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATRWO6BIB6LBW2FPEXLWAXDTL7RGLANCNFSM43M324CA .

-- Kingsley Oladayo Ogunne

Department of Corporate Services Obafemi Awolowo University Teaching Hospitals Complex P.M.B. 5538 Ile-Ife, Nigeria

Telephone: +2348088444325, +2349050054242

So the code works, but the command line does not?

You could keep working with the code example and avoid the command line I guess. But that may be cumbersome.

I don't have any idea why running the command line would give you an error 400 but running the code would succeed, apart from something specific to your PC, like a firewall or antivirus allowing python.exe interfering with twarc2.exe. That's what i would investigate.

Yeah, a 400 error from the API is documented as:

The request was invalid or cannot be otherwise served. An accompanying error message will explain further. Requests without authentication or with invalid query parameters are considered invalid and will yield this response.

and then suggest:

Double check the format of your JSON query. For example, if your rule contains double-quote characters associated with an exact-match or other operator, you may need to escape them using a backslash to distinguish them from the structure of the JSON format.

But we're not actually sending any JSON as part of the search/recent API call it's just a GET. I guess if we set logging.level to DEBUG we might get some underlying information from requests/urllib3? --log-level might actually be a nice option to have...

But I agree @igorbrigadir it seems like something is interfering with the execution of twarc2.exe? I don't know how feasible it is, but it might be nice to be able to run twarc2 like this:

python -m twarc.command2 search ...

This is a special appreciation to you both for your constant support and perseverance. I am so glad to inform you that my twarc2 now works and generates data. I can't thank you enough sirs, as all your responses were useful. I sincerely appreciate your patience. For the records, I think the improper configuration of the twarc2 (in addition to the twarc configuration) contributed to the reasons for getting those errors.

I will begin to work on twarc2 for my archival data collection now. I will be so glad if you would come to my rescue if problems arise.

Thank you once again for the support.

On Wed, May 5, 2021 at 6:32 PM Ed Summers @.***> wrote:

Yeah, a 400 error from the API is documented https://developer.twitter.com/en/support/twitter-api/error-troubleshooting#http-status-codes as:

The request was invalid or cannot be otherwise served. An accompanying error message will explain further. Requests without authentication or with invalid query parameters are considered invalid and will yield this response.

and then suggest:

Double check the format of your JSON query. For example, if your rule contains double-quote characters associated with an exact-match or other operator, you may need to escape them using a backslash to distinguish them from the structure of the JSON format.

But we're not actually sending any JSON as part of the search/recent API call it's just a GET. I guess if we set logging.level to DEBUG we might get some underlying information https://stackoverflow.com/questions/16337511/log-all-requests-from-the-python-requests-module from requests/urllib3? --log-level might actually be a nice option to have...

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/DocNow/twarc/issues/441#issuecomment-832876616, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATRWO6HBBPD7HMHPABYHBIDTMF6KJANCNFSM43M324CA .

-- Kingsley Oladayo Ogunne

Department of Corporate Services Obafemi Awolowo University Teaching Hospitals Complex P.M.B. 5538 Ile-Ife, Nigeria

Telephone: +2348088444325, +2349050054242

@osemele that is awesome news! Do you know what you did to fix it? It would be useful for us to know if this situation ever arises again.

Yes, I think all this while I never knew I didn't configure my twarc2 properly. First, I thought since I had configured twarc, that that would suffice for twarc2 Second, the error messages I was getting on twarc2 were not pointing towards issues of none/poor configuration. It never directly mentioned authorization as a problem, hence, my attention never went to configuration problems. Again, whenever I made attempts to configure my twarc2, it never displayed the bearer token, API secret and token secret on my screen while pasting it. So in most cases, I abruptly discontinued the process until I read somewhere that not displaying such secret keys and tokens was the normal process of configuring twarc2.

I think those getting similar errors to mine, especially when the python environment has properly been created should also look into their twarc2 configuration specifically.

Thank you once again.

On Fri, May 7, 2021 at 12:18 PM Ed Summers @.***> wrote:

@osemele https://github.com/osemele that is awesome news! Do you know what you did to fix it? It would be useful for us to know if this situation ever arises again.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/DocNow/twarc/issues/441#issuecomment-834281033, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATRWO6DVW5GJDOCLKPQUYZ3TMPEALANCNFSM43M324CA .

-- Kingsley Oladayo Ogunne

Department of Corporate Services Obafemi Awolowo University Teaching Hospitals Complex P.M.B. 5538 Ile-Ife, Nigeria

Telephone: +2348088444325, +2349050054242

That's very helpful thanks @osemele . We will test running twarc2 search without having run twarc2 configure first on Windows.

Maybe we could try and read the old twarc config file if it exists to auto configure twarc2?

Yeah, that would be nice if it wasn't too tricky. Do the old stand-alone apps have access to the Twitter v2 API? I guess it is confusing for someone might concurrently use twarc and twarc2. I wanted to update twarc2 to allow for "profiles" like twarc.

Do the old stand-alone apps have access to the Twitter v2 API?

Not by default, but, the same keys work for both v1.1 and v2, if the app is set up in a Project on the dashboard - https://developer.twitter.com/en/portal/projects-and-apps so we could link that in a "warning" when loading configs this way maybe?

"Profiles" sound like a good feature for sure.

Do you find my suggestion on configuring twarc2 separately to avoid error useful?

On Mon, May 10, 2021, 11:39 AM Igor Brigadir @.***> wrote:

Do the old stand-alone apps have access to the Twitter v2 API?

Not by default, but, the same keys work for both v1.1 and v2, if the app is set up in a Project on the dashboard - https://developer.twitter.com/en/portal/projects-and-apps so we could link that in a "warning" when loading configs this way maybe?

"Profiles" sound like a good feature for sure.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/DocNow/twarc/issues/441#issuecomment-836536018, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATRWO6ADVWNB5KTUBIH2N5LTM6ZXHANCNFSM43M324CA .

Yes very! Thanks again for digging in with the debugging!

This also has me wondering if the input should actually display the keys on the console. It seems to be causing some confusion.

It's not really clear to me that the configuration was actually the root of the problem here. We are seeing the AVG firewall issue coming up in #469 as well.

DocNow / twarc

twarc2 search without configure on Windows throws JSON parse error #441

EndS…","possibly_sensitive":false,"lang":"en","context_annotations":[{"domain":{"id":"46","name":"Brand

FixTheCountry.

wizkidfc","verified":false,"pinned_tweet_id":"1379373013418835968","url":"","protected":false,"profile_image_url":"

IPOB","verified":false,"pinned_tweet_id":"924542533593649153","url":"","protected":false,"profile_image_url":"

endracism #BLM #climateactionnow

stopcensorship","verified":false,"url":"","protected":false,"profile_image_url":"

Bananenrepublik™ #Schokoladenfabrik™ #666000666 Yotabyte™ #BVG™ #BSR™

RsR™ ❤️","verified":false,"pinned_tweet_id":"1389227772439146500","url":"

Coder","verified":false,"pinned_tweet_id":"1384780512791781376","url":"

ClimateChange #cinemastrikesback #P1 #Influencer #AutismAcceptanceMonth

BTC #BlackLivesMatter #California #BMAS_Bund

ForaFutureDancefloor\uD83D\uDC83\uD83C\uDFFB #EndSARS

Your bearer token heret = Twarc2(bearer_token="A...z")

Start and end times must be in UTCstart_time = datetime.datetime(2006, 3, 21, 0, 0, 0, 0, datetime.timezone.utc)end_time = datetime.datetime(2021, 4, 27, 0, 0, 0, 0, datetime.timezone.utc)

search_results is a generator, max_results is max tweets per page, 500 max for full archive search.search_results = t.search_all(query="dogs lang:en -is:retweet", start_time=start_time, end_time=end_time, max_results=10)

Get just 1 page of results instead of iterating over everything in search_results:for page in itertools.islice(search_results, 1):