cjbarrie / academictwitteR

Repo for academictwitteR package to query the Twitter Academic Research Product Track v2 API endpoint.
Other
272 stars 59 forks source link

[BUG] <title> #318

Closed jqb101 closed 2 years ago

jqb101 commented 2 years ago

Please confirm the following

Describe the bug

I've been trying to pull tweets from several media companies during the Obama years for a research project. The get all tweets command has worked well but something strange as occured. The pull drops all tweets from 1AUG09-31AUG2010. I've tried multiple forms of the pull temp<- get_all_tweets(users = media_tweets_usernames[i], start_tweets = media_tweets_start_date[i],end_tweets = media_tweets_end_date[i], bearer_token = get_bearer(),is_retweet=FALSE, is_reply=FALSE,n = 750000)

It's very strange because the pull works for everything but this period. Any advice would be helpful.

The usernames I'm using are: washingtonpost nytimes WSJ FoxNews bbcworld FT Huffpost CNN thedailybeast msnbc newsweek slate voxdotcom AP theatlantic business ABC CBSNews TheEconomist guardian NBCNews NPR politico propublica Time YahooNews USAToday Reuters axios Diplomat_APAC nypost DailyCaller FDRLST AJEnglish XHNews Japantimes BBCNewsAus

Expected Behavior

should pull tweets for the entire period but drops AUG09-AUG10

Steps To Reproduce

           temp<- get_all_tweets(users = media_tweets_usernames[i], start_tweets = media_tweets_start_date[i],end_tweets = media_tweets_end_date[i],     bearer_token = get_bearer(),is_retweet=FALSE, is_reply=FALSE,n = 750000)

where media_tweets_usernames is the list of users above and start end dates are 1/20/09 through 1/20/2017 (in the proper format).

Environment

sessionInfo() R version 4.1.2 (2021-11-01) Platform: x86_64-w64-mingw32/x64 (64-bit) Running under: Windows 10 x64 (build 22000)

Matrix products: default

locale: [1] LC_COLLATE=English_United States.1252 LC_CTYPE=English_United States.1252 LC_MONETARY=English_United States.1252 LC_NUMERIC=C
[5] LC_TIME=English_United States.1252
system code page: 65001

attached base packages: [1] stats graphics grDevices utils datasets methods base

other attached packages: [1] rvest_1.0.2 scales_1.1.1 plotly_4.10.0 ggbeeswarm_0.6.0 ggalt_0.4.0 hrbrthemes_0.8.0 forcats_0.5.1
[8] RCurl_1.98-1.5 dplyr_1.0.7 Rfacebook_0.6.15 httpuv_1.6.5 tidyr_1.1.4 zoo_1.8-9 data.table_1.14.2
[15] stringi_1.7.6 servr_0.24 LDAvis_0.3.2 topicmodels_0.2-12 lubridate_1.8.0 devtools_2.4.3 usethis_2.1.5
[22] tibble_3.1.6 academictwitteR_0.3.1 twitteR_1.1.9 rtweet_0.7.0 httr_1.4.2 plyr_1.8.6 vroom_1.5.7
[29] pdftools_3.0.1 jsonlite_1.7.3 rjson_0.2.21 tidytext_0.3.2 stringr_1.4.0 ggplot2_3.3.5 syuzhet_1.0.6
[36] wordcloud_2.6 RColorBrewer_1.1-2 SnowballC_0.7.0 tm_0.7-8 NLP_0.2-1 quanteda.textstats_0.95 quanteda.textplots_0.94 [43] readtext_0.81 quanteda_3.2.0

loaded via a namespace (and not attached): [1] colorspace_2.0-2 ellipsis_0.3.2 modeltools_0.2-23 rprojroot_2.0.2 fs_1.5.2 rstudioapi_0.13 remotes_2.4.2 bit64_4.0.5 fansi_1.0.2
[10] xml2_1.3.3 extrafont_0.17 cachem_1.0.6 knitr_1.37 pkgload_1.2.4 Rttf2pt1_1.3.9 compiler_4.1.2 lazyeval_0.2.2 assertthat_0.2.1
[19] Matrix_1.3-4 fastmap_1.1.0 cli_3.1.1 later_1.3.0 htmltools_0.5.2 prettyunits_1.1.1 tools_4.1.2 gtable_0.3.0 glue_1.6.0
[28] maps_3.4.0 fastmatch_1.1-3 Rcpp_1.0.8 slam_0.1-50 vctrs_0.3.8 extrafontdb_1.0 xfun_0.29 stopwords_2.3 ps_1.6.0
[37] brio_1.1.3 testthat_3.1.2 nsyllable_1.0 lifecycle_1.0.1 MASS_7.3-54 promises_1.2.0.1 proj4_1.0-11 parallel_4.1.2 curl_4.3.2
[46] yaml_2.2.2 memoise_2.0.1 gdtools_0.2.4 tokenizers_0.2.1 desc_1.4.0 pkgbuild_1.3.1 systemfonts_1.0.4 rlang_0.4.12 pkgconfig_2.0.3
[55] bitops_1.0-7 evaluate_0.14 lattice_0.20-45 purrr_0.3.4 htmlwidgets_1.5.4 bit_4.0.4 processx_3.5.2 tidyselect_1.1.1 magrittr_2.0.1
[64] R6_2.5.1 generics_0.1.1 DBI_1.1.2 pillar_1.6.5 withr_2.4.3 ash_1.0-15 janeaustenr_0.1.5 crayon_1.4.2 KernSmooth_2.23-20 [73] utf8_1.2.2 tzdb_0.2.0 rmarkdown_2.11 grid_4.1.2 qpdf_1.1 callr_3.7.0 digest_0.6.29 openssl_1.4.6 RcppParallel_5.1.5 [82] stats4_4.1.2 munsell_0.5.0 viridisLite_0.4.0 beeswarm_0.4.0 vipor_0.4.5 sessioninfo_1.2.2 askpass_1.1

Anything else?

No response