search

ropensci / rtweet

🐦 R client for interacting with Twitter's [stream and REST] APIs
https://docs.ropensci.org/rtweet
Other
785 stars 201 forks source link

`search_tweets` returning fewer columns since today (11/03) #747

Closed jcrodriguez1989 closed 1 year ago

jcrodriguez1989 commented 1 year ago

Problem

search_tweets returning fewer columns since today (11/03) Some columns seem to have disappeared from the returned object, like: is_retweet, screen_name, reply_to_screen_name, status_id, status_url.

Expected behavior

Reproduce the problem

> search_tweets("(rstat OR rstats)", type = "recent", include_rts = FALSE) |> dplyr::glimpse()
Rows: 96
Columns: 43
$ created_at                    <dttm> 2022-11-03 21:02:45, 2022-11-03 20:58:06, 2022-11-03 20:46:37, 2022-11-03 20:45:28,…
$ id                            <dbl> 1.588321e+18, 1.588320e+18, 1.588317e+18, 1.588316e+18, 1.588315e+18, 1.588315e+18, …
$ id_str                        <chr> "1588320811873886208", "1588319641272999936", "1588316751736946688", "15883164614369…
$ full_text                     <chr> "@SMAS presents the Annual Statistical Science Lecture on Thurs17Nov22 @UOW given by…
$ truncated                     <lgl> FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, …
$ display_text_range            <dbl> 227, 211, 227, 245, 269, 26, 268, 76, 111, 225, 267, 270, 264, 95, 276, 275, 274, 98…
$ entities                      <list> [[<data.frame[4 x 2]>], [<data.frame[1 x 2]>], [<data.frame[2 x 5]>], [<data.frame[…
$ metadata                      <list> [<data.frame[1 x 2]>], [<data.frame[1 x 2]>], [<data.frame[1 x 2]>], [<data.frame[1…
$ source                        <chr> "<a href=\"https://mobile.twitter.com\" rel=\"nofollow\">Twitter Web App</a>", "<a h…
$ in_reply_to_status_id         <dbl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, 1.588304e+18, NA, NA, NA, NA, NA…
$ in_reply_to_status_id_str     <chr> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, "1588304374417489920", NA, NA, N…
$ in_reply_to_user_id           <dbl> 1.769165e+07, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, 1.218834e+07, NA, NA, …
$ in_reply_to_user_id_str       <chr> "17691648", NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, "12188342", NA, NA, "121…
$ in_reply_to_screen_name       <chr> "smas", NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, "Mike_Kaminsky", NA, NA, "Mi…
$ geo                           <list> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA,…
$ coordinates                   <list> [<data.frame[1 x 3]>], [<data.frame[1 x 3]>], [<data.frame[1 x 3]>], [<data.frame[1…
$ place                         <list> [<data.frame[1 x 3]>], [<data.frame[1 x 3]>], [<data.frame[1 x 3]>], [<data.frame[1…
$ contributors                  <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ is_quote_status               <lgl> FALSE, FALSE, FALSE, FALSE, FALSE, TRUE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, F…
$ retweet_count                 <int> 1, 1, 4, 3, 1, 2, 3, 1, 1, 1, 0, 2, 8, 1, 2, 4, 1, 2, 3, 5, 4, 1, 7, 17, 10, 3, 0, 1…
$ favorite_count                <int> 0, 2, 4, 1, 0, 1, 8, 0, 0, 0, 1, 8, 7, 0, 4, 4, 4, 1, 1, 1, 2, 0, 8, 17, 15, 2, 0, 0…
$ favorited                     <lgl> FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, …
$ retweeted                     <lgl> FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, …
$ possibly_sensitive            <lgl> FALSE, NA, NA, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE, FALSE,…
$ lang                          <chr> "en", "en", "en", "en", "en", "en", "en", "en", "en", "en", "es", "en", "en", "en", …
$ quoted_status_id              <dbl> NA, NA, NA, NA, NA, 1.588304e+18, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, 1.588304e+…
$ quoted_status_id_str          <chr> NA, NA, NA, NA, NA, "1588304242863144960", NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, "…
$ quoted_status                 <list> [<data.frame[1 x 27]>], [<data.frame[1 x 27]>], [<data.frame[1 x 27]>], [<data.fram…
$ text                          <chr> "@SMAS presents the Annual Statistical Science Lecture on Thurs17Nov22 @UOW given by…
$ favorited_by                  <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ scopes                        <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ display_text_width            <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ retweeted_status              <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ quoted_status_permalink       <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ quote_count                   <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ timestamp_ms                  <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ reply_count                   <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ filter_level                  <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ query                         <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ withheld_scope                <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ withheld_copyright            <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ withheld_in_countries         <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
$ possibly_sensitive_appealable <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …

rtweet version

packageVersion("rtweet")
[1] ‘1.0.2’

Session info

sessionInfo()
R version 4.2.1 (2022-06-23)
Platform: x86_64-apple-darwin17.0 (64-bit)
Running under: macOS Monterey 12.6

Matrix products: default
LAPACK: /Library/Frameworks/R.framework/Versions/4.2/Resources/lib/libRlapack.dylib

locale:
[1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
[1] stringr_1.4.1       dplyr_1.0.10        rtweet_1.0.2        RStatsJobsBot_0.1.0

loaded via a namespace (and not attached):
 [1] rstudioapi_0.14   magrittr_2.0.3    hms_1.1.2         progress_1.2.2    bit_4.0.4         tidyselect_1.1.2 
 [7] R6_2.5.1          rlang_1.0.6       fansi_1.0.3       httr_1.4.3        tools_4.2.1       utf8_1.2.2       
[13] cli_3.4.1         withr_2.5.0       askpass_1.1       ellipsis_0.3.2    bit64_4.0.5       openssl_2.0.2    
[19] tibble_3.1.8      lifecycle_1.0.2   crayon_1.5.2      purrr_0.3.4       vctrs_0.4.2       curl_4.3.2       
[25] glue_1.6.2        stringi_1.7.8     compiler_4.2.1    pillar_1.8.1      generics_0.1.3    prettyunits_1.1.1
[31] jsonlite_1.8.0    pkgconfig_2.0.3
llrs commented 1 year ago

Some of the fields you mention were removed since the release of 1.0.2. Have you updated the package?

You might benefit from reading this post about the changes in this version.

jcrodriguez1989 commented 1 year ago

This is perfect, thanks! And sorry for not finding that post before submitting the issue.