[Bug]: Can't open log file when track_values = TRUE, arguments imply differing number of rows

[zilch42]

Guidelines

• [X] I agree to follow this project's Contributing Guidelines.

Project Version

0.1.0.9001

Platform and OS Version

Windows 10

Existing Issues

No response

What happened?

After producing a log file using shiny.telemetry and track_values = TRUE, I get an error trying to open it either with analytics_app() or just with read_event_data().

This is the error from shiny.telemetry::analytics_app(shiny.telemetry::DataStorageLogFile$new(log_file_path = "logs/telemetry.txt"))

Listening on http://127.0.0.1:3240
Warning: Error in <Anonymous>: arguments imply differing number of rows: 1, 0, 4
[No stack trace available]
Warning: Error in <Anonymous>: arguments imply differing number of rows: 1, 0, 4
51: <Anonymous>
  Warning: Error in <Anonymous>: arguments imply differing number of rows: 1, 0, 4
187: <Anonymous>

Steps to reproduce

I haven't been able to reproduce this with a simple app. My app is quite complex, uses golem, shiny.router, shiny.fluent, and reactiveValues(), but it does seem to only happen when I use track_values = TRUE (which is exactly what I want). It creates a valid log file with track_values = FALSE. I'm hoping by sharing the log file you may be able to see what has gone on. The contents of the log file are in the attachments section.

Expected behavior

The logfile can be read

Attachments

{"app_name":["(dashboard)"],"type":["login"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"username\":{}}"],"time":[1692083026.2943]} {"app_name":["(dashboard)"],"type":["browser"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"value\":[\"Firefox 102\"]}"],"time":[1692083028.9013]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"control_panel-aggregationchoice\"],\"value\":{}}"],"time":[1692083028.9233]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"control_panel-agfilter\"],\"value\":{}}"],"time":[1692083028.9323]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_epublish-modal_publicationsDT-selectedPublications\"],\"value\":{}}"],"time":[1692083030.1113]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_epublish-tableDownload-downloadButton\"],\"value\":{}}"],"time":[1692083030.1133]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_rise-modal_publicationsDT-allPublications\"],\"value\":{}}"],"time":[1692083030.1153]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_citation-tableDownload-downloadButton\"],\"value\":{}}"],"time":[1692083030.1173]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_home-exploremetrics\"],\"value\":{}}"],"time":[1692083030.1193]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_subjects-pick_subject_WoSCat\"],\"value\":{}}"],"time":[1692083030.1223]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"nav--render_finished\"],\"value\":[\"1692083029161\"]}"],"time":[1692083030.1243]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"login-my_input_for_catching_render\"],\"value\":[\"1692083029189\"]}"],"time":[1692083030.1263]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_rise-modal_publicationsDT-selectedPublications\"],\"value\":{}}"],"time":[1692083030.1293]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_prestigepubs-modal_publicationsDT-selectedPublications\"],\"value\":{}}"],"time":[1692083030.1323]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_citation-modal_publicationsDT-selectedPublications\"],\"value\":{}}"],"time":[1692083030.1343]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_collaboration-tableDownload-downloadButton\"],\"value\":{}}"],"time":[1692083030.1373]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"header-openFilters\"],\"value\":{}}"],"time":[1692083030.1423]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_wos-modal_publicationsDT-allPublications\"],\"value\":{}}"],"time":[1692083030.1443]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_rise-showPeers\"],\"value\":{}}"],"time":[1692083030.1463]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_wos-tableDownload-downloadButton\"],\"value\":{}}"],"time":[1692083030.1483]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_partners-tableDownload-downloadButton\"],\"value\":{}}"],"time":[1692083030.1503]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_partners-modal_publicationsDT-selectedPublications\"],\"value\":{}}"],"time":[1692083030.1513]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_subjects-modal_publicationsDT-allPublications\"],\"value\":{}}"],"time":[1692083030.1533]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_subjects-tableDownload-downloadButton\"],\"value\":{}}"],"time":[1692083030.1563]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_prestigepubs-modal_publicationsDT-allPublications\"],\"value\":{}}"],"time":[1692083030.1583]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"header-browser\"],\"value\":[0]}"],"time":[1692083030.1613]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_collaboration-modal_publicationsDT-selectedPublications\"],\"value\":{}}"],"time":[1692083030.1643]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_collaboration-modal_publicationsDT-allPublications\"],\"value\":{}}"],"time":[1692083030.1663]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_citation-modal_publicationsDT-allPublications\"],\"value\":{}}"],"time":[1692083030.1693]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_wos-modal_publicationsDT-selectedPublications\"],\"value\":{}}"],"time":[1692083030.1713]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"footer-disclaimer\"],\"value\":{}}"],"time":[1692083030.1733]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"header-changeBU\"],\"value\":{}}"],"time":[1692083030.1743]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_prestigepubs-tableDownload-downloadButton\"],\"value\":{}}"],"time":[1692083030.1773]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_rise-tableDownload-downloadButton\"],\"value\":{}}"],"time":[1692083030.1803]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_subjects-modal_publicationsDT-selectedPublications\"],\"value\":{}}"],"time":[1692083030.1823]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_home-readinformation\"],\"value\":{}}"],"time":[1692083030.1843]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_subjects-pick_subject_ESICat\"],\"value\":{}}"],"time":[1692083030.1863]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_partners-modal_publicationsDT-allPublications\"],\"value\":{}}"],"time":[1692083030.1883]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_epublish-modal_publicationsDT-allPublications\"],\"value\":{}}"],"time":[1692083030.1913]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"header-changeBU\"],\"value\":[1]}"],"time":[1692083033.4642]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"header-thisBU\"],\"value\":{}}"],"time":[1692083033.5332]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"header-startTour\"],\"value\":{}}"],"time":[1692083033.5372]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"header-letMeIn\"],\"value\":{}}"],"time":[1692083033.5402]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"header-thisBU\"],\"value\":[\"Manufacturing\"]}"],"time":[1692083034.8873]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"header-letMeIn\"],\"value\":[1]}"],"time":[1692083036.4623]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"control_panel-showPanel\"],\"value\":[0.3355]}"],"time":[1692083038.9451]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"control_panel-savebutton\"],\"value\":[0.1959]}"],"time":[1692083040.6061]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"nav-changePage\"],\"value\":[0.0402]}"],"time":[1692083041.8443]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_wos-main_table-DT_cells_selected\"],\"value\":[]}"],"time":[1692083043.8898]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_wos-main_table-DT_cell_clicked\"],\"value\":{}}"],"time":[1692083043.8918]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_wos-main_table-DT_rows_current\"],\"value\":{}}"],"time":[1692083043.8958]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_wos-main_table-DT_rows_all\"],\"value\":{}}"],"time":[1692083043.8998]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_wos-main_table-DT_columns_selected\"],\"value\":{}}"],"time":[1692083043.9038]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_wos-main_table-DT_rows_selected\"],\"value\":{}}"],"time":[1692083043.9088]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_wos-main_table-DT_search\"],\"value\":[\"\"]}"],"time":[1692083043.9128]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_wos-main_table-DT_state\"],\"value\":{}}"],"time":[1692083043.9158]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_wos-main_table-DT_rows_current\"],\"value\":[1,2,3,4,5,6,7,8,9,10,11,12,13,14]}"],"time":[1692083046.3723]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_wos-main_table-DT_rows_all\"],\"value\":[1,2,3,4,5,6,7,8,9,10,11,12,13,14]}"],"time":[1692083046.3763]} {"app_name":["(dashboard)"],"type":["input"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"id\":[\"page_wos-main_table-DT_state\"],\"value\":{\"time\":[1692083043893],\"start\":[0],\"length\":[25],\"order\":[],\"search\":{\"search\":[\"\"],\"smart\":[true],\"regex\":[false],\"caseInsensitive\":[true]},\"columns\":[{\"visible\":[true],\"search\":{\"search\":[\"\"],\"smart\":[true],\"regex\":[false],\"caseInsensitive\":[true]}},{\"visible\":[true],\"search\":{\"search\":[\"\"],\"smart\":[true],\"regex\":[false],\"caseInsensitive\":[true]}},{\"visible\":[true],\"search\":{\"search\":[\"\"],\"smart\":[true],\"regex\":[false],\"caseInsensitive\":[true]}},{\"visible\":[true],\"search\":{\"search\":[\"\"],\"smart\":[true],\"regex\":[false],\"caseInsensitive\":[true]}}]}}"],"time":[1692083046.3813]} {"app_name":["(dashboard)"],"type":["logout"],"session":["1237370724a89e6cc8db48e197e57e7b"],"details":["{\"username\":{}}"],"time":[1692083053.1754]}

Screenshots or Videos

No response

Additional Information

Outside server function:

telemetry <- shiny.telemetry::Telemetry$new(
  data_storage = shiny.telemetry::DataStorageLogFile$new(
    log_file_path = paste0(get_golem_config("log_location"), "telemetry.txt")))

Inside Server Function: telemetry$start_session(track_values = TRUE)

Inside UI: use_telemetry()

[zilch42]

I think it may be due to DT. It looks like all of the settings for a DT::datatable() are being captured within an input value and the format of that messes with the format of the log file

[zilch42]

Further to this, I have got around it by using track_values = FALSE and manually logging the inputs that I'm interested in. If the intention is for track_values = TRUE to be able to handle any input values from common packages then I suggest this is a bug; however, if the intention is to say 'you can try tracking all input values automatically, but some inputs are too complex for shiny.telemetry to handle so you may need to use manual value tracking if it doesn't work', then I suggest this just needs to be reflected in the documentation.

[averissimo]

Thanks for reporting this. See PR #133 to track the solution

It seems a problem when converting fields that were saved by your inputs to a data.frame.

Some of those fields have length(x) > 1 and were creating a bunch of rows and {shiny.telemetry} was smart enough to detect this problem.

I've created a fix that will handle this gracefully on #133 that will revert these fields back to JSON (i.e. if it's a vector, list, etc...).

This should only affect the analytics apps as the data-storage backends are not affected with the fixes.

[zilch42]

Awesome thank you