search

OpenAdaptAI / OpenAdapt

Open Source Generative Process Automation (i.e. Generative RPA). AI-First Process Automation with Large ([Language (LLMs) / Action (LAMs) / Multimodal (LMMs)] / Visual Language (VLMs)) Models
https://www.OpenAdapt.AI
MIT License
1k stars 138 forks source link

[Bug]: `QWindowsContext: OleInitialize() failed` error on running: `python -m openadapt.app.visualize` #862

Open KrishPatel13 opened 4 months ago

KrishPatel13 commented 4 months ago

Describe the bug

(.venv) PS P:\OpenAdapt> python -m openadapt.app.visualize
2024-07-21 11:25:44.667 | INFO     | openadapt.events:get_events:74 - num_process_iters=0 num_action_events=2600 num_window_events=1 num_screenshots=179
2024-07-21 11:25:44.669 | INFO     | openadapt.events:process_events:825 - before num_action_events=2600 num_window_events=1 num_screenshots=179 num_total=2780
2024-07-21 11:25:44.710 | INFO     | openadapt.events:merge_consecutive_action_events:757 - name='redundant_mouse_move' num_events_removed=66
2024-07-21 11:25:44.733 | INFO     | openadapt.events:get_group_idx_tups:529 - len(to_merge)=10 group_idx_tups=[(0, 8), (8, 10)]
2024-07-21 11:25:44.977 | INFO     | openadapt.events:get_group_idx_tups:529 - len(to_merge)=38 group_idx_tups=[(0, 8), (8, 10), (10, 22), (22, 24), (24, 28), (28, 31), (31, 34), (34, 36), (36, 38)]
2024-07-21 11:25:44.999 | INFO     | openadapt.events:get_group_idx_tups:529 - len(to_merge)=18 group_idx_tups=[(0, 2), (2, 6), (6, 8), (8, 10), (10, 12), (12, 14), (14, 16), (16, 18)]
2024-07-21 11:25:45.048 | INFO     | openadapt.events:merge_consecutive_action_events:757 - name='keyboard' num_events_removed=47
2024-07-21 11:25:45.069 | INFO     | openadapt.events:merge_consecutive_action_events:757 - name='mouse_move' num_events_removed=2415
2024-07-21 11:25:45.069 | INFO     | openadapt.events:merge_consecutive_action_events:757 - name='mouse_scroll' num_events_removed=0
2024-07-21 11:25:45.072 | INFO     | openadapt.events:merge_consecutive_action_events:757 - name='mouse_click' num_events_removed=14
2024-07-21 11:25:45.072 | INFO     | openadapt.events:process_events:873 - after num_action_events_=58 num_window_events_=1 num_screenshots_=52 num_total_=111
2024-07-21 11:25:45.072 | INFO     | openadapt.events:process_events:877 - pct_action_events=0.022307692307692306 pct_window_events=1.0 pct_screenshots=0.2905027932960894 pct_total=0.039928057553956835
2024-07-21 11:25:45.073 | INFO     | openadapt.events:get_events:127 - duration=2.549567461013794
2024-07-21 11:25:45.386 | INFO     | __main__:main:154 - event_dicts=
[{'children': [{'id': 243,
                'mouse_x': 1257,
                'mouse_y': 652,
                'screenshot_id': 11,
                'screenshot_timestamp': 1721569972.3549984,
                'timestamp': 1721569972.3864052},
               {'id': 244,
                'mouse_x': 1254,
                'mouse_y': 652,
                'screenshot_id': 11,
                'screenshot_timestamp': 1721569972.3549984,
                'timestamp': 1721569972.3908093},
               {'id': 245,
                'mouse_x': 1245,
                'mouse_y': 653,
                'screenshot_id': 11,
                'screenshot_timestamp': 1721569972.3549984,
                'timestamp': 1721569972.40064},
               {'id': 246,
                'mouse_x': 1242,
                'mouse_y': 653,
                'screenshot_id': 11,
                'screenshot_timestamp': 1721569972.3549984,
                'timestamp': 1721569972.4023662},
               {'id': 247,
                'mouse_x': 1239,
                'mouse_y': 653,
                'screenshot_id': 11,
                'screenshot_timestamp': 1721569972.3549984,
                'timestamp': 1721569972.4231231},
               {'id': 248,
                'mouse_x': 1232,
                'mouse_y': 653,
                'screenshot_id': 11,
                'screenshot_timestamp': 1721569972.3549984,
                'timestamp': 1721569972.4339736},
               {'id': 249,
                'mouse_x': 1232,
                'mouse_y': 652,
                'screenshot_id': 12,
                'screenshot_timestamp': 1721569975.5022848,
                'timestamp': 1721569975.5144775},
               {'id': 250,
                'mouse_x': 1234,
                'mouse_y': 645,
                'screenshot_id': 12,
                'screenshot_timestamp': 1721569975.5022848,
                'timestamp': 1721569975.5282133},
               {'id': 251,
                'mouse_x': 1272,
                'mouse_y': 583,
                'screenshot_id': 12,
                'screenshot_timestamp': 1721569975.5022848,
                'timestamp': 1721569975.5507956},
               {'id': 252,
                'mouse_x': 1275,
                'mouse_y': 575,
                'screenshot_id': 12,
                'screenshot_timestamp': 1721569975.5022848,
                'timestamp': 1721569975.5543833},
               {'id': 253,
                'mouse_x': 1279,
                'mouse_y': 567,
                'screenshot_id': 12,
                'screenshot_timestamp': 1721569975.5022848,
                'timestamp': 1721569975.5824442},
               {'id': 254,
                'mouse_x': 1291,
                'mouse_y': 559,
                'screenshot_id': 12,
                'screenshot_timestamp': 1721569975.5022848,
                'timestamp': 1721569975.5831692},
               {'children': [{'id': 255,
                              'screenshot_id': 12,
                              'screenshot_timestamp': 1721569975.5022848,
                              'timestamp': 1721569975.586228},
                             {'id': 256,
                              'screenshot_id': 13,
                              'screenshot_timestamp': 1721569995.8832257,
                              'timestamp': 1721569995.9327462}],
                'id': 257,
                'mouse_x': 1290,
                'mouse_y': 559,
                'screenshot_id': 13,
                'screenshot_timestamp': 1721569995.8832257,
                'timestamp': 1721569975.6031942},
               {'id': 258,
                'mouse_x': 1289,
                'mouse_y': 555,
                'screenshot_id': 13,
                'screenshot_timestamp': 1721569995.8832257,
                'timestamp': 1721569975.6038504},
               {'id': 259,
                'mouse_x': 1289,
                'mouse_y': 554,
                'screenshot_id': 13,
                'screenshot_timestamp': 1721569995.8832257,
                'timestamp': 1721569975.6065505},
               {'id': 260,
                'mouse_x': 1289,
                'mouse_y': 552,
                'screenshot_id': 13,
                'screenshot_timestamp': 1721569995.8832257,
                'timestamp': 1721569975.6224337},
               {'id': 261,
                'mouse_x': 1289,
                'mouse_y': 549,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.625444},
               {'id': 262,
                'mouse_x': 1289,
                'mouse_y': 550,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.6386862},
               {'children': [{'id': 263, 'timestamp': 1721569995.9923966},
                             {'id': 264, 'timestamp': 1721569996.0092666}],
                'id': 265,
                'mouse_x': 1287,
                'mouse_y': 557,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.640003},
               {'id': 266,
                'mouse_x': 1286,
                'mouse_y': 558,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.6418583},
               {'id': 267,
                'mouse_x': 1284,
                'mouse_y': 561,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.6455777},
               {'id': 268,
                'mouse_x': 1281,
                'mouse_y': 565,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.6496458},
               {'id': 269,
                'mouse_x': 1278,
                'mouse_y': 568,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.6545453},
               {'id': 270,
                'mouse_x': 1274,
                'mouse_y': 576,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.657772},
               {'id': 271,
                'mouse_x': 1272,
                'mouse_y': 581,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.6616013},
               {'id': 272,
                'mouse_x': 1270,
                'mouse_y': 588,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.6656053},
               {'id': 273,
                'mouse_x': 1268,
                'mouse_y': 594,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.6695735},
               {'id': 274,
                'mouse_x': 1267,
                'mouse_y': 599,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.6741111},
               {'id': 275,
                'mouse_x': 1267,
                'mouse_y': 606,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.6818907},
               {'id': 276,
                'mouse_x': 1263,
                'mouse_y': 614,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.6998923},
               {'id': 277,
                'mouse_x': 1247,
                'mouse_y': 663,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.7018683},
               {'id': 278,
                'mouse_x': 1240,
                'mouse_y': 680,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.7030241},
               {'id': 279,
                'mouse_x': 1233,
                'mouse_y': 694,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.7056851},
               {'id': 280,
                'mouse_x': 1228,
                'mouse_y': 705,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.7095895},
               {'id': 281,
                'mouse_x': 1226,
                'mouse_y': 715,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.715115},
               {'id': 282,
                'mouse_x': 1222,
                'mouse_y': 726,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.7177162},
               {'id': 283,
                'mouse_x': 1220,
                'mouse_y': 736,
                'screenshot_id': 14,
                'screenshot_timestamp': 1721569995.974621,
                'timestamp': 1721569975.7216306},
               {'id': 284,
                'mouse_x': 1215,
                'mouse_y': 747,
                'screenshot_id': 14,
                'screenshot_timestamp':QWindowsContext: OleInitialize() failed:  "COM error 0x80010106: Cannot change thread mode after it is set."
qt.qpa.window: SetProcessDpiAwarenessContext() failed: The operation completed successfully.
Qt's default DPI awareness context is DPI_AWARENESS_CONTEXT_PER_MONITOR_AWARE_V2. If you know what you are doing, you can overwrite this default using qt.conf (https://doc.qt.io/qt-6/highdpi.html#configuring-windows).
2024-07-21 11:25:47.482 | INFO     | __main__:main:258 - len(action_events)=58
Generating Visualization:   0%|                                                                     | 0/58 [00:00<?, ?event/s] 
--- Logging error in Loguru Handler #1 ---
Record was: None
Traceback (most recent call last):
  File "P:\OpenAdapt\.venv\lib\site-packages\loguru\_handler.py", line 272, in _queued_writer
    message = queue.get()
  File "P:\Program Files\Python310\lib\multiprocessing\queues.py", line 367, in get
    return _ForkingPickler.loads(res)
  File "av\\enum.pyx", line 130, in av.enum._unpickle
  File "av\\enum.pyx", line 58, in av.enum.EnumType.__getitem__
KeyError: 'ERRORTYPE_2'
--- End of logging error ---
(.venv) PS P:\OpenAdapt>

To Reproduce

I use Windows 11 OS.

Step 1: Setup OpenAdapt. Step 2: Record a small clip with clicking on calculator app and type 10 - 2 = operation. Then, I open chrome. And there as well I typed, 10 - 2. FInally, stop the recording. I wait for the record to finish successfully. Step 3: Run python -m openadapt.app.visualize.

abrichr commented 4 months ago

Thank you for reporting this @KrishPatel13. Can you please run poetry update av and try again?

KrishPatel13 commented 4 months ago

As per the pair-programming session between @abrichr and me,

poetry remove av
poetry add av

worked for me. The old av version was 11.0.0 and the new version was: 12.3.0

KrishPatel13 commented 4 months ago

Closing in light of: https://github.com/OpenAdaptAI/OpenAdapt/issues/862#issuecomment-2241706739.

wjs9715 commented 3 months ago

This is still happening in the macOS Sonoma. I've updated the AV library and using the latest master https://github.com/PyAV-Org/PyAV/issues/991#issuecomment-1706713466 I followed the above to fix it

abrichr commented 2 months ago

Reported by Bach Vu on Discord:

Last login: Fri Sep 20 13:53:00 on ttys000
macbook@May-tinh-xach-tay-cua-Macbook ~ % cd OpenAdapt
macbook@May-tinh-xach-tay-cua-Macbook OpenAdapt % poetry shell
Spawning shell within /Users/macbook/Library/Caches/pypoetry/virtualenvs/openadapt-o9nVgTAt-py3.10
macbook@May-tinh-xach-tay-cua-Macbook OpenAdapt % emulate bash -c '. /Users/macbook/Library/Caches/pypoetry/virtualenvs/openadapt-o9nVgTAt-py3.10/bin/activate'
(openadapt-py3.10) macbook@May-tinh-xach-tay-cua-Macbook OpenAdapt % python -m openadapt.entrypoint
2024-09-20 13:58:08.465 | INFO     | openadapt.config:print_config:417 - Reading from /Users/macbook/OpenAdapt/openadapt/data/config.json
2024-09-20 13:58:08.465 | INFO     | openadapt.config:print_config:421 - ROOT_DIR_PATH=/Users/macbook/OpenAdapt/openadapt
2024-09-20 13:58:08.465 | INFO     | openadapt.config:print_config:421 - PRIVATE_AI_API_KEY=******************Y>
2024-09-20 13:58:08.465 | INFO     | openadapt.config:print_config:421 - REPLICATE_API_TOKEN=*******************N>
2024-09-20 13:58:08.465 | INFO     | openadapt.config:print_config:421 - DEFAULT_SEGMENTATION_ADAPTER=ultralytics
2024-09-20 13:58:08.465 | INFO     | openadapt.config:print_config:421 - OPENAI_API_KEY=***************>
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - ANTHROPIC_API_KEY=******************>
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - GOOGLE_API_KEY=***************>
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - CACHE_DIR_PATH=.cache
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - CACHE_ENABLED=True
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - CACHE_VERBOSITY=0
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - DB_ECHO=False
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - ERROR_REPORTING_ENABLED=True
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - OPENAI_MODEL_NAME=gpt-3.5-turbo
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - EVENT_BUFFER_QUEUE_SIZE=100
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - RECORD_WINDOW_DATA=False
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - RECORD_READ_ACTIVE_ELEMENT_STATE=False
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - RECORD_VIDEO=True
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - RECORD_AUDIO=True
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - RECORD_BROWSER_EVENTS=False
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - RECORD_FULL_VIDEO=False
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - RECORD_IMAGES=False
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - LOG_MEMORY=False
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - REPLAY_STRIP_ELEMENT_STATE=True
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - VIDEO_ENCODING=libx264
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - VIDEO_PIXEL_FORMAT=yuv444p
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - VIDEO_DIR_PATH=/Users/macbook/OpenAdapt/openadapt/data/videos
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - STOP_SEQUENCES=[['o', 'a', '.', 's', 't', 'o', 'p'], ['ctrl', 'ctrl', 'ctrl']]
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - BROWSER_WEBSOCKET_SERVER_IP=localhost
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - BROWSER_WEBSOCKET_PORT=8765
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - BROWSER_WEBSOCKET_MAX_SIZE=4194304
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - IGNORE_WARNINGS=False
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - MAX_NUM_WARNINGS_PER_SECOND=5
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - WARNING_SUPPRESSION_PERIOD=1
2024-09-20 13:58:08.466 | INFO     | openadapt.config:print_config:421 - MESSAGES_TO_FILTER=['Cannot pickle Objective-C objects']
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - ACTION_TEXT_SEP=-
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - ACTION_TEXT_NAME_PREFIX=<
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - ACTION_TEXT_NAME_SUFFIX=>
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - PLOT_PERFORMANCE=True
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - DATABASE_FILE_PATH=/Users/macbook/OpenAdapt/openadapt/data/openadapt.db
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - APP_DARK_MODE=False
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - SCRUB_ENABLED=False
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - SCRUB_CHAR=*
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - SCRUB_LANGUAGE=en
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - SCRUB_FILL_COLOR=255
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - SCRUB_KEYS_HTML=['text', 'canonical_text', 'title', 'state', 'task_description', 'key_char', 'canonical_key_char', 'key_vk', 'children']
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - SCRUB_CONFIG_TRF={'nlp_engine_name': 'spacy', 'models': [{'lang_code': 'en', 'model_name': 'en_core_web_trf'}]}
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - SCRUB_PRESIDIO_IGNORE_ENTITIES=[]
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - VISUALIZE_DARK_MODE=False
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - VISUALIZE_RUN_NATIVELY=True
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - VISUALIZE_DENSE_TREES=True
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - VISUALIZE_ANIMATIONS=True
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - VISUALIZE_EXPAND_ALL=False
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - VISUALIZE_MAX_TABLE_CHILDREN=10
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - SAVE_SCREENSHOT_DIFF=False
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - SPACY_MODEL_NAME=en_core_web_trf
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - DASHBOARD_CLIENT_PORT=5173
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - DASHBOARD_SERVER_PORT=8080
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - SOM_SERVER_URL=<SOM_SERVER_URL>
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - UNIQUE_USER_ID=785a6a0b-4db2-4b77-a16e-41ff3354194c
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - REDIRECT_TO_ONBOARDING=False
2024-09-20 13:58:08.467 | INFO     | openadapt.config:print_config:421 - DEFAULT_ADAPTER=openai
2024-09-20 13:58:08.467 | INFO     | openadapt.error_reporting:configure_error_reporting:18 - config.ERROR_REPORTING_ENABLED=True
2024-09-20 13:58:08.480 | INFO     | openadapt.error_reporting:configure_error_reporting:26 - active_branch_name='main'
2024-09-20 13:58:08.480 | INFO     | openadapt.error_reporting:configure_error_reporting:28 - is_reporting_branch=True
DB_URL=sqlite:////Users/macbook/OpenAdapt/openadapt/data/openadapt.db
INFO  [alembic.runtime.migration] Context impl SQLiteImpl.
INFO  [alembic.runtime.migration] Will assume non-transactional DDL.

> nextjs-fastapi@0.1.0 dev
> concurrently "npm run next-dev" "npm run fastapi-dev"

[1] 
[1] > nextjs-fastapi@0.1.0 fastapi-dev
[1] > python3 -m uvicorn api.index:app --port $DASHBOARD_SERVER_PORT --reload
[1] 
[0] 
[0] > nextjs-fastapi@0.1.0 next-dev
[0] > next dev -p $DASHBOARD_CLIENT_PORT
[0] 
[1] INFO:     Will watch for changes in these directories: ['/Users/macbook/OpenAdapt/openadapt/app/dashboard']
[1] INFO:     Uvicorn running on http://127.0.0.1:8080 (Press CTRL+C to quit)
[1] INFO:     Started reloader process [78076] using WatchFiles
[0]  ⚠ Specified "rewrites" will not automatically work with "output: export". See more info here: https://nextjs.org/docs/messages/export-no-custom-routes
[0]  ⚠ Specified "rewrites" will not automatically work with "output: export". See more info here: https://nextjs.org/docs/messages/export-no-custom-routes
[0]    ▲ Next.js 14.1.4
[0]    - Local:        http://localhost:5173
[0] 
[0]  ⚠ Specified "rewrites" will not automatically work with "output: export". See more info here: https://nextjs.org/docs/messages/export-no-custom-routes
[0]  ⚠ Specified "rewrites" will not automatically work with "output: export". See more info here: https://nextjs.org/docs/messages/export-no-custom-routes
[0]  ✓ Ready in 1641ms
[1] INFO:     Started server process [78078]
[1] INFO:     Waiting for application startup.
[1] INFO:     Application startup complete.
[0]  ○ Compiling /recordings ...
[0] Browserslist: caniuse-lite is outdated. Please run:
[0]   npx update-browserslist-db@latest
[0]   Why you should do it regularly: https://github.com/browserslist/update-db#readme
[0]  ✓ Compiled /recordings in 4.7s (2342 modules)
[0]  ○ Compiling /not-found ...
2024-09-20 13:58:19.273 Python[77979:10136758] Warning: Window move completed without beginning
[0]  ✓ Compiled /favicon.ico in 2.3s (2347 modules)
[0]  ✓ Compiled (2377 modules)
2024-09-20 13:58:26.480 | INFO     | openadapt.app.tray:_replay:296 - strategy_names=['NaiveReplayStrategy', 'VisualReplayStrategy', 'SegmentReplayStrategy', 'StatefulReplayStrategy', 'VanillaReplayStrategy']
2024-09-20 13:58:30.385 | INFO     | openadapt.app.tray:_replay:398 - kwargs=
{'instructions': 'Copy all person commented in the facebook post to Notion '
                 'database'}
2024-09-20 13:58:30.397 | INFO     | openadapt.app.tray:handle_recording_signal:197 - Received signal: {'type': 'replay.starting'}
2024-09-20 13:58:31.416 | INFO     | openadapt.error_reporting:configure_error_reporting:18 - config.ERROR_REPORTING_ENABLED=True
2024-09-20 13:58:31.421 | INFO     | openadapt.error_reporting:configure_error_reporting:26 - active_branch_name='main'
2024-09-20 13:58:31.421 | INFO     | openadapt.error_reporting:configure_error_reporting:28 - is_reporting_branch=True
2024-09-20 13:58:31.981 | INFO     | openadapt.app.tray:handle_recording_signal:197 - Received signal: {'type': 'replay.started'}
2024-09-20 13:58:31.981 | INFO     | openadapt.replay:replay:71 - strategy_name='VisualReplayStrategy'
2024-09-20 13:58:35.412 | INFO     | openadapt.replay:replay:84 - strategy_class=<class 'openadapt.strategies.visual.VisualReplayStrategy'>
2024-09-20 13:58:35.921 | INFO     | openadapt.browser:add_screen_tlbr:200 - Finished processing all browser events for screen coordinates.
  0%|                                                   | 0/109 [00:00<?, ?it/s]2024-09-20 13:58:35.923 | INFO     | openadapt.browser:assign_browser_events:688 - Left Click: 88 action events, 0 browser events
2024-09-20 13:58:35.923 | INFO     | openadapt.browser:evaluate_alignment:483 - Alignment for Left Click Events
2024-09-20 13:58:35.924 | INFO     | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:35.924 | INFO     | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
2024-09-20 13:58:35.924 | INFO     | openadapt.browser:assign_browser_events:688 - Right Click: 6 action events, 0 browser events
2024-09-20 13:58:35.925 | INFO     | openadapt.browser:evaluate_alignment:483 - Alignment for Right Click Events
2024-09-20 13:58:35.925 | INFO     | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:35.925 | INFO     | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
  4%|█▌                                         | 4/109 [00:00<00:25,  4.09it/s]2024-09-20 13:58:36.900 | INFO     | openadapt.browser:assign_browser_events:688 - Key Press A: 2 action events, 0 browser events
2024-09-20 13:58:36.900 | INFO     | openadapt.browser:evaluate_alignment:483 - Alignment for Key Press A Events
2024-09-20 13:58:36.900 | INFO     | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:36.900 | INFO     | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
2024-09-20 13:58:36.935 | INFO     | openadapt.browser:assign_browser_events:688 - Key Press C: 4 action events, 0 browser events
2024-09-20 13:58:36.935 | INFO     | openadapt.browser:evaluate_alignment:483 - Alignment for Key Press C Events
2024-09-20 13:58:36.935 | INFO     | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:36.935 | INFO     | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
 20%|████████▍                                 | 22/109 [00:01<00:03, 26.07it/s]2024-09-20 13:58:37.253 | INFO     | openadapt.browser:assign_browser_events:688 - Key Press V: 6 action events, 0 browser events
2024-09-20 13:58:37.253 | INFO     | openadapt.browser:evaluate_alignment:483 - Alignment for Key Press V Events
2024-09-20 13:58:37.254 | INFO     | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:37.254 | INFO     | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
 37%|███████████████▍                          | 40/109 [00:01<00:01, 44.04it/s]2024-09-20 13:58:37.556 | INFO     | openadapt.browser:assign_browser_events:688 - Key Press CTRL: 3 action events, 0 browser events
2024-09-20 13:58:37.556 | INFO     | openadapt.browser:evaluate_alignment:483 - Alignment for Key Press CTRL Events
2024-09-20 13:58:37.556 | INFO     | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:37.556 | INFO     | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
2024-09-20 13:58:37.590 | INFO     | openadapt.browser:assign_browser_events:688 - Key Press ESC: 2 action events, 0 browser events
2024-09-20 13:58:37.590 | INFO     | openadapt.browser:evaluate_alignment:483 - Alignment for Key Press ESC Events
2024-09-20 13:58:37.590 | INFO     | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
 42%|█████████████████▋                        | 46/109 [00:01<00:01, 47.93it/s]2024-09-20 13:58:37.590 | INFO     | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
 48%|████████████████████                      | 52/109 [00:01<00:01, 50.94it/s]2024-09-20 13:58:37.792 | INFO     | openadapt.browser:assign_browser_events:688 - Key Release A: 2 action events, 0 browser events
2024-09-20 13:58:37.792 | INFO     | openadapt.browser:evaluate_alignment:483 - Alignment for Key Release A Events
2024-09-20 13:58:37.792 | INFO     | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
 53%|██████████████████████▎                   | 58/109 [00:01<00:00, 53.38it/s]2024-09-20 13:58:37.793 | INFO     | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
2024-09-20 13:58:37.826 | INFO     | openadapt.browser:assign_browser_events:688 - Key Release C: 4 action events, 0 browser events
2024-09-20 13:58:37.826 | INFO     | openadapt.browser:evaluate_alignment:483 - Alignment for Key Release C Events
2024-09-20 13:58:37.826 | INFO     | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:37.826 | INFO     | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
 70%|█████████████████████████████▎            | 76/109 [00:02<00:00, 57.43it/s]2024-09-20 13:58:38.144 | INFO     | openadapt.browser:assign_browser_events:688 - Key Release V: 6 action events, 0 browser events
2024-09-20 13:58:38.144 | INFO     | openadapt.browser:evaluate_alignment:483 - Alignment for Key Release V Events
2024-09-20 13:58:38.144 | INFO     | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:38.144 | INFO     | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
 87%|████████████████████████████████████▌     | 95/109 [00:02<00:00, 58.98it/s]2024-09-20 13:58:38.446 | INFO     | openadapt.browser:assign_browser_events:688 - Key Release CTRL: 3 action events, 0 browser events
2024-09-20 13:58:38.446 | INFO     | openadapt.browser:evaluate_alignment:483 - Alignment for Key Release CTRL Events
2024-09-20 13:58:38.446 | INFO     | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:38.446 | INFO     | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
2024-09-20 13:58:38.480 | INFO     | openadapt.browser:assign_browser_events:688 - Key Release ESC: 2 action events, 0 browser events
2024-09-20 13:58:38.480 | INFO     | openadapt.browser:evaluate_alignment:483 - Alignment for Key Release ESC Events
2024-09-20 13:58:38.480 | INFO     | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:38.480 | INFO     | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
100%|█████████████████████████████████████████| 109/109 [00:02<00:00, 39.76it/s]
2024-09-20 13:58:38.663 | WARNING  | openadapt.browser:assign_browser_events:745 - name='Remote' time_differences=[]
2024-09-20 13:58:38.663 | WARNING  | openadapt.browser:assign_browser_events:745 - name='Local' time_differences=[]
2024-09-20 13:58:38.663 | WARNING  | openadapt.browser:assign_browser_events:772 - axis='X' mouse_differences=[]
2024-09-20 13:58:38.664 | WARNING  | openadapt.browser:assign_browser_events:772 - axis='Y' mouse_differences=[]
2024-09-20 13:58:38.664 | INFO     | openadapt.browser:assign_browser_events:806 - Total Errors Across All Events: 0
2024-09-20 13:58:38.664 | INFO     | openadapt.browser:log_stats:817 - event_stats['match_count']=0
2024-09-20 13:58:38.664 | INFO     | openadapt.browser:log_stats:818 - event_stats['mismatch_count']=0
2024-09-20 13:58:38.664 | INFO     | openadapt.browser:log_stats:819 - event_stats['unmatched_browser_events']=0
2024-09-20 13:58:39.043 | INFO     | openadapt.events:get_events:80 - num_process_iters=0 num_action_events=3345 num_window_events=63 num_screenshots=475num_browser_events=0
2024-09-20 13:58:39.043 | INFO     | openadapt.events:merge_events:849 - before num_action_events=3345 num_window_events=63 num_screenshots=475 num_browser_events=0 num_total=3883
2024-09-20 13:58:39.072 | INFO     | openadapt.events:merge_consecutive_action_events:782 - name='redundant_mouse_move' num_events_removed=75
2024-09-20 13:58:39.102 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=2 group_idx_tups=[(0, 2)]
2024-09-20 13:58:39.102 | WARNING  | openadapt.events:get_group_idx_tups:534 - Key.cmd not in pressed_keys=set()
2024-09-20 13:58:39.103 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.103 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.123 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.124 | WARNING  | openadapt.events:get_group_idx_tups:534 - Key.esc not in pressed_keys=set()
2024-09-20 13:58:39.124 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.124 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=2 group_idx_tups=[(0, 2)]
2024-09-20 13:58:39.136 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=4 group_idx_tups=[(0, 2), (2, 4)]
2024-09-20 13:58:39.137 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.137 | WARNING  | openadapt.events:get_group_idx_tups:534 - Key.ctrl not in pressed_keys=set()
2024-09-20 13:58:39.137 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.156 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.157 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.157 | WARNING  | openadapt.events:get_group_idx_tups:534 - Key.cmd not in pressed_keys=set()
2024-09-20 13:58:39.157 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=2 group_idx_tups=[(0, 2)]
2024-09-20 13:58:39.161 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=2 group_idx_tups=[(0, 2)]
2024-09-20 13:58:39.162 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.162 | WARNING  | openadapt.events:get_group_idx_tups:534 - Key.cmd not in pressed_keys=set()
2024-09-20 13:58:39.162 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.184 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=3 group_idx_tups=[(0, 3)]
2024-09-20 13:58:39.185 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.204 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.206 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.207 | WARNING  | openadapt.events:get_group_idx_tups:534 - Key.cmd not in pressed_keys=set()
2024-09-20 13:58:39.207 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=2 group_idx_tups=[(0, 2)]
2024-09-20 13:58:39.210 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=6 group_idx_tups=[(0, 6)]
2024-09-20 13:58:39.228 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=2 group_idx_tups=[(0, 2)]
2024-09-20 13:58:39.228 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.229 | WARNING  | openadapt.events:get_group_idx_tups:534 - Key.cmd not in pressed_keys=set()
2024-09-20 13:58:39.229 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.252 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.253 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.254 | WARNING  | openadapt.events:get_group_idx_tups:534 - Key.cmd not in pressed_keys=set()
2024-09-20 13:58:39.254 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.254 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.259 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=6 group_idx_tups=[(0, 6)]
2024-09-20 13:58:39.278 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=2 group_idx_tups=[(0, 2)]
2024-09-20 13:58:39.279 | WARNING  | openadapt.events:get_group_idx_tups:534 - Key.cmd not in pressed_keys=set()
2024-09-20 13:58:39.279 | INFO     | openadapt.events:get_group_idx_tups:554 - len(to_merge)=2 group_idx_tups=[(0, 2)]
2024-09-20 13:58:39.301 | INFO     | openadapt.events:merge_consecutive_action_events:782 - name='keyboard' num_events_removed=41
2024-09-20 13:58:39.330 | INFO     | openadapt.events:merge_consecutive_action_events:782 - name='mouse_move' num_events_removed=3049
2024-09-20 13:58:39.330 | INFO     | openadapt.events:merge_consecutive_action_events:782 - name='mouse_scroll' num_events_removed=2
2024-09-20 13:58:39.334 | INFO     | openadapt.events:merge_consecutive_action_events:782 - name='mouse_click' num_events_removed=33
2024-09-20 13:58:39.335 | INFO     | openadapt.events:merge_events:910 - after num_action_events_=145 num_window_events_=34 num_screenshots_=121 num_browser_events_=0 num_total_=300
2024-09-20 13:58:39.335 | INFO     | openadapt.events:merge_events:916 - pct_action_events=0.043348281016442454 pct_window_events=0.5396825396825397 pct_screenshots=0.25473684210526315 pct_browser_events=None pct_total=0.07725985063095545
2024-09-20 13:58:39.335 | INFO     | openadapt.events:get_events:142 - duration=3.8551647663116455
--- Logging error in Loguru Handler #1 ---
Record was: None
Traceback (most recent call last):
  File "/Users/macbook/Library/Caches/pypoetry/virtualenvs/openadapt-o9nVgTAt-py3.10/lib/python3.10/site-packages/loguru/_handler.py", line 272, in _queued_writer
    message = queue.get()
  File "/opt/homebrew/Cellar/python@3.10/3.10.14_1/Frameworks/Python.framework/Versions/3.10/lib/python3.10/multiprocessing/queues.py", line 367, in get
    return _ForkingPickler.loads(res)
  File "av/enum.pyx", line 122, in av.enum._unpickle
  File "av/enum.pyx", line 54, in av.enum.EnumType.__getitem__
KeyError: 'ERRORTYPE_2'
--- End of logging error ---
2024-09-20 13:58:39.347 | INFO     | openadapt.strategies.visual:__del__:254 - action_history=
[]