search

OpenAdaptAI / OpenAdapt

AI-First Process Automation with Large ([Language (LLMs) / Action (LAMs) / Multimodal (LMMs)] / Visual Language (VLMs)) Models
https://www.OpenAdapt.AI
MIT License
739 stars 98 forks source link

repair VisualReplayStrategy #758

Closed abrichr closed 2 weeks ago

abrichr commented 2 weeks ago

This PR reverts the regression described here: https://github.com/OpenAdaptAI/OpenAdapt/issues/756#issuecomment-2168636951

abrichr commented 2 weeks ago

Replay is successful, however finishes with:

2024-06-15 11:29:29.870 | INFO     | openadapt.strategies.visual:find_similar_image_segmentation:349 - similarity_index=0.9840672822483859
2024-06-15 11:29:29.870 | WARNING  | openadapt.strategies.visual:get_next_action_event:225 - exc=ValueError("'(None)' is not in list")
2024-06-15 11:29:29.896 | INFO     | openadapt.strategies.visual:find_similar_image_segmentation:349 - similarity_index=0.9840672822483859
2024-06-15 11:29:29.896 | WARNING  | openadapt.strategies.visual:get_next_action_event:225 - exc=ValueError("'(None)' is not in list")
2024-06-15 11:29:29.922 | INFO     | openadapt.strategies.visual:find_similar_image_segmentation:349 - similarity_index=0.9840672822483859
2024-06-15 11:29:29.922 | WARNING  | openadapt.strategies.visual:get_next_action_event:225 - exc=ValueError("'(None)' is not in list")
2024-06-15 11:29:29.951 | INFO     | openadapt.strategies.visual:find_similar_image_segmentation:349 - similarity_index=0.9840672822483859
2024-06-15 11:29:29.952 | WARNING  | openadapt.strategies.visual:get_next_action_event:225 - exc=ValueError("'(None)' is not in list")
2024-06-15 11:29:29.980 | INFO     | openadapt.strategies.visual:find_similar_image_segmentation:349 - similarity_index=0.9840672822483859
2024-06-15 11:29:29.980 | WARNING  | openadapt.strategies.visual:get_next_action_event:225 - exc=ValueError("'(None)' is not in list")
2024-06-15 11:29:30.012 | INFO     | openadapt.strategies.visual:find_similar_image_segmentation:349 - similarity_index=0.9840672822483859
2024-06-15 11:29:30.012 | WARNING  | openadapt.strategies.visual:get_next_action_event:225 - exc=ValueError("'(None)' is not in list")
2024-06-15 11:29:30.043 | INFO     | openadapt.strategies.visual:find_similar_image_segmentation:349 - similarity_index=0.9840672822483859
2024-06-15 11:29:30.043 | WARNING  | openadapt.strategies.visual:get_next_action_event:225 - exc=ValueError("'(None)' is not in list")