Research tests

[nerfZael]

Closes #247 #238

• Testing only what the user actually sees
• Testing with dynamic instead of hardcoded data

[nerfZael]

/workflows/benchmarks agents/token/send,agents/token/test_swap.py,agents/token/test_swap_and_send.py 3

[github-actions[bot]]

Finished benchmarks Download artifacts

Test Run Summary

• Run from: ./autotx/tests/agents/token/send,./autotx/tests/agents/token/test_swap.py,./autotx/tests/agents/token/test_swap_and_send.py
• Base path: autotx/tests/agents/token/
• Iterations: 3
• Total Cost: $1.67
• Total Success Rate (%): ${\color{red} \LARGE \texttt {93.75} \large \texttt { (94/-6)} }$

Detailed Results

Test Name	Success Rate (%)	Passes	Fails	Avg Time	Avg Cost
send/test_send.py::test_send_erc20	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {3}}$	${\color{none} \large \texttt {0}}$	28s	$0.02
send/test_send.py::test_send_erc20_parallel	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {3}}$	${\color{none} \large \texttt {0}}$	42s	$0.03
send/test_send.py::test_send_eth_multiple	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {3}}$	${\color{none} \large \texttt {0}}$	60s	$0.05
send/test_send.py::test_send_native	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {3}}$	${\color{none} \large \texttt {0}}$	23s	$0.02
send/test_send.py::test_send_native_sequential	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {3}}$	${\color{none} \large \texttt {0}}$	33s	$0.04
test_swap.py::test_swap_complex_1	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {3}}$	${\color{none} \large \texttt {0}}$	50s	$0.04
test_swap.py::test_swap_complex_2	${\color{red} \large \texttt {0} \normalsize \texttt {(-100)} }$	${\color{red} \large \texttt {0}}$	${\color{red} \large \texttt {3}}$	43s	$0.04
test_swap.py::test_swap_multiple_1	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {3}}$	${\color{none} \large \texttt {0}}$	33s	$0.03
test_swap.py::test_swap_multiple_2	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {3}}$	${\color{none} \large \texttt {0}}$	46s	$0.03
test_swap.py::test_swap_native	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {3}}$	${\color{none} \large \texttt {0}}$	29s	$0.02
test_swap.py::test_swap_triple	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {3}}$	${\color{none} \large \texttt {0}}$	48s	$0.03
test_swap.py::test_swap_with_non_default_token	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {3}}$	${\color{none} \large \texttt {0}}$	34s	$0.02
test_swap_and_send.py::test_send_and_swap_complex	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {3}}$	${\color{none} \large \texttt {0}}$	1.10m	$0.08
test_swap_and_send.py::test_send_and_swap_simple	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {3}}$	${\color{none} \large \texttt {0}}$	32s	$0.03
test_swap_and_send.py::test_swap_and_send_complex	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {3}}$	${\color{none} \large \texttt {0}}$	56s	$0.05
test_swap_and_send.py::test_swap_and_send_simple	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {3}}$	${\color{none} \large \texttt {0}}$	31s	$0.03

Total run time: 32.69 minutes

[nerfZael]

/workflows/benchmarks agents/token/research

[github-actions[bot]]

Finished benchmarks Download artifacts

Test Run Summary

• Run from: ./autotx/tests/agents/token/research
• Base path: autotx/tests/agents/token/research/test_
• Iterations: 5
• Total Cost: $12.52
• Total Success Rate (%): ${\color{red} \LARGE \texttt {85.00} \large \texttt { (85/-6)} }$

Detailed Results

Test Name	Success Rate (%)	Passes	Fails	Avg Time	Avg Cost
advanced.py::test_research_and_swap_many_tokens_subjective_complex	${\color{lightgreen} \large \texttt {40} \normalsize \texttt {(+30)} }$	${\color{lightgreen} \large \texttt {2}}$	${\color{lightgreen} \large \texttt {3}}$	6.46m	$0.60
advanced.py::test_research_and_swap_many_tokens_subjective_simple	${\color{red} \large \texttt {60} \normalsize \texttt {(-30)} }$	${\color{red} \large \texttt {3}}$	${\color{red} \large \texttt {2}}$	1.77m	$0.21
research.py::test_get_top_5_memecoins	${\color{red} \large \texttt {80} \normalsize \texttt {(-10)} }$	${\color{red} \large \texttt {4}}$	${\color{red} \large \texttt {1}}$	1.50m	$0.16
research.py::test_get_top_5_memecoins_in_optimism	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {5}}$	${\color{none} \large \texttt {0}}$	1.01m	$0.15
research.py::test_get_top_5_most_traded_tokens_from_l1	${\color{red} \large \texttt {80} \normalsize \texttt {(-20)} }$	${\color{red} \large \texttt {4}}$	${\color{red} \large \texttt {1}}$	59s	$0.17
research.py::test_get_top_5_tokens_from_base	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {5}}$	${\color{none} \large \texttt {0}}$	1.21m	$0.15
research.py::test_price_change_information	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {5}}$	${\color{none} \large \texttt {0}}$	25s	$0.06
research_and_swap.py::test_research_and_buy_multiple	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {5}}$	${\color{none} \large \texttt {0}}$	1.13m	$0.18
research_and_swap.py::test_research_and_buy_one	${\color{red} \large \texttt {80} \normalsize \texttt {(-20)} }$	${\color{red} \large \texttt {4}}$	${\color{red} \large \texttt {1}}$	59s	$0.22
research_swap_and_send.py::test_research_buy_multiple_send_multiple	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {5}}$	${\color{none} \large \texttt {0}}$	1.83m	$0.24
research_swap_and_send.py::test_research_buy_one_send_multiple	${\color{red} \large \texttt {80} \normalsize \texttt {(-20)} }$	${\color{red} \large \texttt {4}}$	${\color{red} \large \texttt {1}}$	1.37m	$0.20
research_swap_and_send.py::test_research_buy_one_send_one	${\color{none} \large \texttt {100} \normalsize \texttt {} }$	${\color{none} \large \texttt {5}}$	${\color{none} \large \texttt {0}}$	1.13m	$0.17

Total run time: 98.85 minutes