caymansimpson / EliteFurretAI

Attempt to create a superhuman bot to play VGC
MIT License
5 stars 3 forks source link

Add fuzz testing and open up scripts #42

Open caymansimpson opened 1 month ago

caymansimpson commented 1 month ago

Fuzz:

  1. Create a bunch of edge case teams (speed, pivot, move, residual, field/SC/Weather, ability, Effects, items)
  2. Load teams and have them battle each other 100s of times
  3. Check inference, and throw errors for ground truth violations, check bad battle order returns through custom player class
  4. Print errors nicely with updates, tracking speed of games and logging them to files

Also open up scripts and change gitignore to be file specific

caymansimpson commented 1 month ago

Have to add poke-env features that were flagged by VGC fuzz testing. So far:

  1. Implementing Pokemon.name that will help construct a Showdown identifier
  2. Add temporary_ability and temporary_types for moves like Skill Swap and Soak
  3. Handle Effect ending
  4. Handle "-singlemove"
caymansimpson commented 1 week ago

Import FuzzTest method to threaded FuzzTester Have FuzzTest pull from print_observation from inference_utils