Write a custom scorer for the eval.

browserbase / stagehand

An AI web browsing framework focused on simplicity and extensibility.

https://www.browserbase.com

MIT License

1.16k stars 43 forks source link

Open navidkpr opened 1 month ago

navidkpr commented 1 month ago

And

Implement fuzzy search scoring

Also, if you get extra time, make more information available on Braintrust dashboard

filip-michalsky commented 1 month ago

fuzzy search scoring is an option, how about embeddings vector similarity?