macrocosm-os / prompting

SN1: An incentive mechanism for internet-scale conversational intelligence
https://bittensor.com
MIT License
64 stars 35 forks source link

Stop Validators from Sending Empty Challenges #196

Open bkb2135 opened 2 months ago

bkb2135 commented 2 months ago

For wiki-based tasks, validators send empty challenges ~1.2% of the time.

bkb2135 commented 2 weeks ago

If the challenge is empty, we should just raise an exception and try again/skip the task. We should check this after we generate the challenge and clean it.