ashirt-ops / ashirt-workers

Repo for ashirt enhancement workers
MIT License
0 stars 0 forks source link

Vision Worker #26

Open jkennedyvz opened 5 months ago

jkennedyvz commented 5 months ago

Most of our users won't be able to upload all of their evidence to a 3rd party for inference. This worker uses the Microsoft phi-3-vision model to answer pre-defined questions of the image evidence you submit.

Screenshot 2024-05-14 at 5 57 55 PM Screenshot 2024-06-13 at 11 07 48 PM
jkennedyvz commented 5 months ago

This works locally, but the init lasts longer than the maximum for aws lambda (10 seconds). I'll package this as an ECS task as well.