allenai / mmda

multimodal document analysis
Apache License 2.0
158 stars 18 forks source link

Fix vila it and drop `blocks` #236

Closed cmwilhelm closed 1 year ago

cmwilhelm commented 1 year ago

I would like to redeploy vila with some new performance modifications. This PR does two things:

  1. Removes the requirements for blocks from the request payload. We don't actually use them, since we are using ivila. This will save us unnecessary, expensive boxgroup annotation time.
  2. Updates the test fixtures to use the newer box json serialization, since this was out of date. (values otherwise unchanged)
geli-gel commented 1 year ago

this whole time i thought vila annotated the blocks

cmwilhelm commented 1 year ago

@geli-gel the blocks are used by the hvila variant, which we decided not to use lololol.