search

ntlm1686 / LLaVA-Surg

0 stars 0 forks source link

Build an interface for MD to annotation the surgical videos #23

Open ntlm1686 opened 7 months ago

ntlm1686 commented 7 months ago

Built the interface with label studio. Available on http://bellatrix.cse.buffalo.edu:8080. Data will be uploaded later.

Image

Customize template:

<View>
  <Labels name="labels" toName="audio">    
  <Label value="Visual" background="#2eb24f"/>
  <Label value="Knowledge" background="#0d2ed3"/></Labels>
  <Video name="video" value="$video_url" sync="audio"/>
  <Audio name="audio" value="$video_url" sync="video"/>

  <TextArea name="transcription" toName="audio" rows="2" editable="true" perRegion="true" required="true"/>
</View>
ntlm1686 commented 7 months ago

Added the dictation feature. https://github.com/ntlm1686/label-studio/commit/c23a87c06ac1c0de7ec7025f19f51e66ebf5ad1c

Image