scanner-research / esper-tv

Esper instance for TV news analysis
Apache License 2.0
39 stars 10 forks source link

Add mechanism for handling binary data #94

Open willcrichton opened 5 years ago

willcrichton commented 5 years ago

We commonly have binary data, or data with sufficiently complex structure that it doesn't make sense to add it as SQL columns.

We should have a single consistent mechanism for creating, saving, loading (e.g. w/ mmap), searching, etc. packed binary files for each kind of data type.

DanFu09 commented 5 years ago

See https://github.com/DanFu09/esper/blob/master/app/esper/pose_wrapper.py, https://github.com/DanFu09/esper/blob/master/app/esper/face_landmarks_wrapper.py, and https://github.com/scanner-research/esper/blob/master/app/esper/face_embeddings.py for some ad hoc solutions using https://github.com/scanner-research/rs-embed.