search

fastmachinelearning / SonicCMS

Services for Optimized Network Inference on Coprocessors (for CMS)
8 stars 8 forks source link

Trt fpga #3

Closed violatingcp closed 4 years ago

violatingcp commented 4 years ago

Pull request to have FPGA running with Sonic. The protocol uses the same protocol as triton inference server. The only major difference is that our input to the fpga is fixed point 16bit as oppose to 32bit.

kpedro88 commented 4 years ago

@jmduarte did you also have comments on this?

kpedro88 commented 4 years ago

superseded by #7