search

EndyLab / opentrons

Code relating to the OpenTrons liquid handling robots.
9 stars 0 forks source link

Using computer vision to control OT-1 robot #36

Open jaysehgal opened 1 year ago

jaysehgal commented 1 year ago

Hello,

I'm a research student who recently got his hands on opentrons OT-1 robot. I wanted to implement computer vision using openCV to have feedback control to the robot. I have a couple of questions to ask.

  1. I am currently using intelsense intel sense d435i camera but didn't had much success with its integeration. What camera you guys recommend using?
  2. For the platform do you guys recomended using Matlab computer vision toolbox or stick to python OpenCV as the OT-1 is meant to work with python.

Thanks, Jay

antonjs commented 1 year ago

Hi Jay,

Awesome that you're giving this a try. I don't recall which camera we were using, but I don't think it was a particularly sophisticated one. I would think any USB camera with decent resolution that's compatible with the python image libraries should work. One thing to note is that lighting can be very important--lighting the deck well will help the camera a lot.

I would definitely use python for the image analysis, both because it will be much easier to control the robot, and because now there's an even richer and more powerful collection of neural network based image analysis tools that are easily accessible from python.

Cheers Anton