Add interface to collect frames from V1 in the tool

[DXM123]

Description

With the introduction of the new Pylon Camera and the Falcons new v1 Robot, there is a need to integrate the camera's frame collection into our system and develop methods for running the calibration and warping tool remotely. This will facilitate real-time data processing directly from the robot or through remote operation, enhancing flexibility and usability in various field settings.

Objective

To successfully integrate the Pylon Camera with the Falcons v1 Robot for effective frame collection and explore feasible methods for running the calibration tool remotely, ensuring simplicity and reliability in initial implementations.

Expected Outcome

• Seamless integration of the Pylon Camera with the Falcons v1 Robot for direct frame collection.
• Implementation of a basic remote operation setup, allowing the calibration tool to be run either on the robot or from a remote location.
• Documentation outlining the setup process and operational instructions.

Proposed Methods for Remote Operation

1. X Forwarding: Utilize X11 forwarding to run the GUI remotely but render it on a local machine. This method is relatively simple to set up and uses SSH for secure data transmission.

   • Pros: Simple setup; uses existing SSH infrastructure.
   • Cons: May have performance issues with high-latency networks.

2. Socket Communication: Develop a simple socket-based server-client model where the robot acts as a server sending frame data to a remote client that runs the calibration tool.

   • Pros: More scalable and suitable for handling larger data streams.
   • Cons: Requires setting up a robust network communication protocol.

3. Web-Based Interface: Implement a web interface to interact with the robot and control the calibration tool via a browser. This can be built on top of a lightweight HTTP server running on the robot.

   • Pros: Accessible from any device with a browser; intuitive user interface.
   • Cons: Higher initial development effort and may require additional security considerations.

Steps to Achieve

1. Integration Development: Develop the integration layer for the Pylon Camera with the Falcons v1 Robot, ensuring the camera can transmit frames effectively to the processing unit.
2. Prototype Remote Operation Method: Select one of the proposed methods and develop a prototype to test its feasibility and effectiveness in a controlled environment.
3. Testing and Evaluation: Conduct comprehensive testing of both the integration and the remote operation setup. Assess performance, ease of use, and reliability.
4. Documentation and Training: Provide detailed documentation on the setup process, operational guidelines, and troubleshooting.

Additional Notes

• Initial efforts should prioritize simplicity and reliability to quickly establish a working system.
• Security considerations, especially in methods involving network communication, should be addressed early in the development phase.
• Make sure we dont break MSL rules

Questions & Discussion Points

• Which remote operation method should we prioritize for the initial implementation?
• Are there specific security concerns or performance benchmarks we should consider for each method?

Your insights and contributions to this discussion are highly valuable. Please let us know your preferences and any concerns you might have regarding these proposals.

---

This integration and exploration of remote operation methods aim to significantly enhance the functionality and flexibility of our calibration tool in line with the capabilities of the Falcons new v1 Robot.

[DXM123]

I will take a look.

Maybe this can be used:

https://github.com/basler/pypylon

Only local collect or add options over network like socker or rtsp

[DXM123]

Added Pylon, closed