small-thinking / mnlm

Demo of robotics.
43 stars 7 forks source link

mnlm (中文文档)

Source code of robotic arm demo (see Physical Robot Arm and Simulation).

IMAGE ALT TEXT HERE

Build and Start the Docker Container

  1. Install Docker and Docker Compose.
    docker-compose up --build -d

This command will build the docker image for the server side, and also start the docker container. Users can also access the simulation environment through the browser by visiting http://localhost:8080/vnc.html. [IMAGE ALT TEXT HERE]

  1. Login to the docker container. If you use vscode, you can install the Dev Container extension and open the running container. Otherwise, you can login to the docker container by running the following command:

    docker exec -it mnln-ros_dev_env-1 /bin/bash
  2. Start the ROS2 simulation.

    cd /home/small-thinking/mnlm/mnlm/robot/robot_arm_ws
colcon build --symlink-install ; source install/setup.bash ; ros2 launch robot_arm robot_arm_sim.launch.py

You should see the server side program started. And you can visit `http://localhost:8080/vnc.html`` to see the Gazebo Fortress simulation environment. IMAGE ALT TEXT HERE

  1. In your host machine. You can run the command to start the voice based UI.

IMAGE ALT TEXT HERE


In the project folder:
```bash
cd mnlm/client/gpt_control

Then you can see the client side started, and you will be prompoted to tell the robot what to do.

python assistant.py