Skip to content

Vision Based Robot Control & Digital Twin v1.0

Latest
Compare
Choose a tag to compare
@SAIRISAN123 SAIRISAN123 released this 15 Jan 18:23
· 7 commits to main since this release
ee2971a

new

Slide2

Physical Robot Arm
• Gesture-Controlled: Operates using vision-based hand gestures.
• IoT Integration: Communication is facilitated via the MQTT protocol.
• NodeMCU: Acts as the main controller for the robot arm, subscribing to MQTT topics and processing commands.
• Servo Motor Control: The robot arm's movement is powered by servo motors, controlled precisely based on gesture inputs.
• Flexible Connectivity: Supports both local and cloud-based MQTT brokers for teleoperation over the internet.
• Seamless Setup: Broker deployment through Docker ensures a hassle-free and scalable environment.

Digital Twin
• 3D Model: A highly accurate virtual replica of the physical robot arm, built in Unity Game Engine.
• Hands-On Creation: Designed 80% of the 3D assets personally in Unity and Blender.
• Real-Time Synchronization: Maintains precise, real-time updates using the WebSocket protocol.
Multihost Deployment
• Distributed Architecture: The system runs across three host computers connected via LAN.
• Scalable Design: Can scale to four hosts, including a dedicated gesture recognition system.