XRP Robot for FRC - Adding Computer Vision and Object Detection | DigiKey

Embark on a journey of innovation and learning with the eXperiential Robotics Platform (XRP), a 3D-printed robot born from a collaboration between tech giants like DigiKey, SparkFun, WPI, FIRST, Raspberry Pi, and more. Discover how to modify your XRP to navigate, identify, and interact with objects, elevating it beyond its initial capabilities. In the video, Shawn uses a custom object detection machine learning model to enable the robot to identify a red basket and deliver it to a target zone marked with tape. A written guide for this project can be found here: https://www.digikey.com/en/maker/projects/adding-object-detection-vision-to-the-xrp-robot/9119cd68087145bca1470a0ed13d1d9a All code and 3D printer STL files can be found here: https://github.com/ShawnHymel/xrp-object-detection The XRP contains several sensors to get you started interacting with the physical world along with the challenge of delivering baskets to a target zone. However, the delivery challenge uses a route clearly marked in tape to encourage the use of the line-following sensor. In the video, we take a more advanced approach by introducing machine learning through a custom-trained object detection model and Google Coral Dev Board Micro. See the previous video on how to train and deploy this object detection model to the Coral Micro: https://youtu.be/4KzWIJYnHW0 With the object detection model running on the Coral Micro, we can mount the board to the XRP to provide a continuous stream of bounding box information about the objects in its field of view. We can use this information to make driving decisions on the XRP. We create a program in MicroPython to identify a red basket (from the bounding box information), drive toward it, pick it up, identify the target zone marked with tape, and deliver the basket to the target zone. This is the beginning of creating a fully autonomous robot to perform tasks without the need for a designated road to follow! Additionally, it should help any FIRST teams understand how to use object detection for any upcoming challenges as part of FRC. Guide for training an object detection model for the Google Coral Micro: https://www.digikey.com/en/maker/projects/intro-to-the-google-coral-dev-board-micro-custom-object-detection/a8f6695940bf4c74a900e06bce3feacd Main XRP site: https://experientialrobotics.org/ XRP Getting Started Guide: https://docs.wpilib.org/en/latest/docs/xrp-robot/index.html XRP Build Instructions: https://xrpusersguide.readthedocs.io/en/latest/course/building.html Introduction to Robotics with XRP curriculum: https://introduction-to-robotics.readthedocs.io/en/latest/course/course_info/index.html XRPLib source code: https://github.com/Open-STEM/XRP_MicroPython Learn more: Maker.io - https://www.digikey.com/en/maker DigiKey’s Blog – TheCircuit https://www.digikey.com/en/blog Connect with DigiKey on Facebook https://www.facebook.com/digikey.electronics/ And follow us on X https://twitter.com/digikey 00:00 Intro 0:51 About the XRP 1:21 The basket challenge 2:19 XRP hardware upgrade 2:43 Object detection with Google Coral Micro 4:51 State machine 6:21 Hardware connections 6:59 Software overview 11:19 Live test