We demoed our work “EmbodiedRDA: Connecting Foundation Models with the Physical World using Reconfigurable Drone Agents” at the 30th Annual International Conference on Mobile Computing and Networking (ACM MobiCom’24) in Washington, DC. The demonstration was awarded Best Demo Runner-Up at the conference.
EmbodiedRDA connects foundation models with the physical world through a custom-designed drone platform that autonomously reconfigures itself with different sensors and actuators. The system adapts to various tasks in physical environments – from locating objects to environmental monitoring and physical assistance.
The demonstration showcased four capabilities of EmbodiedRDA:
- Environmental sensing using reconfigurable temperature sensors
- Chemical spill detection with automated sensor selection
- Object localization through drone camera
- Physical interaction through autonomous medicine delivery
The system includes:
- A drone platform with dynamic sensing and actuation capabilities
- A ground station for autonomous drone payload reconfiguration
- Modular sensor and actuator packages with standardized connections
- Foundation model agents for task comprehension and execution
This recognition reflects our lab’s progress in connecting AI’s digital capabilities with physical world interactions. Congratulations to Minghui Zhao, Kaiyuan Hou, Junxi Xia, and the rest of the team!
You must be logged in to post a comment.