PRIME — Closed-Loop LLM-Based Cobot
Computer-vision perception module for a closed-loop human-robot teaming cobot driven by LLM-based autonomy allocation.
PRIME is a closed-loop cobot system that dynamically allocates autonomy between a human operator and an LLM-driven controller during a shared task. I built and integrated the computer-vision perception module.
My contributions
- Fine-tuned YOLOv26 for object detection and action recognition driving the perception loop.
- Collected and labeled task-specific image datasets covering target objects and operator actions.
- Integrated the perception module with the cobot stack and ran end-to-end task evaluation experiments.
Manuscript under review.