Visual Task Modeling and Automated Planning for Humanoid Robots in Education of Individuals with Autism Spectrum Disorder
A novel method is presented that enables a semi-autonomous, camera-equipped robot to recognise the task goal and plan actions to achieve it, and a solver is developed that uses a vision-based Large Language Model to convert photos of a Shoebox Task into a Planning Domain Definition Language (PDDL) representation and ge...