In augmented reality (AR), DARPA (Defense Advanced Research Projects Agency) is developing AI assistants that will guide users through complex tasks with a step-by-step guide.
In the Perceptually-enabled Task Guidance (PTG) program, which was recently developed, military personnel can be asked to dress wounds, fix fighter jets, or even fly them in 2021. Sensors, such as head-mounted cameras and microphones, will be worn by soldiers to record what they see, hear, and say.
AR goggles, which they will be required to wear, will display instructions on how to complete tasks.
Bruce Draper, manager of the PTG program, stated, “What we need in the middle is an assistant that can recognize what you are doing as you start a task, has the prerequisite know-how to accomplish that task, can provide step-by-step guidance, and can alert you to any mistakes you’re making.” DARPA has already granted PTG contracts and grants to researchers from NYU, Northrop Grumman, and a variety of other institutions in order to keep track of the program’s progress. The AI assistant’s demonstrations would be similar to following a recipe.
Draper asserts, “Cooking is visually quite complex.” Specialized terminology exists. It’s a great practice domain for a wide range of other highly skilled tasks because it requires specialized equipment and a variety of approaches.
Similar to how GPS and the internet were initially developed for the military, the developed artificial intelligence assistants may soon be made available to the general public for use.
