Agility Robotics shared a demo video Wednesday of one of its Digit robots upgraded with AI. Although that may conjure terrifying pop-culture images of sentient sci-fi machines taking over the world, the demo video reveals something much more pedestrian, if not boring. The bipedal warehouse robot ploddingly works to complete a slightly puzzling task without direct human control or detailed guidance. In the clip, it slowly but successfully interprets and executes the command, “Take the box that’s the color of Darth Vader’s lightsaber, and move it to the tallest tower in the front row.” The company, which added a “head” and “hands” to Digit earlier this year, pitches the demonstration as a glimpse into how large language models (LLMs) can enhance its humanoid machines. It suggests it’s a natural fit, describing Digit as “a physical embodiment of artificial intelligence.” “We created a demo space with a series of numbered towers of several heights, as well as three boxes with multiple defining characteristics,” Pras Velagapudi, Agility Robotics’ vice president of innovation and chief architect, explained in the clip. “Digit was given information about this environment, but was not given any specific information about its tasks. Just natural language commands of varying complexity to see if it could execute them.” The clip shows Digit’s beat-by-beat inner monologue overlaid on the screen as the robot thinks its way through the task. For example, “I should find out what commands I can use,” “I should first assess the environment to see what items and locations are available,” and “Darth Vader’s light saber is red, and so the red box (box2) is the one I need to move. The tallest tower in the front row is tower4. I will first move to the location of box2.”
Full story : Agility’s Digit warehouse robot understands natural language commands thanks to AI smarts.