Whoâs a âGood Boy?â Astro, FAUâs Smart Robodog Thatâs Who
Using deep learning and artificial intelligence (AI), Âé¶čŸ«Æ·ÊÓÆ”scientists are bringing to life one of about a handful of these quadruped robots in the world. Astro is unique because he is the only one of these robots with a head, 3D printed to resemble a Doberman pinscher, that contains a (computerized) brain. (Photo by Alex Dolce)
What would you get if you combined Amazonâs Alexa with an open source quadruped robot? Youâd get âAstro,â the four-legged seeing and hearing intelligent robodog.
Using deep learning and artificial intelligence (AI), scientists from âs Machine Perception and Cognitive Robotics Laboratory () in the in FAUâs are bringing to life one of about a handful of these quadruped robots in the world. Astro is unique because he is the only one of these robots with a head, 3D printed to resemble a Doberman pinscher, that contains a (computerized) brain.
Astro not only looks like a dog; he learns like one too. Thatâs because he doesnât operate based on preprogrammed robotic automation. Instead, Astro is being trained using inputs to a deep neural network âÌęa computerized simulation of a brain â so that he can learn from experience to perform human-like tasks, or on his case, âdoggie-likeâ tasks, that benefit humanity.
Ìę
Equipped with sensors, high-tech radar imaging, cameras and a directional microphone, this 60-pound super robot is still a âpuppy-in-training.â Just like a regular dog, he responds to commands such as âsit,â âstandâ and âlie down.â Eventually, he will be able to understand and respond to hand signals, detect different colors, comprehend many languages, coordinate his efforts with drones, distinguish human faces, and even recognize other dogs. Ìę
As an information scout, Astroâs key missions will include detecting guns, explosives and gun residue to assist police, the military, and security personnel. This robodogâs talents wonât just end there, he also can be programmed to assist as a service dog for the visually impaired or to provide medical diagnostic monitoring. The MPCR team also is training Astro to serve as a first responder for search and rescue missions such as hurricane reconnaissance as well as military maneuvers.
Martin Woodall, founder of DroneData and a visionary in the field of GPU accelerated servers, is sponsoring the robotic project at FAU. This project is a collaboration betweenÌęDroneData AstroRobotics division andÌęFAU's MPCR laboratory.ÌęAstroRobotics has provided theÌęGhostRoboticsÌęopen source robotic Four Leg All-Terrain Edge Compute PlatformÌęfor theÌęÂé¶čŸ«Æ·ÊÓÆ”designed software.Ìę
Designed to engage and react to the world around him in real-time, this intelligent machine will be able to navigate through rough terrains and respond to dangerous situations to keep humans and animals out of harmâs way. Astro will be outfitted with more than a dozen sensors that will consume environmental input across multiple modalities including optical, sound, gas and even radar. To process the sensory inputs and make autonomous behavioral decisions, a set of Nvidia Jetson TX2 graphics processing units are onboard with a combined four teraflops of computing power, which amounts to about four trillion computations a second. This robodog will be able to rapidly see and search thousands of faces in a database, smell the air to detect foreign substances, and hear and respond to distress calls that fall outside a humanâs audible hearing range. FAUâs MPCR team will program Astro to have an extensive database of experiences that he can draw upon to help him make immediate decisions on the go.
The human brains behind Astro are a team of neuroscientists, IT experts, artists, biologists, psychologists, high school students and undergraduate and graduate students at FAU. At the helm of this project are , Ph.D., an associate professor in FAUâs , co-director of FAUâs MPCR laboratory, and a member of FAUâs Brain Institute (), one of the universityâs four research pillars; , Ph.D., an assistant professor in FAUâs and co-director of FAUâs MPCR laboratory; and Pedram Nimreezi, director of intelligent software in FAUâs MPCR laboratory, chief technology officer for RedGage and a martial arts expert.
âOur Machine Perception and Cognitive Robotics laboratory team was sought out by DroneDataâs AstroRobotics group because of their extensive expertise in cognitive neuroscience, which includes behavioral, neurophysiological and embedded computational approaches to studying the brain,â said , Ph.D., dean of FAUâs Charles E. Schmidt College of Science. âAstro is inspired by the human brain and he has come to life through machine learning and artificial intelligence, which is proving to be an invaluable resource in helping to solve some of the worldâs most complex problems.â
-FAU-
Tags: faculty and staff | jupiter | engineering | technology | science | research | students