Decoding The Language Of “Things”: From Learning Physics Grammar To "AI-Augmented Super-Sensors"
ABSTRACT
What information is (actually) contained (hidden) in a transducer signal? How can we push the boundaries of what is possible to be sensed beyond physical sensor design expectations? Is there more than meets the classical “instrumentation and measurement” eye? To that end, we are developing AI-augmented sensing capabilities empowered by cross-modal/cross-spectral signal representation learning and signal-to-signal translation leveraging state-of-the-art AI foundation models. One of the highlight research projects will include SoundSee - our mission to the International Space Station (ISS) in partnership with NASA to perform autonomous acoustic monitoring of the station and how we are translating those capabilities into products and services here on the ground.
Finally, we'll discuss challenges and opportunities towards building a generalizable signal AI foundation model that can potentially transform ubiquitous low-cost sensing at scale and enable a diverse range of application domains including richer UX/interaction, surprisingly responsive objects & environments, augmented situational awareness, digital twins, infrastructure monitoring and ultimately, see and sense the world in a whole new way.
BIOGRAPHY
Samarjit Das is the Director of Bosch Research and Technology Center (RTC) and Bosch Center for AI (BCAI) Pittsburgh leading cutting-edge research in multimodal AI, AI for science, sensing AI and physical AI/robotics. He is also the Chief Scientist and global head of Signal Processing + Machine Learning research at Bosch Research.
Dr. Das has successfully led the SoundSee mission to the International Space Station (ISS) in partnership with NASA carrying out novel AI-driven acoustic sensing research in zero-gravity. His work has found extensive media coverages around the world including IEEE Spectrum, MIT Tech Review, NPR, TechCrunch, DigitalTrends, ZDNet, Autonews, Robotics & Automation News to name a few.
Dr. Das is the 2021 recipient of the Carnegie Science Award in innovation and Young Alumni Award’22 from the Iowa State University College of Engineering. He was featured in keynote presentations at the Consumer Electronics Show (CES) 2020 in Las Vegas, NV and Bosch Connected World 2020 in Berlin, Germany and was a selected panelist at South by Southwest (SXSW) 2020.