InvenSense

Part 2 of 2-part series on MSEC 2019 highlights. Read Part 1. Neural Networks on ChipTo be sure, low power is king when bringing machine learning to the sensor edge. Battery-powered, always-on sensing devices require it since frequent recharging is the death knell of any electronic product. That’s why semiconductor companies are offering new ways to conserve power.“MEMS sensor suppliers have made significant strides in the power, size and performance of their devices,” said Aspinity CEO Tom Doyle. “Yet these gains deliver only incremental power improvements to the system.”Doyle advocates a new architectural model that uses an analog neuromorphic processor to analyze all sensor data at the start of the signal chain instead of sending it downstream so power-hungry chips such as DSPs can digitize it before analysis.“The technology industry wants to take advantage of the many benefits of always-on sensing applications,” said Doyle. “Before we can reach mass proliferation, however, we need to resolve the power issues that are deal-breakers for some applications. We believe the answer to this challenge is architectural. All the data gathered by always-on sensing systems is analog in nature, yet as soon as it’s captured, it’s digitized immediately for analysis. Determining which data is important up front eliminates the digitization and processing of irrelevant data so that voice-first devices such as smart speakers and wearables/hearables can run for long periods of time without requiring battery recharge.”Syntiant CTO Jeremy Holleman agreed that on-device intelligence is the future.“Did you just fall? Is your heartrate a bit off? Deep learning provides a toolset that yields vastly superior decisions,” said Holleman. “The problem is that deep learning is computationally intensive. The answer is a neural network that performs on-device edge inferencing.”Holleman added that Syntiant’s neural decision processor was recently certified as Amazon Voice Service (AVS)-compliant for wake-word detection, making it easier to design voice control in battery-powered devices such as earbuds and wearables.MSEC Technology Showcase WinnerWith the groundswell of interest in intelligence at the edge, it was no surprise that Cartesiam won top honors among all competitors in the MSEC Technology Showcase for its NanoEdge AI, software that brings AI to the edge of the signal chain, making it easier for designers to create intelligent objects that can learn and understand.“Unlike other AI algorithmic technologies for sensing devices, NanoEdge enables both learning and inference at the edge, providing accurate and adaptive intelligence,” said Cartesiam Managing Director and Co-founder Marc Dupaquier, who accepted the award. “It’s also the only tool of its kind that does not require data scientists on board for implementation, which saves a tremendous amount of money. Our clients can build a machine learning library and embed it into their own code within weeks to realize the same caliber of unsupervised neural network that was once the exclusive domain of AI cloud vendors.”MSIG 2019 Hall of FameAt this year’s conference, MSIG Director Carmelo Sansone recognized two longtime contributors to the commercialization of MEMS and sensors: Peter G. Hartwell, Ph.D., chief technology officer at InvenSense, a TDK group company; and Thomas Kenny, professor and senior associate dean of engineering at Stanford University.Hartwell leads technology strategy and the InvenSense advanced technology research group. He has more than 25 years’ experience commercializing silicon MEMS products, including advanced sensors and actuators, and developing MEMS testing techniques.Kenny’s academic accomplishments include authoring or co-authoring more than 250 scientific papers and holding 50 issued patents. He has also advised more than 50 graduated Ph.D. students from Stanford.MSEC 2020Mark your calendar for next year’s MSEC, October 12-14, at Coronado Island Marriott Resort Spa in Coronado, Calif. Get updates from MSIG on MSEC and other upcoming events including MSTC 2020.Stay in Touch with MSIGMEMS Sensors Industry Group (MSIG), a SEMI Strategic Association Partner, is the industry association representing the global MEMS and sensors supply chain. To learn how MSIG enables professionals in the MEMS and sensors industry to innovate, address common challenges and accelerate business results, visit us today.Connect with MSIG on Twitter and LinkedIn. Subscribe to SEMI Blog: Technology and Trends.Maria Vetrano is a public relations consultant at SEMI.

Part of 1 of 2-part series on MSEC 2019 highlights. Read Part 2. MEMS and sensors are proliferating across consumer, automotive, biomedical/healthcare, robotics, industrial and agriculture applications to harvest sensory data in a hyper-connected world and meet demand from consumers and organizations alike as they clamor for more intelligence in electronics.Take the ubiquitous iPhone. Shipped in 2007, Apple’s first iPhone sported five sensors. By contrast, the most feature-packed smartphones will embed up to 20 sensors by 2021, according to Yole Développement’s Jérôme Azémar. He estimates that the devices will feature four MEMS microphones, four CMOS image sensors (CIS), a RGB color sensor, a laser rangefinder, an infrared sensor, a gas sensor, a heart rate monitor and a fingerprint sensor, not to mention the MEMS inertial sensors that device users have come to know and trust.The MEMS market is expected to reach $18.5 billion in 2024 [1], up a whopping 60 percent from $11.6 billion in 2018, according to Azémar, who presented at MEMS Sensors Industry Group’s 15th annual MEMS Sensors Executive Congress (MSEC) in late October in Coronado, Calif. Add other types of sensors to the mix – CIS, environmental sensors, LiDARs, radars, ultrasonics, and fingerprint sensors – and the market will mushroom to $93 billion by 2024, said Azémar.Since MEMS Sensors Industry Group (MSIG) joined SEMI as a Strategic Association Partner three years ago, SEMI has expanded its MEMS and sensors programs to Europe and Asia while continuing to grow its U.S. conferences. “SEMI is continually investing in MEMS and sensors innovation across the supply chain,” said Dave Anderson, president of SEMI Americas and host of MSEC. “For example, MSIG is contributing to the development of the Heterogeneous Integration Roadmap, an initiative designed to drive heterogeneous integration technology development and accelerate electronics innovation. The roadmap spans device design, test and fabrication, ecosystem development, R D, equipment and materials. “At MSEC, executives and other speakers explored how AI and blockchain are remaking the food supply chain, air transportation and other sectors as MEMS and sensors improve the quality of our lives,” said Anderson.Sensing at the EdgeThe concept of artificial intelligence (AI), that a machine can harness intelligence that rivals or outperforms humans – and act without human intervention – has been a feature of the human imagination since at least the 1968 film 2001: A Space Odyssey. MEMS and sensors facilitate intelligence in a wide range of electronics such as smartphones, healthcare wearables, robots, industrial predictive maintenance systems, and cars. AI is sure to augment that functionality.MEMS and sensors are now in their third wave of evolution, a focus on edge AI, Bosch Sensortec CEO and General Manager Stefan Finkbeiner told MSEC attendees. For its part, Bosch is working to add AI to MEMS devices. The first wave integrated software with MEMS sensors, and the second, sensor fusion, enabled designers to allocate performance and power strategically to tune MEMS for resource-constrained devices. The third wave is “an active-learning phase in which MEMS facilitates real-time learning at the edge to promote greater personalization, environmental feedback, privacy of user data and improved battery life,” said Finkbeiner.Small sensor nodes with edge AI exemplify third-wave applications. Integrating low-power environmental sensors (e.g., gas, temperature, pressure, humidity and air-flow sensors), the nodes could be deployed in fire-prone forests to assess fire risk and support early detection. Access to this real-time environmental information could prove invaluable to residents and public-safety personnel alike.Google takes another tack, applying machine learning to resource-constrained devices, said Nick Kreeger, a senior software engineer at the Internet giant. The company’s Google Brain creates machine learning models that can run on inexpensive, low-power microcontrollers using Google’s TensorFlow Lite, an open-source machine learning tool that’s been deployed on a multitude of mobile devices. Inferencing is done at the device’s edge, rather than transmitted to the cloud.Meeting the power constraints of battery-powered sensing devices is another matter that starts with minimizing energy and data waste. “Deep learning is compute-bound and runs well on existing microcontrollers,” Kreeger said. “Because it’s all arithmetic, it’s low-power compared to storage access.”Already Google has worked with Plant Village, a research unit at Penn State University, and the International Institute of Tropical Agriculture (IITA) to help farmers improve food production by using machine learning and cheap sensors to spot and manage planet diseases in developing countries. And that production chain is in dire need of a boost, according to Rajendra Rao, general manager of IBM Food Trust, an enterprise-class blockchain solution.“We are on the cusp of complete failure of the food system,” Rao said. “One out of 10 people gets sick each year from foodborne illness, 420,000 die from this annually, 80 percent of companies in the food supply chain have not digitized, one-third of all fresh food in the US is thrown away, and one in five seafood samples worldwide is mislabeled.”IBM Food Trust’s work with Sucafina, which manages a global green coffee supply chain, shows how sensors can trace food from the farm to the processing plant to the consumer. With the IBM Food Trust platform, Sucafina can track the origin of the beans used in a cup of coffee – a competitive differentiator to coffee drinkers eager to support fair-trade coffee roasters.ripe.io, one of Forbes’ 25 most innovative AgTech startups, is also tackling the challenges and complexities of the food supply chain.“Our secure blockchain platform creates a digital twin of food items, transparently aggregating foods’ journey in real-time, to provide a harmonized trustworthy platform for multiple stakeholders,” said Rachel Gabato, the company’s COO. The ripe.io blockchain-based platform collects data from various sensors – temperature, pressure, light, humidity and inertial MEMS sensors. Growers, distributors and end customers including sweetgreen – a U.S. restaurant chain that depends on fresh produce – use the information to trace the origin and quality of food.MSEC 2020Mark your calendar for next year’s MSEC, October 12-14, at Coronado Island Marriott Resort Spa in Coronado, Calif. Get updates from MSIG on MSEC and other upcoming events including MSTC 2020.Stay in Touch with MSIGMEMS Sensors Industry Group (MSIG), a SEMI Strategic Association Partner, is the industry association representing the global MEMS and sensors supply chain. To learn how MSIG enables professionals in the MEMS and sensors industry to innovate, address common challenges and accelerate business results, visit us today.Connect with MSIG on Twitter and LinkedIn. Subscribe to SEMI Blog: Technology and Trends.[1] Source: Status of the MEMS Industry report, Yole Développement, 2019Maria Vetrano is a public relations consultant at SEMI.

Stefano Zanella, Head of Automotive, Industrial and Location Businesses, TDK InvenSense will present at next month’s SEMICON Taiwan (September 18-20, 2019 in Taipei City, Taiwan). SEMI Taiwan’s Emmy Yi spoke with Stefano for a preview of his talk.SEMI: What macro market trends are driving automotive manufacturers to increase the variety and volume of MEMS sensors in cars?Zanella: The car world is changing. Consumers increasingly view car ownership as less desirable, yet the number of miles traveled and of hours spent in a car are rising steadily. At the same time, cars are changing profoundly, and the pace of change is rapid. To thrive in this new world, automakers are becoming transportation enablers and providers.Many vehicles today autonomously interact with humans and the world around them, operate with less or no human control, and are powered by electric batteries. MEMS sensors – which mimic and augment the five human senses – are front and center in these advancements.Unlike other types of sensors – such as cameras, radar and GNSS/GPSS – MEMS gyroscopes are functional in every environment. Gyroscopes, as well as accelerometers, can supplement those other sensors when they are not available and boost the accuracy of their outputs when they are available. Both camera stabilization and dead reckoning when GNSS is unavailable are good examples of the latter. Other prevalent sensors include MEMS microphones, used to capture voice commands, ultrasonic sensors, which can be leveraged for parking and gesture recognition, and fingerprint sensors, which can improve car security.SEMI: How can automakers stay competitive in this changing landscape?Zanella: Automakers can future-proof their relevance in the transportation market in several ways. By embracing consumer migration toward ride-sharing over car ownership, many are transforming from manufacturers to mobility providers. Carmakers that invest in ride-sharing and other modes of transportation (e.g., scooters) can sustain their profitability, even if the number of vehicles sold eventually shrinks or simply doesn’t grow as much as anticipated.Automakers will need to pursue new avenues of product differentiation. Traditionally, automakers have kept performance and aesthetics to themselves by owning the engine and the body design of the car, leaving nearly everything else to suppliers. Autonomous driving and electrification, however, are pushing automakers to own the battery pack and the autonomous driving software stack.While we are just beginning to see standardization in battery packs, automakers are likely to own the autonomous driving stack for many years to come. Automakers that offer cars with highly functional and efficient batteries and driving stacks stand to gain market share.Automotive infotainment systems will become increasingly crucial as autonomous driving turns everyone into a passenger. Audio subsystem providers such as Harman Kardon, Bose, and Bang Olufsen, for example, jockeyed for attention at the most recent Geneva Motor Show, demonstrating sophisticated surround-sound systems that rival premium-quality home audio setups.With more and more consumers using voice interfaces to interact with devices in the home, drivers are less willing to accept spotty accuracy in the car. Hence, automakers are using more higher-performing MEMS microphones to accurately capture voice commands. This will come as a relief to those of us who routinely yell at our steering wheels while using voice command to try to call home. Demand for higher quality infotainment systems has prompted some automotive OEMs to own the entire infotainment system and work directly with sensor and chipmakers, a level of intimacy that gives automakers a chance to tune sensor and chip development to their own needs. This tighter relationship also positions device suppliers to forge more direct links with drivers.SEMI: Which MEMS sensors are particularly important to tomorrow’s automobiles and why?Zanella: For many years the automotive industry has been integrating more electronics into cars to improve safety, advance the driver and passenger experience, and, more recently, power the car. As vehicles rely less on human control, automakers must replace the senses of the driver with something else. That something else is a bunch of sensors, microphones, cameras, radar and LIDAR to replace vision and hearing.Since MEMS sensors such as accelerometers, gyroscopes and pressure sensors are much more robust than other types of sensors to operate in snow, rain and darkness and other imperfect environments, automakers use them to ensure that the vehicle never gets lost when other sensors and/or the GPS/GNSS signal become unavailable in tunnels or urban canyons. Gyros help determine direction, accelerometers velocity and distance driven, and pressure sensors height, such as when taking a fork on a multi-level highway. At the same time, fingerprint sensors, ultrasonic parking sensors, and temperature sensors are improving convenience, safety and security for the car’s occupants. Automakers increasingly use inertial and environmental sensors, MEMS microphones, fingerprint sensors, and vision/imaging sensors to augment or replace the five human senses on which car drivers have relied for over 100 years. Source: TDK InvenSense SEMI: To what degree can MEMS sensors enable automotive security?Zanella: MEMS sensors are used widely to enhance security today. Some of their mechanisms are easy to understand while some are unexpected. For instance, ultrasonic fingerprint sensors can authenticate the driver of a vehicle to prevent car theft or something less onerous, like a teenage driver taking the car out without permission.Accelerometers and gyroscopes can prevent a new type of spoof on keyless entry systems. Imagine that you are very close to your vehicle. Your car senses the remote control in your pocket and automatically opens the doors when you pull the handle. Now suppose that your car is parked on the street, not far from your house. You leave the remote control home, and the car doesn’t sense the proximity of the remote control. Great! No one can enter your car, unless ... a thief has a big signal amplifier that makes your car think that the keyless entry device is next to the car. In this case, what can an automaker do? Add an accelerometer that restricts the keyless device from broadcasting the entry signal unless you are walking to the car with the device on your person.SEMI: What would you like SEMICON Taiwan attendees to take away from your presentation?Zanella: I would like them to embrace the transformations afoot in the automotive market as well as their associated design challenges since, by overcoming these hurdles, they can offer significant societal benefits such as safer and cleaner transportation. At the same time, these transformations mean significant opportunities for semiconductor industry revenue growth. And while design-to-delivery cycles in automotive are longer than in consumer and mobile, the automotive market supports higher-value devices as well as the chance to fold dozens of MEMS sensors into a single model.To paraphrase Lord Kelvin: If you can’t sense it, you can’t manage it. As suppliers of many key technologies that make intelligent transportation possible, the MEMS sensors industry is in an excellent position to help automakers manage the many challenges ahead.Stefano Zanella, Ph.D., is Head of Automotive, Industrial and Location Businesses at TDK InvenSense, where he brings MEMS sensors (including accelerometers, gyroscopes and microphones) and location solutions to the automotive and industrial markets. Zanella holds an MS and a Ph.D. in Electrical Engineering from the University of Padova, Padova, Italy as well as MBAs from both the UC Berkeley Haas School of Business and from Columbia University.He will present MEMS Sensors Enabling the Smart Car Revolution on Wednesday, September 18, 2019, at SEMICON Taiwan at 1F 4F, Taipei Nangang Exhibition Center, Taipei City, Taiwan. Register today and save 20% to learn how MEMS sensors are transforming the human experience with cars.Connect with Stefano Zanella at SEMICON Taiwan or via LinkedIn. You can also get more information on TDK’s automotive solutions and application guides online.Interested in engaging with the MEMS sensors supply chain? SEMI MEMS Sensors Industry Group is a technology community that enables professionals in the MEMS and sensors industry to innovate, address common challenges and accelerate business results.Emmy Yi is a marketing specialist at SEMI Taiwan.