CMOS image sensors

AEM Holdings Ltd, a Singapore-based multinational corporation, is listed in Forbes Asia’s 200 Best Under A Billion 2019 and 2020 spotlighting small and midsized companies in the Asia-Pacific region with sales under $1 billion. AEM clinched the Singapore Business Review Technology Excellence Award 2020 for Analytics-Semiconductor and the Singapore Business Awards Enterprise Award 2019/2020. These achievements are testament to AEM’s vision and innovation and the company’s contributions to the increasingly complex testing of chips in a rapidly evolving technological world. I spoke with AEM CEO Chandran Nair, a new Regional Advisory Board (RAB) member of SEMI Southeast Asia, about the company’s intelligent test and handling solutions, its role in digital transformation, the company’s key role in the smart manufacturing movement and the growth prospects for Singapore’s electronics sector. SEMI: AEM’s application-specific, intelligent system test and handling solutions for semiconductor and electronics companies serve the advanced computing, 5G and AI markets. How do you differentiate your solutions from those offered by competitors? Nair: A key differentiation for AEM is that we work closely with our customers to develop application-specific integrated test and handling solutions that meet their needs in a scalable manner from lab to production. We offer our customers customized, full-stack test and handling solutions that give them the agility to accelerate their delivery cycles and enhance product quality. Over the years, AEM has developed and acquired world-class technologies in instrumentation, test, automation, robotics, optical inspection, high-end thermal control, and software. These technology pillars, along with our deep know-how to customize test and handling solutions using the technology pillars as a platform, enable AEM to meet the fast-changing needs of our customers faced with the challenges of testing heterogeneous and complex devices. In addition to investing in technology, AEM has also invested in delivering application-specific solutions to meet customer demand. Our recently announced acquisition of CEI with its manufacturing capabilities in Vietnam and its specialization in low-volume, high-mix manufacturing increases our geographical reach and our ability to quickly turn application-specific test and handling solutions to be deployed. We have a unique and differentiated approach that enables our customers to test high-performance computing devices, automotive devices, and mobility devices with maximum test coverage, cost-effectively, in a manufacturing environment. Our experience in serving the high-performance computing market that traditionally drives advancements in thermal control also puts us at the forefront of delivering comprehensive thermal management, vision, and deep automation and test solutions for the computing, automotive, and mobility markets. AEM also has a strong instrumentation portfolio, including high-density digital instruments and mixed-signal and protocol-aware instrumentation that is well-suited for ATE solutions for SoC, high-power devices, and CMOS image sensors. Over the last few years, we have also established leadership positions in developing and deploying application-specific test solutions for MEMS devices and offering wafer and frame probing stations suitable for R D, wafer sort, and final test. We form strong partnerships with our customers, provide them with end-to-end support in product development, and take them through the entire life cycle process from concept to mass production. Chandran Nair and Goh Meng Klang, vice president of operations, at the AEM manufacturing site in Singapore. (Photo credit: AEM) SEMI: Digital transformation is powering strong growth of advanced computing, 5G and AI. Will AEM be expanding its AEM manufacturing plants in China, Malaysia and Singapore to meet rising demand for these technologies in the coming years? Nair: In regards to manufacturing, AEM currently has manufacturing facilities in Singapore, Malaysia, the U.S., Finland, and China. With our recently announced acquisition of CEI, we will add manufacturing capability in Vietnam and Indonesia. AEM will continue to expand manufacturing appropriately to give our customers cost-effective solutions while maintaining our proven track record of delivering on time and scaling rapidly in times of crises like the pandemic or geopolitical disruptions. As for advanced technologies, the three key factors that will bring the full potential of 5G to fruition are 1) cost-effective, high-powered processing devices at the edge, 2) easy access to high-bandwidth communications, and 3) cost-effective sensor technology. Semiconductors are the primary drivers of these three key success factors. As devices become more complex and our reliance on semiconductor-powered devices in all aspects of our lives deepens exponentially to include mission-critical applications, AEM’s role is to ensure that our customers' electronic and semiconductor devices are shipped thoroughly tested, safe to use, and highly reliable. It is imperative that, as a testing company, we find innovative ways to help our customers test their products with maximum coverage and minimum cost. To do this, we are focusing our R D efforts and investments to continue building on our key technology pillars to ensure that we stay ahead of the curve when it comes to test and handling solutions. We prepare our customers to test increasingly complex devices manufactured on the latest process node. SEMI: During your career you’ve driven projects in test and automation and more recently robotics solutions for ports, logistics warehouses and transport. With robotics and automation a key part of Industry 4.0, what role do AEM solutions play in powering the smart manufacturing movement? Nair: The smart manufacturing movement is powered by semiconductors, software and increasingly by artificial intelligence (AI). Test is at the heart of the process of ensuring that semiconductor and electronics devices reach the consumer well-tested for reliability. With our vision of enabling A Zero Failure World, AEM addresses the necessity for safe, highly reliable devices. The semiconductor companies themselves are adopting smart manufacturing methods. AEM’s tools are Industry 4.0-ready, and we continue to invest in machine learning and data analytics, which are integral to the future of test. Our tools are automated and feature embedded sensors to provide our customers with data about tool usage, the state of a machine’s health, and more. Our tools are connected to our customers’ manufacturing automation platforms. Additionally, we continue to invest in our ability to better slice and dice test data to understand trends and patterns to help our customers analyze data and make decisions faster. SEMI: You also have experience heading autonomous vehicle projects. With the COVID-19 pandemic hastening digital transformation, do you see an acceleration in the development of fully autonomous vehicles and smart manufacturing? Research and development efforts for autonomous vehicles (AV) continue at a fast pace worldwide. With shutdowns and restricted movement rules globally, the pandemic has hastened digital transformation in many ways. The delivery of goods and services is transforming, and AV will surely play a part, especially in secure environments for autonomous transport. The pandemic has accelerated the development of autonomous vehicles and smart manufacturing technology in automation-friendly environments like factories and ports. SEMI: At the recent Global Technology Summit hosted by SEMI, you spoke about testing innovations to meet the demands of highly complex devices. Please elaborate on innovative testing solutions versus traditional testing? Nair: AEM offers a disruptive and differentiated solution, one that is driving a paradigm shift to asynchronous, modular, highly parallel, smart testing solutions. ​ The traditional approach of ATEs to test increasingly complex devices on advanced nodes has reached a point of diminishing returns as it gets exponentially more expensive to increase test coverage to acceptable levels. Additionally, as devices get more complex and companies are rapidly adopting heterogeneous packaging technologies, the realization that System Level Test (SLT) is necessary is forcing a rethink of the entire test process. AEM’s provides asynchronous, modular, highly parallel test cell solutions that enable each test cell to run SLT, final test, or burn-in all in one system and its ability to handle hundreds of test cells independently with each test cell testing multiple devices. Our solutions suddenly make comprehensive testing of every complex device cost-effective. Freeing us from legacy ATE allows AEM to provide these innovative solutions to our customers. AEM engineering and manufacturing teams in Singapore at work on semiconductor test and handling systems for global deployment at world-class semiconductor facilities. (Photo credit: AEM) SEMI: Singapore seems to be in the sweet spot of digital transformation. Singapore’s industrial production grew 8.6% year-over-year in January 2021, an expansion driven mainly by a surge in sectors including electronics, and more growth is seen in the year ahead. Digital technologies such as 5G technology and cloud computing together with continued demand for work-from-home equipment is behind this growth. What are the growth prospects for the region’s electronics sector? Nair: Singapore is well-poised to benefit from the current digital transformation accelerated by the adoption of these technologies during the pandemic. Being a safe, well-governed country with strong IP protection, excellent infrastructure, and the rule of law, Singapore is in a great position to play a central role in cloud-based services, 5G, and the semiconductor industry. Singapore’s semiconductor sector output is at a record high, and the prospects for renewed growth in the region are very good. SEMI: As a new Regional Advisory Board member of SEMI Southeast Asia, how is your industry experience relevant to the scope of this role? What opportunities lie ahead for the region? Nair: I am honored to represent AEM in the SEMI’s Southeast Asia RAB. The SEMI RAB can influence policymakers with ideas and information on the current and future needs of the industry. I also believe that SEMI Southeast Asia can cultivate a strong innovative semiconductor ecosystem that helps regional and global growth. I look forward to working with other very experienced and accomplished board members. Bee Bee Ng is president of SEMI Southeast Asia.

Japan’s semiconductor industry has weathered the COVID-19 pandemic to post robust growth. Far from a temporary setback, COVID-19 will lead to enduring change in how we work and live. And just as automation has been a bulwark against the devastating business impacts of the virus outbreak, increasing digitization will lead to new efficiencies in our industry.These were some of the key takeaways from three SEMI Japan Members Day webinars in June and July that offered the latest updates on COVID-19 impacts to the semiconductor industry and restart strategies for SEMI members. More than 2,000 SEMI members across Japan’s islands attended the webinars featuring the following five speakers: Hideki Kanewaka, Marketing Director, Consulting Lead, Japan, Accenture Japan Ltd. Takayuki Komori, Manager, Marketing Engineering Dept, SUMCO Corporation Taketoshi Hamaguchi, Director, Manufacturing Industry, Microsoft Corporation Akira Minamikawa, Senior Consulting Director, OMDIA (Informa Intelligence LCC) Yuichi Koshiba, Managing Director Partner, Boston Consulting Group COVID-19 Impact on Japan Semiconductor Industry is ModestThe consensus view of the five speakers from various quarters of the industry – consultant, IT service provider, materials supplier, market analyst – was that the Japan semiconductor industry withstood the heavy blows COVID-19 dealt to other industries thanks to strong demand for chips. Shelter-in-place policies and lockdowns spawned by COVID-19 has accelerated the digital transformation rippling around the world as electronics sales have soared to support everything from remote work and education to healthcare and home entertainment including gaming.The rapid growth of cloud usage for video streaming, gaming and remote work is taxing communications network capacity and placing more bandwidth demands on servers, said Akira Minamikawa of OMDIA. According to a recent report by Nokia, communications network traffic has skyrocketed 300 percent for online meetings and 400 percent for gaming, bringing the networks closer to their capacity limits. Minamikawa sees server shipments increasing at 8 percent CAGR through 2024. For the broader chip market, he expects demand for notebooks, solid state and hard disk drives, and gaming to remain strong in 2020. He also predicts rapid 5G penetration for smartphones will boost semiconductor chip industry growth.Still, not all semiconductor segments are expanding, said Yuichi Koshiba of Boston Consulting Group. Chip shipments for end products in markets such as automotive, industrial equipment and aircrafts are on the decline. Slowing demand for chips that power automotive applications in particular could pare sales for some chip companies and distributors since the segment accounts for a high proportion of their overall revenue.State of the Semiconductor IndustryFrom SUMCO’s vantagepoint as a major silicon wafer supplier, the company’s Takayuki Komori sees a number of changes unfolding in the semiconductor industry: Smartphones are driving growing demand for process technology (smaller nodes) and 300mm wafers. Komori estimates the typical high-end smartphone sports 1,700 square millimeters of silicon. 300mm wafers account for 80 percent of that total while more than 50 percent of the devices use leading edge multi-patterning technologies. Smartphones will need more RF chips to support 5G’s high-speed communications and added frequency ranges. Substrates for RF switches and tuners have been shifting from gallium arsenide (GaAs) and other compound semiconductors to silicon. 5G smartphone penetration will accelerate as the cost of integrating CPUs and modem functions into a single chip sees a swift decline. While the sensitivity and resolution of CMOS image sensors have evolved to incorporate innovative backside illumination and stacking technologies, future advances will focus more on products for machine vision applications capable of sensing invisible light bands. Rising adoption of electric vehicles and robotics applications will drive growing demand for power semiconductors that control their motors such as IGBTs and MOSFETs as the production capacity for the devices expands and shifts to 300mm wafer lines. For memory fabs, Minamikawa said utilization remains high as a result of a spending slowdown by major chip manufacturers and will stay elevated even once additional capacity ramps to support robust demand. Foundry fab utilization also remains high despite the pandemic-driven cancellation of smartphone chip orders in March. Minamikawa also sees the utilization rate of micro rising with the surge in demand for notebooks, PCs and servers in the second half of 2020.Transition to New NormalAs people around the world start to settle into new ways of living and working, there’s a growing acceptance that the transformation will be long-lasting. And no area of people’s lives is changing more than their work. Boosted by government subsidies, many small and midsize companies in Japan have started to implement work-from-home policies, an area where major electronics and IT businesses had already instituted reforms, said Hideki Kanewaka of Accenture. A few examples: Nippon Telegraph and Telephone Corporation (NTT) announced that half of its employees will continue to work from home in the future. A five-year plan Toshiba launched in 2019 to allow all employees to work from home will likely accelerate. Hitachi plans to allow all employees to work from home starting in April 2021. dwango, a major internet-based entertainment company in Japan, announced it will allow in principle any employees to work remotely. In the critical area of remote sales, Kanewaka pointed to the importance of going beyond online business meetings, paperless transactions and virtual events to devise new ways to attract customers and close deals. Creating online communities and providing rich digital content are also important measures to consider, he said.Manufacturing's Digital TransformationTravel restrictions by most countries to curb the COVID-19 outbreak have also raised barriers to chip companies sending engineers overseas sites to service state-of-art equipment and provide other technical support. Microsoft’s remote assist system deployed by ASML is one tool semiconductor makers can use to overcome this challenge, said Taketoshi Hamaguchi of Microsoft.The system connects a remote equipment service expert with an onsite worker through the internet, allowing the technical expert to provide support through a goggle display with a camera worn by the worker. Guided by the expert, the worker can perform complex services. A Natural User Interface (NUI) helps give the factory worker a clear understanding of the often highly technical instructions.Using artificial intelligence (AI) to increase automation will also help reduce the reliance of semiconductor factories on onsite workers. For example, AI deep learning can be deployed to calibrate equipment autonomously and reduce downtime after scheduled maintenances, Hamaguchi said.Corporate Restart Strategies Beyond factory considerations tied to COVID-19, semiconductor companies will need to adapt their business strategies to new ways of operating. For example, global supply chains will shift to domestic sources and increase redundancy to ensure a steady supply, a change leading to higher overall costs, Koshiba said. Trade routes among regions will also be redrawn as the trade rift between the United States and China and other geopolitical tensions intensify. The total value of those routes is expected to recover by 2023.Koshiba advised companies to evaluate the supply chain trade-offs between stability and cost and factor in potential risks to improve their short-term resilience and drive mid- to long-term supply chain restructuring.After past recessions, 14 percent of companies restored sales growth, Koshiba said. He recommended investing aggressively in growth and seizing M A opportunities during the downturn. Chip companies must also adapt to supply chain changes faster than competitors.Become a SEMI MemberWebinars like the recent SEMI Japan Members Day series have become increasingly important in the mix of programs and services SEMI offers members to help them connect, collaborate and innovate in the microelectronics community. To become a SEMI member, please visit the SEMI website or contact your nearest SEMI office.Jim Hamajima is president of SEMI Japan.

Part 2 of 2-part series on MSEC 2019 highlights. Read Part 1. Neural Networks on ChipTo be sure, low power is king when bringing machine learning to the sensor edge. Battery-powered, always-on sensing devices require it since frequent recharging is the death knell of any electronic product. That’s why semiconductor companies are offering new ways to conserve power.“MEMS sensor suppliers have made significant strides in the power, size and performance of their devices,” said Aspinity CEO Tom Doyle. “Yet these gains deliver only incremental power improvements to the system.”Doyle advocates a new architectural model that uses an analog neuromorphic processor to analyze all sensor data at the start of the signal chain instead of sending it downstream so power-hungry chips such as DSPs can digitize it before analysis.“The technology industry wants to take advantage of the many benefits of always-on sensing applications,” said Doyle. “Before we can reach mass proliferation, however, we need to resolve the power issues that are deal-breakers for some applications. We believe the answer to this challenge is architectural. All the data gathered by always-on sensing systems is analog in nature, yet as soon as it’s captured, it’s digitized immediately for analysis. Determining which data is important up front eliminates the digitization and processing of irrelevant data so that voice-first devices such as smart speakers and wearables/hearables can run for long periods of time without requiring battery recharge.”Syntiant CTO Jeremy Holleman agreed that on-device intelligence is the future.“Did you just fall? Is your heartrate a bit off? Deep learning provides a toolset that yields vastly superior decisions,” said Holleman. “The problem is that deep learning is computationally intensive. The answer is a neural network that performs on-device edge inferencing.”Holleman added that Syntiant’s neural decision processor was recently certified as Amazon Voice Service (AVS)-compliant for wake-word detection, making it easier to design voice control in battery-powered devices such as earbuds and wearables.MSEC Technology Showcase WinnerWith the groundswell of interest in intelligence at the edge, it was no surprise that Cartesiam won top honors among all competitors in the MSEC Technology Showcase for its NanoEdge AI, software that brings AI to the edge of the signal chain, making it easier for designers to create intelligent objects that can learn and understand.“Unlike other AI algorithmic technologies for sensing devices, NanoEdge enables both learning and inference at the edge, providing accurate and adaptive intelligence,” said Cartesiam Managing Director and Co-founder Marc Dupaquier, who accepted the award. “It’s also the only tool of its kind that does not require data scientists on board for implementation, which saves a tremendous amount of money. Our clients can build a machine learning library and embed it into their own code within weeks to realize the same caliber of unsupervised neural network that was once the exclusive domain of AI cloud vendors.”MSIG 2019 Hall of FameAt this year’s conference, MSIG Director Carmelo Sansone recognized two longtime contributors to the commercialization of MEMS and sensors: Peter G. Hartwell, Ph.D., chief technology officer at InvenSense, a TDK group company; and Thomas Kenny, professor and senior associate dean of engineering at Stanford University.Hartwell leads technology strategy and the InvenSense advanced technology research group. He has more than 25 years’ experience commercializing silicon MEMS products, including advanced sensors and actuators, and developing MEMS testing techniques.Kenny’s academic accomplishments include authoring or co-authoring more than 250 scientific papers and holding 50 issued patents. He has also advised more than 50 graduated Ph.D. students from Stanford.MSEC 2020Mark your calendar for next year’s MSEC, October 12-14, at Coronado Island Marriott Resort Spa in Coronado, Calif. Get updates from MSIG on MSEC and other upcoming events including MSTC 2020.Stay in Touch with MSIGMEMS Sensors Industry Group (MSIG), a SEMI Strategic Association Partner, is the industry association representing the global MEMS and sensors supply chain. To learn how MSIG enables professionals in the MEMS and sensors industry to innovate, address common challenges and accelerate business results, visit us today.Connect with MSIG on Twitter and LinkedIn. Subscribe to SEMI Blog: Technology and Trends.Maria Vetrano is a public relations consultant at SEMI.

SEMI spoke with Dr. Mikko Söderlund, sales director for Beneq’s semiconductor business, about trends in Atomic Layer Deposition (ALD) applications. Söderlund shared his views ahead of his presentation at SEMI MEMS Imaging Sensors Summit, 25-27 September, 2019, at the WTC in Grenoble, France. Join us at the event to meet Beneq and other key industry influencers. Registration is open.SEMI: The Backside Illuminated (BSI) CMOS Image Sensors (CIS) market continues to experience steady growth. Which applications are currently driving market growth?Söderlund: BSI CMOS Image Sensor market continues to be driven by mobile, security, automotive and Internet of Things (IoT) applications – so there seems to be plenty of opportunities for BSI CIS market to grow further.SEMI: What is critical for advanced thin-film deposition methods to extract best electrical performance?Söderlund: It is critical to control the material properties of the deposited layer (such as charge density, resistivity or barrier property) and of course, film uniformity and conformality. Furthermore, controlling material interfaces is also important, especially for sensitive III-V materials. {% video_player "embed_player" overrideable=False, type='scriptV4', hide_playlist=True, viral_sharing=False, embed_button=False, width='350', height='197', player_id='12721134435', style='margin: 0px auto; display: block; float: right; margin-left: auto; margin-right: auto; width: 350px;' %} Coatings and material features based on existing standard techniques can be very expensive, or not feasible at all. What does Atomic Layer Deposition (ALD), as a thin film coating method, offer in particular?Söderlund: ALD offers dense, highly conformal and pinhole-free best-in-class functional layers for dielectrics, passivation, encapsulation and much more. As a gentle and precise layer-by-layer method, ALD is extremely well-suited for deposition of such performance critical layers over large surface areas such as a cassette of wafers.SEMI: Please describe the Atomic Layer Deposition (ALD) coating process. Söderlund: ALD is based on a self-limiting surface reaction controlled thin film deposition. During coating, two or more chemical vapors or gaseous precursors react sequentially on the substrate surface, producing a solid thin film (see schematic below). Most ALD coating systems use a flow-through traveling wave setup, where an inert carrier gas flows through the system and precursors are injected as very short pulses into this carrier flow. The carrier gas flow takes the precursor pulses as sequential waves through the reaction chamber, followed by a pumping line, filtering systems and, eventually, a vacuum pump.SEMI: What are the two leading edge ALD applications?Söderlund: Today’s leading-edge ALD applications are in logic (high-k/metal gate, multiple patterning) and memory (DRAM capacitor, 3D NAND). Within the More-than-Moore (MtM) markets, CIS and MEMS (actuators and sensors, RF) have been early adopters of ALD, and we also see ALD being introduced in GaN Power and RF, as well as photonics.SEMI: Give us one prediction about the opportunities offered by advanced imaging applications.Söderlund: The large diversity of imaging applications will continue to drive growth and innovation. For example, machine vision is expected to transform the imaging landscape. We see this as a big opportunity for advanced thin-film deposition methods such as ALD, provided that the tools are versatile enough to address the diverse manufacturing requirements.SEMI: What are your expectations for SEMI MEMS Imaging Sensors Summit and why do you invite your peers to attend? Söderlund: The summit brings together all key RF stakeholders in the MEMS and imaging sensors industry, and we are looking forward to a great event. It’s a special event for us as we are officially launching a new ALD cluster tool product specifically engineered for the MtM applications – so this brings great excitement that we want to share with the attendees.Dr. Mikko Söderlund is Sales Director for Beneq’s semiconductor business. He has more than 20 years of experience in product development, product management, technical sales and business development across the photonics, OLED, and semiconductor industries. Mikko received his Ph.D. in Micro- and Nanotechnology from the Helsinki University of Technology. Serena Brischetto is a marketing and communications manager at SEMI Europe.

2017 was a good year for the MEMS and sensors business, and that upward trend should continue. We forecast extended strong growth for the sensors and actuators market, reaching more than $100 billion in 2023 for a total of 185 billion units. Optical sensors, especially CMOS image sensors, will have the lion’s share with almost 40 percent of market value. MEMS will also play an important role in that growth: During 2018–2023, the MEMS market will experience 17.5 percent growth in value and 26.7 percent growth in units, with the consumer market accounting for more than 50 percent(1) share overall. Evolution of SensorsSensors were first developed and used for physical sensing: shock, pressure, then acceleration and rotation. Greater investment in R D spurred MEMS’ expansion from physical sensing to light management (e.g., micromirrors) and then to uncooled infrared sensing (e.g., microbolometers). From sensing light to sensing sound, MEMS microphones formed the next wave of MEMS development. MEMS and sensors are entering a new and exciting phase of evolution as they transcend human perception, progressing toward ultrasonic, infrared and hyperspectral sensing.Sensors can help us to compensate when our physical or emotional sensing is limited in some way. Higher-performance MEMS microphones are already helping the hearing-impaired. Researchers at Arizona State University are among those developing cochlear implants — featuring piezoelectric MEMS sensors — which may one day restore hearing to those with significant hearing loss. The visually impaired may take heart in knowing that researchers at Stanford University are collaborating on silicon retinal implants. Pixium Vision began clinical trials in humans in 2017 with its silicon retinal implants.It’s not science fiction to think that we will use future generations of sensors for emotion/empathy sensing. Augmenting our reality, such sensing could have many uses, perhaps even aiding the ability of people on the autism spectrum to more easily interpret the emotions of others.Through my years in the MEMS industry, I have identified three distinct eras in MEMS’ evolution: The “detection era” in the very first years, when we used simple sensors to detect a shock. The “measuring era” when sensors could not only sense and detect but also measure (e.g., a rotation). The “global-perception awareness era” when we increasingly use sensors to map the environment. We conduct 3D imaging with Lidar for autonomous vehicles. We monitor air quality using environmental sensors. We recognize gestures using accelerometers and/or ultrasonics. We implement biometry with fingerprint and facial recognition sensors. This is possible thanks to sensor fusion of multiple parameters, together with artificial intelligence. Numerous technological breakthroughs are responsible for this steady stream of advancements: new sensor design, new processes and materials, new integration approaches, new packaging, sensor fusion, and new detection principles.Global Awareness SensingThe era of global awareness sensing is upon us. We can either view global awareness as an extension of human sensing capabilities (e.g., adding infrared imaging to visible) or as beyond-human sensing capabilities (e.g., machines with superior environmental perception, such as Lidar in a robotic vehicle). Think about Professor X in Marvel’s universe, and you can imagine how human perception could evolve in the future! Some companies envisioned global awareness from the start. Movea (now part of TDK InvenSense), for example, began their development with inertial MEMS. Others implemented global awareness by combining optical sensors such as Lidar and night-vision sensors for robotic cars. A third contingent grouped environmental sensors (gas, particle, pressure, temperature) to check air quality. The newest entrant in this group, the particle sensor, could play an especially important role in air-quality sensing, particularly in wearable devices.Driven by increasing societal concern over mounting evidence of global air-quality deterioration, air pollution has become a major topic in our society. Studies show that there is no safe level of particulates. Instead, for every increase in concentration of PM10 or PM2.5 inhalable particles in the air, the lung cancer rate is rising proportionately. Combining a particle sensor with a mapping application in a wearable could allow us to identify the locations of the most polluted urban zones.The Need for Artificial Intelligence To realize global awareness, we also need artificial intelligence (AI), but first, we have challenges to solve. Activity tracking, for example, requires accurate live classification of AI data. Relegating all AI processing to a main processor, however, would consume significant CPU resources, reducing available processing power. Likewise, storing all AI data on the device would push up storage costs. To marry AI with MEMS, we must do the following: Decouple feature processing from the execution of the classification engine to a more powerful external processor. Reduce storage and processing demands by deploying only the features required for accurate activity recognition. Install low-power MEMS sensors that can incorporate data from multiple sensors (sensor fusion) and enable pre-processing for always-on execution. Retrain the model with system-supported data that can accurately identify the user’s activities. There are two ways to add AI and software in mobile and automotive applications. The first is a centralized approach, where sensor data is processed in the auxiliary power unit (APU) that contains the software. The second is a decentralized approach, where the sensor chip is localized in the same package, close to the software and the AI (in the DSP for a CMOS image sensor, for example). Whatever the approach, MEMS and sensors manufacturers need to understand AI, although they are unlikely to gain much value at the sensor-chip level.Heading to an Augmented WorldWe have achieved massive progress in sensor development over the years and are now reaching the point when sensors can mimic or augment most of our perception: vision, hearing, touch, smell and even emotion/empathy as well as some aesthetic senses. We should realize that humans are not the only ones to benefit from these developments. Enhanced perception will also allow robots to help us in our daily lives (through smart transportation, better medical care, contextually aware environments and more). We need to couple smart sensors’ development with AI to further enhance our experiences with the people, places and things in our lives.About the authorWith almost 20 years’ experience in MEMS, sensors and photonics applications, markets, and technology analyses, Dr. Eric Mounier provides in-depth industry insight into current and future trends. As a Principal Analyst, Technology Markets, MEMS Photonics, in the Photonics, Sensing Display Division, he contributes daily to the development of MEMS and photonics activities at Yole Développement (Yole). He is involved with a large collection of market and technology reports, as well as multiple custom consulting projects: business strategy, identification of investment or acquisition targets, due diligence (buy/sell side), market and technology analyses, cost modeling, and technology scouting, etc.Previously, Mounier held R D and marketing positions at CEA Leti (France). He has spoken in numerous international conferences and has authored or co-authored more than 100 papers. Mounier has a Semiconductor Engineering Degree and a PhD in Optoelectronics from the National Polytechnic Institute of Grenoble (France).Mounier is a featured speaker at SEMI-MSIG European MEMS Sensors Summit, September 20, 2018 in Grenoble, France. (1) Source: Status of the MEMS Industry report, Yole Développement, 2018