virtual reality

The latest MEMS and sensors advancements in markets ranging from displays to biotech and in key areas of manufacturing including sensor devices and fabrication came into sharp focus at the 2022 MEMS & Sensors Technical Congress (MSTC) in late April as 120+ industry experts gathered in Berkeley, CA.

Azeez Bhavnagarwala, Metis’ founder and CEO, speaks about advanced CMOS Memory and Arithmetic component intellectual property (IP) to improve energy efficiency and performance of processors.

Jack McCauley understands the interplay between video game hardware and human interaction like few others in the industry. He designed the guitar and drums for Red Octane’s (later Activision’s) Guitar Hero video game series. As co-founder and chief engineer of Oculus VR, he designed the Oculus DK1 and DK2 virtual reality (VR) headsets and helped guide the company through its acquisition by Facebook in 2014. Now active in automotive technology, he builds cars at Black Lab, his private R D facility and hardware incubator in Livermore, California. And, in no small feat, he thinks he’s solved the head-tracking problems in augmented reality (AR)/VR headsets – which he’ll demonstrate during his keynote presentation, MEMS Applications in Augmented Reality, October 6 at MSEC 2020. SEMI’s first virtual MEMS Sensors Executive Congress. The event is October 6-8 and 13-15, 2020, and registration is open. I interviewed McCauley to preview his presentation. Register now for MSEC 2020.SEMI: What inspired you to become the first person to use a MEMS sensor in a gaming device?McCauley: When I started designing the Guitar Hero peripherals, I had intermittent problems with the motion tracking. I switched to a Freescale single-axis accelerometer, developed some IP around it, and that fixed the problem. That’s how I became an early customer of MEMS. SEMI: When you pioneered immersive VR gaming experiences at Oculus VR, tech industry analysts predicted widespread adoption of VR for gaming. What do you think happened?McCauley: There are a lot of reasons why VR hasn’t become the standard bearer for gaming. Gaming used to be a solitary activity, but as companies like Microsoft and Sony got behind multiplayer gaming, we realized many gamers found the social aspect more important than the visual aspect. Many gamers are content to play on a 2D screen or on multiple monitors because they’re playing against many people. The proliferation of internet connections worldwide has also promoted the kinship and social aspect of gaming.SEMI: Do you think VR has a place in other applications?McCauley: I think it has a lot of potential in real estate, VR movies, and engineering and design, among other areas. The automotive designer Henrik Fisker, for example, created whole vehicles in a game-engine model. If you wanted to buy one of his cars, let’s say, you could change the color and upholstery, for example, and then view it in a VR environment. SEMI: One of the biggest obstacles to VR adoption is the motion sickness some people experience during game play. What would you do to fix that?McCauley: The vestibular system in the brain, which uses the inner ear, is crucial to helping you balance. If there’s a mismatch between what your eyes see and your brain is perceiving, you’re likely to feel dizzy. I’ve built a VR headset that uses a MEMS pico projector with micromirrors and a small laser for position tracking as well as for facial tracking and modeling. But the platform’s not for sale.Still, many of the technical advances that we’ve made in VR are helping us with AR development. The increasing power of mobile chipsets and GPUs, the decreasing geometry for individual transistors and the way specific chips are processed, screen interfaces that will drive a 4K panel at a high frame rate, plus MEMS devices inside the eyewear for rotations and tracking are all helpful innovations.SEMI: When designing cars in your own lab, you’re doing a lot of work with AR. What do you think of AR’s commercial viability?McCauley: I know there are well-funded AR programs in place at major companies. That’s because mobile-device companies want an omnipresent phone in front of your face. I thought Google Glass, for example, was brilliant, but it was way too early for that product, and there was too much hype behind it.McCauley's latest R D project is a vehicle that incorporates augmented features and a computerized display. The vehicle is a custom built, environmentally friendly super-car with enhanced driver safety and high vehicle performance. AR is appealing because it lets people see through a screen – and have objects appear on that screen – while they are moving through space. My son actually came up with one of the ideas I’m implementing in a car I’m designing. We were driving in Spain, and he suggested that instead of using Google Maps to show me driving directions – which would force me to look down at an infotainment display – a sign could appear on AR glasses that would instruct me how to drive to Italy. That’s just an example of how we’ll use AR. SEMI: After you sold Oculus VR to Facebook, you began investing time and resources into engineering education. Why did you make that choice?McCauley: I’m originally from a blue-collar family, and then I got an education at Berkeley. That made a major difference in my life. When I sold Oculus, I donated to education-focused charities primarily, because an education can lift an entire family out of poverty. Let’s say your family are farm workers, but you get a degree in engineering and land a job at Apple. That could produce a ripple effect. As other members of your family and people in your community see the benefits of your education, they’re more likely to get an education, too. SEMI: What would you like MSEC attendees to take away from your presentation?McCauley: I appreciate what the MEMS industry has done for VR because if Oculus didn’t have a nine degrees of freedom (9DoF) IMU, no one would have bought our company. A new application will come along sooner or later that will require a different type of MEMS technology, and I have total confidence that the MEMS industry will deliver what’s needed. For more information on McCauley’s R D projects or on his position as Innovator in Residence at UC Berkeley’s Jacobs Institute for Design Innovation, visit his website. MEMS Sensors Industry Group® (MSIG), a SEMI technology community that connects the MEMS and sensors supply network in established and emerging markets, enables members to grow and prosper. Visit us today.Jack McCauley is an Innovator in Residence at the Jacobs Institute for Design Innovation, where he mentors students, lectures in courses focused on product design and design for manufacturing, and leads research and development projects focused on applications of augmented, virtual, and mixed reality for design professionals and students.McCauley graduated from Berkeley Engineering with a B.S. in Electrical Engineering and Computer Science in 1986, and credits the time he spent at Berkeley as an undergraduate with helping to ignite his career. Maria Vetrano is a public relations consultant at SEMI.

In 2000, the average car sported 30 to 50 semiconductors. By 2025, the number of chips and sensors in an automobile will soar to an eye-popping 70,000 as it comes uber-connected and immeasurably smarter, powered by machine learning, artificial intelligence (AI), Internet of Things (IoT), visual sensing, high-precision mapping and other advanced capabilities.Today, the proliferation of semiconductors in cars is remaking the automotive industry as four major forces – electrification, connectivity, autonomous driving and diverse mobility – take hold, according to the consultancy firm McKinsey in its report Automotive Revolution – Perspective towards 2030 report. The chip industry saw auto-related sales jump from US$7 billion in 1995 to US$30 billion in 2015, a trajectory that has steepened over the past two years as major chip suppliers have rolled out products for precision mapping, navigation, in-car entertainment, and communications. With semiconductors fast becoming a major aspect of automotive design, traditional automakers are quickly moving to build strong partnerships with the semiconductor sector.Audi, a leading German car brand, took a big step to just that when it became the first automotive OEM to join SEMI as a member in June 2019 and strengthen the automaker’s ties to the semiconductor industry. With a massive market potential to tap, are Taiwan's auto electronics firms well-positioned to work even more closely with first-tier car brands like Audi?At the Smart Transportation Forum on September 18 at SEMICON Taiwan, Andre Blum, project manager at AUDI AG, will join Ian Chan, CTO of Cyntec, to offer insights into how automakers can team up with Taiwanese auto electronics companies. TechOrange, a Taiwanese tech news online media, spoke Blum ahead of the event about Audi's smart car efforts and the carmaker’s work to integrate new technologies into its automotive designs as it forms new partnerships with the semiconductor industry.Blum joined Audi in 2004 and since 2016 has led manifold projects within the group driving Audi’s work with semiconductor companies (Progressive Semiconductor Program). He has seen the automotive industry rapidly accelerate the integration of high technology in vehicles, an area where Audi excels. “The industry is changing how it works and new partners are joining the ecosystems," Blum said.Audi Wants to be the Next Apple in the Car SectorAudi's business developments in recent years echo Apple's early push to integrate the Internet and a panoply of applications into mobile phones. The difference now is Audi is working to integrate a wide range of smart applications into its automobiles for – ala Apple – the best user experience.For example, Audi has recently launched cars designed with Traffic Jam Pilot, Parking Pilot, and Garage Pilot three smart driver-assisting systems. With Traffic Jam Pilot, drivers no longer need to be on standby when stuck in the traffic. Instead, they can kill time with an infotainment system. While out shopping or making other stops, Parking Pilot helps drivers find a parking spot and park automatically. Garage Pilot provides a more comfortable parking-at-home experience – the driver waits maneuvers the car into the garage using handheld remote control. Audi stepped up its efforts in 2019 and revealed its latest concept car at the Shanghai Auto Show. Dubbed Audi AI:ME, the vehicle is equipped with a dizzying array of high tech: level-four self-driving technology, technology that allows the driver to control features with eye movements, LED units in headlights and taillights that change brightness accordingly at night and in bad weather, and VR goggles for onboard infotainment. Innovation and Tech Both Key to the New Driving ExperienceAutomotive technology is rapidly advancing in areas such as electric vehicles, autonomous driving and smart auto electronics. Cars of the future must have more computing power and connectivity to deliver a great user experience that includes high battery efficiency to extend the duration between recharges, in-car entertainment, and intelligent voice assistants – all capabilities made possible by semiconductors.Unburdened by the tasks of driving, passengers will enjoy a more intimate relationship with their vehicles. "The in-car entertainment system will allow passengers to have a teleconference or enjoy a movie in a theater-like setting,” Blum said. Switch on the self-driving system and you can drive through the night from Munich to Hamburg, covering a distance of 800 kilometers in the comfort of a home-like environment. The trip is even possible on one charge, meeting high energy-saving standards.These capabilities are technologically feasible now, but government regulations and policies still need to catch up. In the meantime, Blum says that Audi is focusing on creating a top-notch experience for car users today."The minute you step into a car, all the features, including the seat, radio channels, and the entertainment system will have already been adjusted to your liking and seamlessly connected to your mobile or other hand-held devices," he said.What does the Future Hold for Taiwan in the Next Blue Ocean Market?Semiconductors are the heart of these features, and Blum believes Taiwan is uniquely positioned to drive advances in automotive chips. Taiwan is home to semiconductor powerhouses TSMC and ASE as well as auto electronics companies, and its sophisticated mobile phone supply chain has endowed it with deep experience in integrating semiconductors with electronic modules – advantages that give Taiwan a head start in the automotive semiconductor market.Audi, too, is in a strong position to thrive in the new age of automotive electronics as it looks to its membership with SEMI to collaborate with companies across the microelectronics supply chain.“With rapid advances in automotive electronics technology, semiconductors now play a critical role in innovation and product differentiation,” said Dr. Klaus Buettner, executive vice president of Development Electrics/Electronics, CarIT, Audi.“To fulfill the promise of sustainable, connected-to-everything, highly automated mobility up to autonomous driving, we need to also align automotive requirements across the entire semiconductor value chain,” he said. “With its global platform, SEMI is the right association to bring together supply chain stakeholders for the close collaboration critical to driving technology innovation.”Emmy Yi is a marketing specialist at SEMI Taiwan.

Have you ever wondered if you could “feel” what it’s like to revisit your favorite vacation spot while sitting on a couch in your living room? How about walk through a restaurant overlooking the water’s edge as you enjoy a savory dish, while still sitting on that couch?If you follow trends in consumer electronics, you probably imagined a virtual reality (VR) headset that uses a visual interface to simulate the ambiance of the restaurant as you use a voice interface to scroll through the restaurant’s menu. While the tech world has made great progress in evolving the visual and voice interfaces of VR, immersive virtual food-tasting also requires a digital interface that supports a sense of smell and taste. In fact, the National University of Singapore is conducting research on the topic (see the video), and Project Nourished claims to enable “eating and drinking in a whole new way – by hacking vision, gustation, olfaction, audition and touch – with or without caloric intake” – through VR.We’ve already come a long way in our quest to replicate human senses such as touch, vision (via biometric authentication) and voice to build user interfaces to interact with the digital devices around us. In fact, every invention that permanently changed the consumer electronics landscape in the last few decades has in turn brought to life one of these user interfaces (UI). For example, smartphones proliferated touch, video games such as Nintendo Wii and Sony Xbox brought gesture, and most recently, smart speakers and VR headsets have increased the adaptation of voice and vision.Complexities of UI DesignUI design is a complicated task that builds upon years of research in neuroscience, cognitive thinking and engineering. It must also account for individuality because users interact differently with their digital devices. Some, like me, use their left hand predominantly when interacting with a gaming console. Some have a heavy accent, which can make speech recognition difficult, while those with a hearing disability may prefer touch over voice as a user interface. Application, context and proximity of the device to the user also affect UI. For example, a user interacting with a smartphone at home has the option to touch or speak to the device whereas voice is the safest means to communicate with a car’s infotainment system while driving.Consumers often bring their digital devices wherever they go, but still expect a consistent user experience. Therefore, a natural user experience is the key to UI adoption. A multi-sensory approach combining voice, vision and/or touch could prove the most practical solution. For example, if I were to access my account at a bank ATM, I would prefer visual- or touch-interface authentication for security reasons, but I would still want to use a hands-free voice interaction to switch between the different menus on the machine. In this case, a combination of UIs could provide a more natural multi-sensory experience, albeit one that needs a careful design.UI technology development and adoption are largely influenced by the top four players in the consumer electronics industry – Apple, Amazon, Google and Samsung. Apple pioneered the touch interface with the invention of keyboard-less smartphones, and the rest of the industry followed suit. The introduction of Google Glass kickstarted the VR/augmented reality (AR) segment and opened new applications in the gaming and multimedia entertainment segments. While VR headsets work for gaming – and more recently for selling products and experiences – they are large and cumbersome devices that are uncomfortable to wear for extended periods. These are major hurdles for designers to solve. Voice, on the other hand, offers a hands-free user interface that is a more natural and frictionless compared to alternative UIs.A voice UI needs nothing but a voice command to interact with digital devices. However, it comes with its own complexity of varying user speech characteristics such as accent or volume. More importantly, the need to suppress various background noises for efficient use of voice UIs is critical. While edge computing and/or cloud-based artificial intelligence (AI) are critical technologies to enable battery life and performance of smart home devices, the overarching goal of conversational AI is still far from reality.From a business standpoint, the winner of the race for voice UIs must improve AI capabilities while supporting a strong ecosystem of partners. Amazon, for example, is king of this strategy. The e-commerce giant is building an Alexa Voice Service (AVS) ecosystem by way of its Alexa Fund companies and third-party integrations (partners) to realize its goal of proliferating voice everywhere. These partnerships enable the ecosystem to build end-to-end speech systems that can literally take voice interface products everywhere and promote, among other things, hardware startups that are disrupting the MEMS market with products such as environmentally robust piezoelectric microphones.Energy harvesting near-zero-power always-listening microphones, used in partnership with the AVS ecosystem, are enabling voice UI products to expand into battery-operated applications such as hands-free TV remotes, smart garbage cans, Bluetooth speakers, headsets, hardware appliances and automobiles. A good example of a unique voice UI launched at CES 2019: Housewares designer simplehuman’s voice-activated smart garbage can uses Vesper microphones and AVS. Watch the video.While the future might bring additional digital interfaces, along with multisensory experiences using vision, gesture and touch, voice UI is at the forefront of current technological innovation. Soon, Alexa might help cook dinner without intervention, even turning off the stove when food is burning through the use of a scent-detection sensor integrated with a microphone array. Voice UI continues to astound us with its possibilities, and we’re excited for the journey ahead.With more than 12 years of experience working in speech and voice applications for wireless devices, Udaynag Pisipati is a senior field applications engineer at Vesper. He holds a master’s degree in electrical engineering from University of Missouri and an MBA from Santa Clara University. A firm believer in speech as a natural user interface for human-machine interaction, Pisipati’s areas of interest include everything related to speech processing, including microphones/speakers, signal processing and machine learning.Vesper is a member of MEMS Sensors Industry Group (MSIG), SEMI technology community.

The 3D optical sensing market is once again surging – and it’s all thanks to Apple. What will we see in the next wave of end products enhanced by this technology, how will other market segments approach – and eventually use – 3D optical sensing, and which suppliers stand to gain the most from this very vital technology?Although 3D sensing, facial recognition and optical authentication systems have become only recently hot topics in the consumer electronics market, these mechanisms first made their appearance nearly a decade ago in November 2010. Following that debut, Microsoft soon launched the Kinect system in its Xbox 360 gaming console, marking a milestone as significant as Nintendo’s launch of its Nintendo Wii remote controller in 2010, which catapulted MEMS motion sensors into the high-volume consumer market.The Kinect system used a triangulation-based camera that Israeli developer PrimeSense Ltd. created and then licensed to Microsoft; Apple liked the technology so much that it acquired PrimeSense in 2013. The first version of Kinect applied the Structured Light (SL) method, a depth-sensing principle featuring an infrared (IR) laser projecting dots onto the scene, with a monochrome CMOS sensor measuring the differences in the acquired pattern. The second version of Kinect used the Time-of-Flight (ToF) principle.Kinect for Xbox360 was not only a successful consumer product; it also sparked a new market, thanks to the relatively low cost of the 3D sensing solution. By using the same hardware for Xbox 360 as in its first version of Kinect, Microsoft allowed developers to design their pet projects in the Kinect environment. Adding hand gestures controls to a PC, creating a user-controlled virtual dynamic light (see Kimchi and Chips’ demo), and developing an inexpensive hologram generator (see “Princess Leia” video from the MIT Media Lab) are just a few examples of ecosystem developers and DIYers applying their creativity to Kinect.Apple Goes 3D with Face ID3D optical sensing has expanded from gaming consoles to the smartphone. In 2017 Apple presented its Face ID camera system for the iPhone X, which they launched to celebrate the 10-year anniversary of the iPhone. Face ID is the result of a longer term strategy for Apple, the byproduct of several company acquisitions to expand know-how in 3D sensing and augmented reality (AR)/virtual reality (VR). Between 2015 and 2018, Apple acquired the camera-module maker LinX (2015), the AR startup Vrvana and the imaging sensor firm InVisage Tech (both in 2017), and AR glasses’ designer Akonia Holographics (2018).For a company that has always innovated on its own terms, Apple’s idiosyncratic approach called for deployment of the Structured Light method combined with a ToF device. The result is an amalgamation that utilizes the best features of the two mechanisms, even if the combination is one that is expensive. Apple’s addition of a near-infrared illuminator to its ToF device enhances the system’s effectiveness under most light conditions while also improving the reliability of Face ID; the overall outcome is a more satisfying user experience. The ToF component, which STMicrolectronics supplies, makes use of so-called single-photon avalanche diode (SPAD) receivers that can work with any target material and color, although a higher target illumination is required to obtain good accuracy.The other core components of the Face ID system are the Vertical Cavity Surface Emitting Laser (VCSEL, from Lumentum) and a dot projector (from ams/Heptagon), assembled together in an optical package. Apple’s expensive but reliable approach explains the company’s inclusion of the Face ID system in its latest smartphone and tablet offerings – across the iPhone Xs, Xs Pro and Xr as well as in the latest iPad Pro models. Apple’s Face ID uses facial recognition for authentication on a range of iPhone and iPad Pro models. Image courtesy of Apple. Chinese Phone Makers Get into the GameMeanwhile, other mobile handset manufacturers are rumored to be working on Face ID-like systems or have already presented similar solutions, albeit through a variety of approaches. Some have chosen to use standard ToF devices while others have adopted an SL tactic. In many of these designs, which happen to target Android systems, OEMs generally include a fingerprint sensor as a fallback biometric option to their own nascent 3D facial recognition systems. The fingerprint sensor operates in either standalone mode or integrates into the display.Chinese handset maker Oppo, for instance, uses the SL method on its Find X model with algorithms coming from Megvii. Oppo claims its equivalent of Apple Face ID is faster. I have heard that Vivo has been working on a ToF camera since mid-2018, which it claims provides greater accuracy and security in end-applications such as secure payments and unlocking the phone.Chinese technology giant Huawei’s first 3D facial sensor appeared in its Mate 20 Pro flagship mobile phone. Aside from providing facial biometrics, the front-facing 3D sensor doubles as a 3D scanner, enabling users to digitize live objects that they can then manipulate in 3D AR applications. While still a novelty, the application highlights the use of 3D light sensors beyond that of biometrics. Xiaomi’s Mi Explorer Edition smartphone features a complex SL 3D module to enable 3D facial scanning although it looks like a clone of the Apple solution.Overall, the importance of facial recognition is no longer a matter of dispute, given that Apple’s rivals are now developing counterpart offerings of their own. Leaked code from the next revision of the Android operating system (revision Q), now under development by Google, has confirmed as much. Big and Getting BiggerIHS Markit forecasts that global revenue for ToF sensors in the 3D optical sensing market will surpass $500 million in 2019, up from $370 million last year. We also predict that the ToF market will grow in the coming years, spurred by combo solutions integrated with other light sensors in the same package. This will lead to a cheaper bill of materials (BOM) compared to the BOM for the SL method.At the same time, IHS Markit forecasts that the total market potential for light sensors will be worth much more, reaching $1.5 billion by year 2022. That’s because after a solid start with gaming consoles, 3D sensing has matured and consolidated in the massive smartphone arena.A segment of 3D Sensing’s future growth will come from other use cases and applications that are emerging outside consumer electronics and mobile. These include people-counting and -tracking in consumer and industrial applications, landing-aid and obstacle-avoidance functions in drones, and car-trunk (boot) opening with foot gestures, as well as gesture recognition and passenger detection in automotive. IHS Markit predicts steady growth for ToF and other light sensors. All told, the ToF approach appears to have a greater chance than the SL method in gaining a larger market share, leading to a cheaper and smaller BOM along with reduced integration costs in system assembly and calibration.Sometime this year, Apple and other handset OEMs may include a ToF-based 3D camera on the back of the iPhone to support more immersive gaming experiences and new AR/VR applications. This will further boost the 3D sensing market.To be sure, other mature technologies are available as valid alternatives to optical 3D sensing, including ultrasonic, mmWave and radar. These alternative technologies may gain part of the total market now commanded by 3D sensing, in use cases such as obstacle-avoidance or in-cabin presence detection.To learn about 3D Optical Sensing and Light Sensors from IHS Markit, go to: https://technology.ihs.com/606483/light-sensors-for-consumer-mobile-report-2018Manuel Tagliavini, a principal research analyst at IHS Markit, covers MEMS and sensors technology.Manuel Tagliavini joined IHS Markit in 2017. His key areas of focus are MEMS and sensors for mobile and consumer technologies. He is responsible for the tracking of sensors in handsets, tablets, laptops, and sports and fitness products.Prior to IHS Markit, he spent over 10 years with STMicroelectronics, working in various roles including product engineering, program management, and marketing and business development in the company's MEMS division.Tagliavini earned an Executive Master of Business Administration at SDA Bocconi School of Management and a Master of Science in Electronic Engineering from the University of Parma, both in Italy.Stay tuned with the technological advances and market trends in the MEMS Sensors ecosystem. Join MEMS Sensors Industry Group (MSIG), the SEMI technology community that connects the MEMS and sensors supply network in established and emerging markets, allowing members to grow and prosper.

MedTech, autonomous driving and other disruptive technologies will be in focus at the SEMI Industry Strategy Symposium (ISS Europe), 31 March - 2 April 2019 in Milan, Italy, as top European executives, researchers and academics gather to explore solutions to the region’s most pressing strategic, economic and social challenges. Ahead of ISS Europe, SEMI spoke with Mark Purdy, managing director and chief economist at Accenture Research, about Accenture’s Business Futures – four different future worlds set in 2025 based on the collision of trends across demographics, geopolitics, technology, and economics – and what these futures will mean for markets, workforces, operating models and industry value chains. SEMI: At ISS Europe in Milan, you will kick off the symposium highlighting market opportunities of the digital economy and how companies must adapt to competitive challenges. What inspired Accenture’s Business Futures four world scenarios?Purdy: The impetus for our Business Futures really stemmed from a certain dissatisfaction with current approaches to thinking about the future. We were struck by the following puzzle. First, there is no shortage of techniques for looking at the future, from forecasting to trends analysis to conventional scenarios. Second, most decision-makers have more or less the same access to information on global trends. Yet, time and again, we hear stories of businesses going bust or facing major challenges precisely because they failed to anticipate major changes in their industry.The paradox is that we have so much information, but so little real understanding of how the future actually unfolds. So that set us thinking about how to develop a new approach, based on a combination of detailed trend analysis, expert input and creative storytelling – which is what we call “Business Futures.” SEMI: Of demographics, geopolitics, technology, and economics, which trend do you see as particularly critical?Purdy: Actually, the essence of our Business Futures thinking is that it is the collision or combination of different trends – across economics, technology, demography, etc. – that shapes future outcomes, rather than individual trends per se. To a certain extent we tend to become fixated on specific trends and this can lead us astray or cause bad decision-making. For example, in the early 2000s many people saw very favorable trends in the U.S. economy – strong capital inflows, rapidly rising consumer spending, surging stock markets, and rising home ownership rates. Each trend in isolation looked strong and sustainable. But we failed to see how the combination of these trends was fueling risky financial innovation that would eventually lead to the financial crisis and great recession.Technology of course is a key trend. We are seeing tremendous advances in next-wave technologies such as robotics, machine learning, intelligent objects, 5G and virtualization. But we can only truly understand the impact of the technologies – and the business opportunities and challenges they create – by viewing them against a wider backdrop of changes in society, demography, geopolitics and economics. That is what Business Futures strives to do.SEMI: What will these different futures mean for markets, workforce, operating models and industry value chains?Purdy: There will be profound changes in how we think about all of these areas. Markets will become much more personalized and interactive. Technology will be increasingly integrated with humans, fueling innovation in areas such as personalized healthcare and preventative medicine. Our notions of distance and capacity will be upended, as new virtualized services enable new ways of reaching underserved customers. Consumers will become increasingly involved in the creation and design of products and services. New methods of innovation, powered by AI and virtualization, will come to the fore. New entrants will come from unexpected quarters, enabled by new technology. The upshot will be massive disruption and disintermediation of value chains across many sectors.SEMI: What can Europe do to prepare?Purdy: There are no simple answers, and the correct course will vary by country, but there are some basic things to get right. First, different countries need to understand their comparative advantage – for example, whether it is in services, new technologies, advanced manufacturing or resources – and work with the grain of these different futures. Second, countries need to ensure that they have the basic conditions – regulation, organizational adaptability, workforce flexibility, skills, and innovation infrastructure – to capitalize on the productive potential of new technologies such as AI, virtual reality, and the Internet of Things (IoT). Third, we need to create educational systems and workforce learning methods that emphasize creativity, problem solving and innovation – precisely the skills that will be most needed in an age of intelligent machines. SEMI: What are your expectations for the summit in Milan and for the future?Purdy: I’m very much looking forward to the ISS Europe Summit in Milan. As an economist, I believe we are at a pivotal moment in the semi-conductor industry, driven by waves of technological change and rising geopolitical frictions and uncertainty. With so many industry leaders and experts coming together at the Summit, I’m confident that our discussions will help point a way forward!Mark Purdy is managing director of economic research at Accenture Research. His research examines issues at the intersection of economics, technology and business. He has published widely in tier-1 media and specialised publications on topics such as China’s economy, emerging-market geographic strategy, inclusive economic growth, business futures and the economic impact of new technologies such as the Internet of Things and artificial intelligence. A graduate of Trinity College Dublin, he speaks on these topics at conferences and seminars around the world.Serena Brischetto is a marketing and communications manager at SEMI Europe.

As group vice president of the Analog MEMS Group and general manager of the MEMS Sensor division at STMicroelectronics, Andrea Onetti brings nearly three decades of experience in MEMS, sensors and audio systems to his leadership role at one of the world’s most successful electronics and semiconductor manufacturers. During his keynote at FLEX and MEMS Sensors Technical Congress 2019, February 18-21 in Monterey, Calif., Onetti will address the criticality of sensor accuracy in advancing automotive, industrial and consumer applications. SEMI’s Maria Vetrano spoke with Onetti recently to give FLEX/MSTC attendees a preview of his presentation. SEMI: What are some promising advancements in sensors for autonomous cars? Onetti: The avionics industry is already successfully applying sensors for autonomous operationl. Inertial navigation systems (INS) support the operation of planes during flight, both after takeoff and before landing. Unfortunately, the technology in these navigation systems is expensive and not scalable, and they are hampered by reliability limitations in an automotive environment.Following the steady progress that we have made with MEMS inertial sensors in consumer applications, we are on the cusp of realizing greater accuracy in temperature and time – finally delivering the performance required for autonomous driving. Because we can scale in production – we’re now manufacturing more than a billion units a year – we can select the cream of this production crop for adoption in cars. Consequently, we should see Level 3 and Level 4 autonomous driving for consumers very soon.SEMI: How are companies using sensors to monitor and track their assets in industrial applications? Onetti: Predictive maintenance and asset tracking are the two main verticals in Smart Industry. The adoption of multiple sensors for condition monitoring is helping to detect the faulty operation of equipment and to detect early signs of issues that are otherwise difficult to capture. Ultrasonic microphones can detect leaks in a pipe at an early stage, accelerometers with high bandwidth can act as micrometers, and accurate temperature sensors can catch overheating. Similarly, in asset tracking, we use temperature monitoring in combination with inertial sensors to detect problems during the transport of goods. Shock sensors with extremely high full scale (up to 8000g) can tell whether a lightweight envelop has been dropped. Pressure sensors can switch off a radio system when a cargo plane takes off and can mute smart trackers in compliance with flight regulations. We really can do almost anything! A full slate of ST sensors and microcontroller units (MCUs) enable WEG’s small but powerful motor sensor, which listens to a motor, feels its pain, and shares that information with engineers, operators and others to diagnose problems before they happen. Image courtesy of STMicroelectronics. High-accuracy motion, environmental and proximity sensors are crucial to VR/AR. Image courtesy of STMicroelectronics. SEMI: How will sensors advance user experiences in consumer electronics, such as VR/AR systems?Onetti: Virtual reality (VR) and augmented reality (AR) are great examples of promising consumer technologies that will become pervasive as performance of inertial sensors improves. First, we need super accuracy in time and temperature to provide the right experience to users. To achieve this level of accuracy, we need a major step forward in performance, and that includes power consumption and miniaturization. Fortunately, we are constantly making progress in the high-accuracy motion, environmental and proximity sensors that are critical to these systems. While the scale is vastly different between VR/AR and automotive, the requirements for AR/VR systems are pretty similar to those that will enable autonomous cars. A growing variety of sensors (environmental, microphone, proximity, motion) – combined with a sensor hub in an MCU – are central to VR controllers (above) and VR head mounted displays (below). Images courtesy of STMicroelectronics. SEMI: We don’t hear much about the criticality of higher accuracy in sensors. Why is improving accuracy in sensors especially important – and what role do calibration routines play in achieving higher accuracy?Onetti: A sensor is more than just the performance of the relevant function. It is also the intrinsic accuracy that it brings. This accuracy is tuned by calibration, which is typically an expensive process done at the end of product manufacturing or – better still – during earlier stages of manufacturing.Today more applications require sensors with higher accuracy, which necessitates investing more time in calibration, leading to higher cost.MEMS technology can help by offering solutions with intrinsic higher accuracy, which reduces the cost of calibration for product manufacturers. This naturally delivers major benefits to OEMs and, ultimately, their customers.SEMI: What would you like FLEX and MSTC attendees to take away from your presentation?Onetti: As attendees explore the wide variety of available sensor solutions for their end products, I would ask them to prioritize the role of accuracy in sensor selection – because improved accuracy means higher quality data, and higher quality data means better decisions with reduced need for data processing.While designers understand the role of calibration routines in qualifying individual components for specific applications, it is the continuous evolution of MEMS technology that offers the best possibility of breakthrough reductions in time and cost of these calibration routines. This makes MEMS sensors more attractive and affordable than similar sensor components based on different technologies. Andrea Onetti will present Accuracy Enables MEMS Sensor Pervasion at FLEX/MSTC on Tuesday, February 19 at 11:00 am.Register today to connect with him at the event. To learn more about STMicroelectronics, click here. Maria Vetrano is a public relations consultant at SEMI.MSTC FLEX 2019 is organized by MEMS Sensors Industry Group (MSIG) and FlexTech.Maria Vetrano is a public relations consultant at SEMI.

Francois Jeanneau, president and CEO of Novasentis, has spent the last two decades building strategic relationships, increasing revenues and catapulting growth at leading consumer OEMs and ODMs. Jeanneau will present the world’s thinnest haptic actuator technology at the upcoming FLEX and MEMS Sensors Technical Congress 2019, February 18-21 in Monterey, Calif. SEMI’s Maria Vetrano interviewed Jeanneau to give FLEX and MSTC attendees a preview of this new technology that will enable rich, customizable haptic experiences with virtual reality (VR), hand-held game controllers and flexible wearable devices such as wristbands.SEMI: What do consumers want from haptic feedback? How can the technology industry improve the user experience with haptics?JEANNEAU: In many applications such as VR and gaming, our visual and auditory senses are satisfied by high-resolution displays and good-quality speakers, but they lack the sensation of realistic touch. That’s because haptic technology has lagged the technological advancements that we have made in displays, microphones and speakers. It’s also fallen far behind what is possible on the software side. At the same time, consumers are demanding more from their VR and gaming experiences.Through improvements in haptics, prospective home-buyers touring a home via VR headset will be able to “feel” those granite countertops in the kitchen, assess whether their couch will fit in the living room and check out the view from the back porch, all from the comfort of their own home. Virtual travelers will be able to touch the marble walls of the Taj Mahal, and sports enthusiasts will feel the impact of a tennis ball when they use their haptics 2.0-enabled controller.Haptics will dramatically improve what’s possible in wearable devices as well. From their smartwatches, consumers will discern hundreds of different sensations, from a mild heartbeat to a sharp reminder that they are steering a car through an intersection. This is all possible through new haptic actuator technologies that can accept hundreds of inputs to generate an entire haptic language of outputs.SEMI: What are some major obstacles to realizing improvements in haptics for flexible devices such as wrist-worn devices?JEANNEAU: The best wrist-worn devices today offer a rudimentary haptic output that merely says, “hey, pay attention to me.” To comprehend the alert, the user must look at the display, press a few buttons and then interact with the device. This distracts the user while riding/driving, creating potentially dangerous situations. It’s also frowned upon, particularly in the middle of a meeting!The legacy haptic technologies – eccentric rotating mass (ERM) motors and linear resonant actuators (LRAs) – that are currently used in today’s devices are problematic on multiple levels. They are bulky, sometimes occupying a third of the real estate in a smartwatch. As they are generally made of metal, they are also heavy and too thick for many devices. Their output tends to be slow, lagging the output in the display, making the whole experience clunky. They tend to be power-hungry as well.SEMI: How is Novasentis approaching these technical challenges?JEANNEAU: Novasentis has created an extremely thin (150 um), flexible and low-power polymer film actuator that is small enough to be easily embedded into the next generation of smarter wearable devices and garments; the actuator can provide hundreds of different types of vibrating feedback to the wearer for improved notification and/or suggested actions. The film actuator (that can replace a mechanical motor vibrator found in smartphones and smartwatches) is made by stacking layers of electroactive polymer and metal to create the piezoelectric structure. Upon power-up via a modulated waveform, the molecules move to align themselves in response, which elongates and relaxes the polymer. This causes the attached substrate (wristband in a watch, for example) to bend and relax, thus, causing the vibration effect, or haptic and audio feedback (which is unique to our material).SEMI: How will you demonstrate your technical approach at FLEX 2019?JEANNEAU: We will bring examples of designs incorporating our technology as we share live demos of wearables, game controllers and other applications. We will also bring actual haptic actuator materials for show and tell.Francois Jeanneau will present Flexible Actuators for Sensational Haptics at Flex and MSTC on Wednesday, February 20 at 8:00 am. Register today to connect with him at the event. To learn more, click here. MSTC Flex 2019 is organized by the MEMS Sensors Industry Group (MSIG) and FlexTech. Maria Vetrano is a public relations consultant at SEMI.

Do you email your doctor when you have a tickle in your throat? Wear a fitness tracker or use an app to monitor your sugar levels, exercise or nutrition? If so, congratulations! You are a part of the rapid growth of digital medicine.Since you’re on the leading edge of this trend to enhance the efficiency of healthcare delivery, you might enjoy learning more about how the medical industry is transforming healthcare in this collection of podcast episodes and video. These are my top picks and just the tip of the proverbial iceberg in how modern medicine is taking today’s technology and applying it to best practices for remote patient monitoring, medical diagnosis, rural healthcare and more.Enjoy! And let me know if you find any others worth the listen!1. Inside Angle: 3M Health Information Systems - Telemedicine: Enhancing Access to Improve OutcomesAccess to healthcare can be a matter of life or death. For some patients, this may mean taking a day off work and driving for hours because services are not available in their hometown.Inside Angle host Dr. Gordon Moore interviews Barb Johnston, co-founder and CEO of HealthLinkNow, about the implementation of telemedicine programs. They discuss how technology impacts telemedicine adoption and related regulations and benefits clinicians and patients in the telepsychiatry and mental health industry. 2. NPR’s The Salt: What’s On Your Plate – This Chef Lost 50 Pounds and Reversed Prediabetes With A Digital ProgramThis short audio clip and article dives into lifestyle and wellness apps designed to motivate users to eat healthier, exercise more and – in some cases – save them from a preventable disease, like diabetes.Wellness apps like Omada Health rely on smartphones, e-coaching, electronic nudging and other methods to encourage users to make and, more importantly, stick to changes that can improve their health. And it’s catching on as other organizations, such as The Centers for Disease Control and Prevention, recognize the difference lifestyle-change programs designed to prevent diabetes are making. 3. Red Hot Healthcare: Episode 57 - Bluer Skies for TelemedicineLast year alone, venture capitalists poured $7 billion into telemedicine. As an emerging concept, telemedicine has a long road ahead until it’s fully integrated and adopted into modern medical practices. Nathaniel Lacktman, partner and health care lawyer with Foley Lardner LLP, discusses legal issues and hurdles surrounding telemedicine today with Red Hot Healthcare host Dr. Steve Ambrose.Lacktman pointed to healthcare providers such as Mercy Virtual Care Center, Mayo Clinic and MDLive that are likely to lead the telemedicine race. This podcast episode is a great listen for entrepreneurs and medical professionals who are interested in learning about compliance and business considerations for the implementation of telemedicine. 4. Digital Health Today: Episode 56 – Eren Bali on Building the World’s Largest Connected Care NetworkEren Bali, CEO and co-founder of Carbon Health, is out to change our fragmented traditional healthcare system with his aim to build the world’s largest connected care network.For Bali, it all started with his sister’s experience consolidating his mother’s health records – scattered over 20 different systems. And from that challenge, his idea to create a universal network that aggregates patient medical records was born.Bali and Digital Health Today host Dan Kendall discuss Bali’s launch of Carbon Health, the new medical records system’s first implementation in a San Francisco primary care clinic, and how providers and patients can get on board with this model. 5. Digital Health Today: Episode 58 – Brennan Spiegel Gets Real About Virtual RealityThis episode of Digital Health Today centers on how Virtual Reality (VR) is being used to enhance patient care. Host Dan Kendall speaks with Dr. Brennan Spiegel, Director of Health Services Research at Cedars-Sinai Health System and Professor of Medicine and Public Health at UCLA, about how immersive technology like VR and Augmented Reality (AR) can improve patients’ experience as well as alleviate pain, anxiety, depression, addiction and more. In a particularly interesting segment, Dr. Spiegel calls the hospital a biopsychosocial jail cell and underscores its importance in not just treating physical ailments but, more wholistically, also addressing the psychological and social wellbeing of patients. 6. TED2017: Raj Panjabi – No one should die because they live too far from a doctor What do you do when access to a doctor means rowing a boat for hours? Millions of people around the world lack access to health care because they live in a remote town or village.In this TED talk, Raj Panjabi, physician in the Division of Global Health Equity at Harvard Medical School, Brigham and Women’s Hospital, and co-founder of Last Mile Health, offers a solution to the problem of healthcare access in the form of the Community Health Academy, a global platform to train and connect community health workers by leveraging devices like smartphones to bring preventative healthcare to even the most far-flung regions of the world. 7. GeekWire’s Health Tech Podcast: How AI is making humans the ‘fundamental thing in the internet of things’Can AI predict which patients are at risk for chronic diseases using their old medical records? This episode of Health Tech Podcast dives deep into the future of healthcare with a look at the potential for AI -- “augmented intelligence” or “assistive intelligence” – to improve patient outcomes, the focus of Ankur Teredesai, a data scientist at the University of Washington and co-founder and CTO of health AI startup KenSci.Clare McGrane, host of GeekWire’s Health Tech Podcast, speaks with numerous experts in this field. They compare precision health to a modern car constantly monitored by microprocessors. The minute something is wrong, you get a warning to take the car to a shop to resolve the issue. The same concept can be applied to humans and deliver big healthcare impacts as research in AI and machine learning continues to evolve. 8. NPR’s Shots: Can Home Health Visits Help Keep People Out Of The ER?In Washington D.C., the city with the highest per capita 911 call volume in all of the U.S., Mary’s Center is piloting a program to provide primary care telemedicine to patients who cannot, or in some cases, do not want to visit the clinic. NPR covers the story of Medicaid patient Dennis Lebron Dolman, who is currently receiving a mix of home visits and virtual treatment.Besides providing healthcare access to rural regions, telemedicine has the potential to reduce emergency room visits in cities as well as improve the health of patients in the long run. Learn more at SEMICON West’s Smart MedTech TechXPOT on Digital Medicine and Remote Patient Monitoring. Hosted by NBMC on July 12, 2018, from 10:30 AM to 12:30 PM, the event will feature healthcare industry leaders exploring state-of-the-art healthcare practices and the future of medical technology. Registration is now open!Amy Ly is a Technical Programs Marketing Coordinator at SEMI.