UC Berkeley

Jack McCauley understands the interplay between video game hardware and human interaction like few others in the industry. He designed the guitar and drums for Red Octane’s (later Activision’s) Guitar Hero video game series. As co-founder and chief engineer of Oculus VR, he designed the Oculus DK1 and DK2 virtual reality (VR) headsets and helped guide the company through its acquisition by Facebook in 2014. Now active in automotive technology, he builds cars at Black Lab, his private R D facility and hardware incubator in Livermore, California. And, in no small feat, he thinks he’s solved the head-tracking problems in augmented reality (AR)/VR headsets – which he’ll demonstrate during his keynote presentation, MEMS Applications in Augmented Reality, October 6 at MSEC 2020. SEMI’s first virtual MEMS Sensors Executive Congress. The event is October 6-8 and 13-15, 2020, and registration is open. I interviewed McCauley to preview his presentation. Register now for MSEC 2020.SEMI: What inspired you to become the first person to use a MEMS sensor in a gaming device?McCauley: When I started designing the Guitar Hero peripherals, I had intermittent problems with the motion tracking. I switched to a Freescale single-axis accelerometer, developed some IP around it, and that fixed the problem. That’s how I became an early customer of MEMS. SEMI: When you pioneered immersive VR gaming experiences at Oculus VR, tech industry analysts predicted widespread adoption of VR for gaming. What do you think happened?McCauley: There are a lot of reasons why VR hasn’t become the standard bearer for gaming. Gaming used to be a solitary activity, but as companies like Microsoft and Sony got behind multiplayer gaming, we realized many gamers found the social aspect more important than the visual aspect. Many gamers are content to play on a 2D screen or on multiple monitors because they’re playing against many people. The proliferation of internet connections worldwide has also promoted the kinship and social aspect of gaming.SEMI: Do you think VR has a place in other applications?McCauley: I think it has a lot of potential in real estate, VR movies, and engineering and design, among other areas. The automotive designer Henrik Fisker, for example, created whole vehicles in a game-engine model. If you wanted to buy one of his cars, let’s say, you could change the color and upholstery, for example, and then view it in a VR environment. SEMI: One of the biggest obstacles to VR adoption is the motion sickness some people experience during game play. What would you do to fix that?McCauley: The vestibular system in the brain, which uses the inner ear, is crucial to helping you balance. If there’s a mismatch between what your eyes see and your brain is perceiving, you’re likely to feel dizzy. I’ve built a VR headset that uses a MEMS pico projector with micromirrors and a small laser for position tracking as well as for facial tracking and modeling. But the platform’s not for sale.Still, many of the technical advances that we’ve made in VR are helping us with AR development. The increasing power of mobile chipsets and GPUs, the decreasing geometry for individual transistors and the way specific chips are processed, screen interfaces that will drive a 4K panel at a high frame rate, plus MEMS devices inside the eyewear for rotations and tracking are all helpful innovations.SEMI: When designing cars in your own lab, you’re doing a lot of work with AR. What do you think of AR’s commercial viability?McCauley: I know there are well-funded AR programs in place at major companies. That’s because mobile-device companies want an omnipresent phone in front of your face. I thought Google Glass, for example, was brilliant, but it was way too early for that product, and there was too much hype behind it.McCauley's latest R D project is a vehicle that incorporates augmented features and a computerized display. The vehicle is a custom built, environmentally friendly super-car with enhanced driver safety and high vehicle performance. AR is appealing because it lets people see through a screen – and have objects appear on that screen – while they are moving through space. My son actually came up with one of the ideas I’m implementing in a car I’m designing. We were driving in Spain, and he suggested that instead of using Google Maps to show me driving directions – which would force me to look down at an infotainment display – a sign could appear on AR glasses that would instruct me how to drive to Italy. That’s just an example of how we’ll use AR. SEMI: After you sold Oculus VR to Facebook, you began investing time and resources into engineering education. Why did you make that choice?McCauley: I’m originally from a blue-collar family, and then I got an education at Berkeley. That made a major difference in my life. When I sold Oculus, I donated to education-focused charities primarily, because an education can lift an entire family out of poverty. Let’s say your family are farm workers, but you get a degree in engineering and land a job at Apple. That could produce a ripple effect. As other members of your family and people in your community see the benefits of your education, they’re more likely to get an education, too. SEMI: What would you like MSEC attendees to take away from your presentation?McCauley: I appreciate what the MEMS industry has done for VR because if Oculus didn’t have a nine degrees of freedom (9DoF) IMU, no one would have bought our company. A new application will come along sooner or later that will require a different type of MEMS technology, and I have total confidence that the MEMS industry will deliver what’s needed. For more information on McCauley’s R D projects or on his position as Innovator in Residence at UC Berkeley’s Jacobs Institute for Design Innovation, visit his website. MEMS Sensors Industry Group® (MSIG), a SEMI technology community that connects the MEMS and sensors supply network in established and emerging markets, enables members to grow and prosper. Visit us today.Jack McCauley is an Innovator in Residence at the Jacobs Institute for Design Innovation, where he mentors students, lectures in courses focused on product design and design for manufacturing, and leads research and development projects focused on applications of augmented, virtual, and mixed reality for design professionals and students.McCauley graduated from Berkeley Engineering with a B.S. in Electrical Engineering and Computer Science in 1986, and credits the time he spent at Berkeley as an undergraduate with helping to ignite his career. Maria Vetrano is a public relations consultant at SEMI.

VTT Technical Research Centre of Finland Ltd (VTT) has its sights set high. As a leading global research and development firm , VTT is out to produce bio-interfacing and biodegradable flexible hybrid electronics (FHE) devices that help tackle some of the world’s greatest challenges including environmental degradation and food scarcity.SEMI’s Maria Vetrano interviewed Antti Vasara, president and CEO of VTT Technical Research Centre of Finland, to preview his February 25 keynote, Beyond Flexible Hybrid Electronics: Biodegradable Electronics and Interfacing Bio+Electronics, at FLEX|MEMS Sensors Technical Congress (MSTC) 2020, February 24-27 at the DoubleTree by Hilton in San Jose, California. Join us at FLEX|MSTC to meet Antti and other industry influencers driving innovation in flexible hybrid electronics (FHE) and MEMS sensors. Register now to connect with him at FLEX|MSTC or visit him on LinkedIn.SEMI: What is body-interfacing electronics and what is your vision for bio-interfacing and biodegradable electronics?Vasara: Body-interfacing electronics have existed for decades. Developed in the 1970s, the wireless heart rate monitor is a good example. While continuous heart monitoring with a compact, inexpensive wearable device is widely accessible technology, other bodily parameters, such as cholesterol levels or biomarkers, are diagnosed every time we see a doctor. Establishing a baseline using multiple measurements — before symptoms develop is actually much more effective.That’s where bio-interfacing comes in. Bio-interfacing devices will continuously measure and analyze complex biogenic substances such as sweat, breath, blood and urine. A smart patch for continuous sweat monitoring, for example, would overcome several challenges: supporting electronics functionality in liquid environments, managing the transport of harvested samples to and from the sensor, managing potential contamination, and disposing of samples after measurement.While FHE in principle delivers the right building blocks and is an ideal form factor for a wearable sweat analytics patch, flexible circuits are not ready for out-of-the box interaction with biological matrices. Hence, our mission at VTT is to anticipate and develop the upscaling process know-how required for FHE devices that either interface with biological systems — or that must themselves biodegrade.We’re also focusing on biodegradable electronics because environmentally conscious end-users and manufacturing companies want biodegradable versions of energy-autonomous, label- or sticker-like Internet of Things (IoT) sensors. Typically used for packaging, logistics, environmental monitoring and medical diagnostics applications, these sensors — which have a lifetime of a few days, weeks or months — have become very popular. Unless they are biodegradable, however, they just add to landfill.SEMI: What approaches is VTT using to develop bio-interfacing and biodegradable electronics?Vasara: In our Business Finland-funded ECOtronics project, we are working with our partners to create recyclable and compostable electronics and optics that use renewable resources. For example, devices developed using substrate materials like paper, cardboard or VTT’s in-house-developed nanocellulose films and biopolymer films for environmental monitoring or skin patches can be easily recycled or even biodegrade naturally. Where possible, we use roll-to-roll printing to generate the device circuitry, and on a component level, we have optimized our assembly process towards bare-die component bonding to reduce the overall footprint of non-biodegradable waste per device.SEMI: What use cases do you find most promising and why?Vasara: A prominent example of a single-use test that generates a large amount of waste is the digital pregnancy test. When breaking it down into components, you will find a rigid circuit board with microprocessor, a couple of coin cell batteries, a liquid crystal display, a LED light source and photodiode, and a large chunk of plastic packaging around it. The materials and battery capacity of such a device would be sufficient to run hundreds of pregnancy tests – actually technical overkill.By using printed circuits on biodegradable substrates, bare-die assembled components (ASIC, LED light sources, photo diodes, thin film batteries as power sources) and device packaging composed of biodegradable plastics, we can completely redefine the environmental footprint of single-use tests. We are currently developing a toolbox for our customers to turn their existing conventional test into an ecotronic form factor.Another exciting use case is a sweat sensor that we developed collaboratively with Ali Javey, Ph.D., professor of Electrical Engineering and Computer Sciences, UC Berkeley, and the co-director of Berkeley Sensor and Actuator Center (BSAC). Together with his team, we created a wearable electrochemical sensor for continuous sweat analysis during exercise. With the UC Berkeley group providing the chemistry to monitor N+, K+ ion and hydration levels in sweat over the duration of several hours, VTT delivered the underlying sensor platform, featuring the printed sensor electrodes and sweat harvesting microfluidic channels for fluid management and transport. It’s exciting to see what we can achieve by combining techniques from different disciplines, in this case electrochemistry, printing, packaging and microelectronics.SEMI: How can industry enable the development/manufacture of flexible FHE devices? Where does VTT fit into the ecosystem?Vasara: As many FHE devices target large-volume markets, scalability of manufacturing is key: How can I get from one device (= working prototype) to a handful of devices (= feasibility study), to thousands (= pilot manufacturing), to a million (= mass manufacturing) without compromising the quality of the system’s performance and reliability?Access to upscaling infrastructure is essential for the development of novel FHE devices and methods, but infrastructure is expensive. That’s where our establishment of a roll-to-roll pilot printing line to bridge the gap between laboratory R D and mass manufacturing has proved invaluable. We can provide a unique worldwide upscaling infrastructure for advanced FHE devices, with a strong focus on large-area roll-to-roll processes and hybrid assembly. This service removes our customers’ burden of high infrastructure investment in early development stages and it allows us to guide customers along their development path, from prototype to mass production.Watch our video: VTT pilot manufacturing for diagnostics and wearablesSEMI: Is there anything else that device manufacturers need to know in order to succeed?Vasara: In my eyes, the success of FHE devices eventually depends on several factors: It requires a high degree of automation, well-optimized processes, reliable supply chains, and perhaps most importantly, clear standards and rules for designers to guarantee flawless interoperability of all the different elements on a flexible and hybrid circuit. Let us not forget – we are trying to marry electronics with printing, biology, packaging, microfluidics, injection molding and other fields of expertise.We recently finalized the compilation of a set of design rules for publication in our state-of-the-art overview of printed and hybrid electronics manufacturing methods. You can download the overview, PrintoCent Handbook, for free.SEMI: What would you like FLEX|MSTC attendees to take away from your presentation?Vasara: The latest technologies and innovations in microelectronics, MEMS, printing, materials, and biosensors provide us a toolbox for true innovation in the FHE space. Now we need cross-disciplinary thinking and daring steps to combine different manufacturing methods and skill-sets. The ideal cross-disciplinary team might include: The printing engineer who knows how to design contact pads for a bare-die IC assembly The biologist who knows about the thermal and mechanical stress in a printing environment to design processes for bio-functionalization of surfaces The electronics engineer who knows how to optimize a circuit powered with an enzymatic biofuel cell The number of sensors deployed on (or inside) our body, in our drinking water, in our cars, on our fields, in our pets, and everyday products will surely grow. Let us make sure they leave the smallest environmental footprint possible.Antti Vasara, Ph.D. has been the president and CEO of VTT Ltd since 2015. VTT is a visionary research, development and innovation partner with over 2000 people and a turnover exceeding 250M EURO. Vasara is president of EARTO (European Association of Research and Technology Organisations) and is chairman of the board of Palta (Finnish Service Sector Employers). In addition, he is a non-executive director of Elisa Oyj (largest communications operator in Finland) and a board member at EK (Finnish Confederation of Industries).He has served on several high-profile groups on industrial and innovation policy of the European Commission, in addition to several groups in Finland on artificial intelligence and research policy. Previously, Vasara spent close to 25 years in private industry, working at Nokia, Tieto, SmartTrust and McKinsey Company. Earlier in his career, he was a researcher in optical communications with 20+ peer-reviewed articles and one international patent. Vasara holds a Doctor of Science (Technology) degree from Aalto University in Finland.For more information about VTT’s work in bio-interfacing and biodegradable FHE devices, visit VTT Research. FLEX|MSTC is organized MEMS Sensors Industry Group (MSIG) and FlexTech, SEMI technology communities focused on the growth of MEMS sensors and the flexible electronics supply chain, respectively.Maria Vetrano is a public relations consultant at SEMI.

When developing industry forecasts, market analysts gather data from hundreds of companies to provide actionable insights on established technologies and to identify near-term business opportunities. As a developer of new MEMS and sensor technologies for a range of commercial applications, clients often ask us, “What’s going to be hot?” Gauging the promise of emerging technologies that are five to 10 years from commercialization requires taking a different tack.History tells us that most of today’s blockbuster MEMS products were born as academic research projects. Years of hard work by entrepreneurs, funded by millions of dollars, have turned proof-of-concept research into new commercial products. To identify up-and-coming technologies, we gather information straight from the source: academic conferences and articles.Chirp Microsystems is a good proof point of our research methodology: In my 2012 report on emerging technologies, I highlighted research from UC Berkeley and UC Davis on “In-Air Ultrasonic Rangefinding and Angle Estimation Using an Array of AlN Micromachined Transducers.” Soon after publication, the authors incorporated Chirp Microsystems to commercialize their technology for gesture- and fingerprint-recognition applications.After five years of development work, Chirp’s products are entering the marketplace. In February 2018, the global supplier TDK InvenSense acquired Chirp, underscoring the company’s commercial potential. At October’s SEMI-MSIG MEMS Sensors Executive Congress in Napa, Calif., Chirp’s CEO, Dr. Michelle Kiang, held attendees rapt as she described her company’s journey from startup to wholly owned subsidiary.There’s a methodThis year, I reviewed over 100 papers from top researchers presenting noteworthy technologies at the Hilton Head Workshop on Solid-State Sensors, Actuators and Microsystems. My criteria for selection were: commercial relevance; offers a solution to a known or anticipated problem; and technology game-changers. The following caught my eye: Event-driven sensors: Cleverly designed silicon MEMS that consume no power while standing by. A triggering mechanical or thermal event closes a contact within the sensor to activate its circuitry and telemetry. These sensors leverage existing fabrication methods, so they could become commercial products within five years for event monitoring and security applications. (UT Dallas, Northeastern University). Figure: 5-bit accelerometer having zero standby power. The device is open circuit until a threshold acceleration closes a mechanical contact. Source: University of Texas at Dallas. Thin film piezoelectric resonators: Advances in PZT deposition methods and process integration with CMOS were used to create monolithic acoustic waveguides for RF filtering in 5G applications. This new filter design, using existing scalable processes, is ripe for commercialization. (Purdue University, Texas Instruments) Intra-body communications: MEMS ultrasound transceivers, made from aluminum nitride, can send data directly through flesh at Mbit/s data rate. With trends toward networks of multiple implanted or wearable medical devices, this innovation would enable medically safe, secure, intra-body wireless communication. This early-stage work still needs in vivo validation and would likely require 10 or more years for development and regulatory approval. (Northeastern University) Screen- and 3D-printed sensors: One example of many exciting innovations using screen- and 3D-printing are potentiometric nitrate soil sensors. Low-cost and biodegradable, these sensors could be spread over huge areas to monitor a farm’s soil quality. Table-top and hobbyist tools are currently used to make screen- and 3D-printed devices, so new manufacturing equipment and infrastructure must be developed before commercial production could occur. (Purdue University) Biodegradable batteries: A paper-based battery that can deliver 0.5 uW of power, ingeniously using bacterial metabolism as the electrolyte. These batteries dissolve in water and could one day be used to power temporary medical implants or biodegradable sensors. This exciting proof-of-concept prototype will require significant process development and new manufacturing infrastructure for commercialization. (SUNY Binghamton) Figure: Paper-based battery dissolves in 60 minutes after immersion in water. Source: SUNY Binghamton To read more about these technologies, please download my presentation from SEMI-MSIG’s MEMS Sensors TechXpot at SEMICON West 2018.Alissa M. Fitzgerald, Ph.D., is the founder and managing member of A.M. Fitzgerald Associates, LLC, a MEMS and sensors development company in Burlingame, CA. She has over 20 years of engineering experience in MEMS design, fabrication and product development and now advises clients on the entire cycle of product development, from business and IP strategy to manufacturing operations. She is a frequent speaker at industry conferences and currently serves as a director of the Transducer Research Foundation, sponsor of the Hilton Head Workshop. She received her bachelor’s and master’s degrees from MIT and her doctorate from Stanford University in Aeronautics and Astronautics.For more information, visit: www.amfitzgerald.com