AI

Part 2 of this two-part piece examines the potential benefits to be realized by pairing human Subject Matter Experts with smart silicon assistants, and what these new arrangements mean for semiconductor device manufacturing. Part 1 explores best-practice perspectives on collecting and utilizing smart data in industries outside semiconductor manufacturing, one of the important takeaways from the Smart Manufacturing panel discussion at SEMI ASMC 2018. So what does this observation (i.e. the field of medicine, in what seems at first glance a big data environment, is really just clusters and clusters of loose small data connected by the collective neural network of highly trained doctors and their colleagues) mean for semiconductor manufacturing? We think it means we need to apply the same level of intense focus that we already devote to instrumented data collection and analytics in the fab to something more: we need to better capture the vast expertise of our engineering and operational talent in semiconductor manufacturing. We think we need to record what the subject matter experts (SMEs) in the fab see, hear, and think as they investigate yield excursions or machine-down problems. We need to effectively combine product, process, equipment and component subject matter expertise / subject matter experts (SME) with big data analytics to more effectively solve manufacturing problems, be they killer or be they chronic. And we must provide structured methods for incorporating inputs from and active participation of SMEs throughout the data analysis lifecycle, from collection and aggregation, through filtering, feature extraction, analysis and optimization. Some of the challenge will be in just how do we make it easy to gather information from SMEs in real time, while standing in front of equipment in the fab. Internet of Things (Iot) devices are emerging to capture and label images and sounds to enable machine learning algorithms to recognize and help diagnose manufacturing problems based on sight and sound, complementing the instrumented data. But we also need to record the thought processes our human SMEs go through in those investigations – perhaps by the SMEs talking to a smart AI-based conversational assistant who helps make “rounds.” Doing contextual analysis on this added data, combined with the instrumented data, will create the equation Human + Machine = AI (Awesome Insight). Sounds reasonable, right? We think artificial intelligence becomes too artificial if you leave the human out of the equation. AI should be augmented intelligence, where we take the expertise and creativity of the human, and combine it with the rapid computational capabilities of the computer, in order to put problem identification and solutions on steroids. But with the already huge advancements to date in data analytics, cloud, and the emergence of AI, why do improvements in quality, machine utilization, and the implementation of predictive analytics in semiconductor manufacturing seem to be creeping along incrementally, and not appearing as dramatic, step-function improvements? Call it Smart Manufacturing, call it Connected Enterprise, call it Advanced Manufacturing, or Analytics, or Cloud, or the Digital Twin … there are no shortages of terms, philosophies, and technologies available, but why aren’t we seeing their rapid adoption? It could be it’s the downside that comes with needing people. “Good business leaders create a vision, articulate the vision, passionately own the vision, and relentlessly drive it to completion.” Jack Welch. We see from other industries that smart manufacturing conversations originating with the executives of a company thinking to implement smart manufacturing programs lead to vision; however, we also see from other industries, and from our own, that realizing this vision has often been a challenge. Why is that? One reason may be that the people who are personally vested in solutions they implemented in the past, as well as those who follow a pattern of ‘how we’ve always done things’, create, inadvertently or not, persistent internal barriers hindering innovative action. Another may be that engagements with the working engineers and managers charged to be smart manufacturing implementers leads to the pursuit of low-hanging fruit, and cautious investments, that often utilize solutions that ultimately cannot scale and integrate. Not to mention the disadvantage of dealing with the legacy equipment, the legacy networks, the traditional thinking, and the lack of consistency in metrics adding to the confusion. Addressing all these barriers requires an alignment in strategy and execution, along with a plan to support the overall vision, often across the entire enterprise, which is no small matter. And then there are the standards. Having and adhering to standards in control solutions, networks, and data becomes critical in achieving real benefits from smart manufacturing. And data security. One of the other big impediments in the smart manufacturing transformation is data and IP security, another key concern (maybe the most significant) preventing us from moving forward more quickly (e.g. to cloud-based solutions) in our industry. More about that in a follow-up. Achieving synergy across all of manufacturing, from connecting equipment horizontally, through the production system (machines processes), and vertically, through enterprise systems and across production facilities, can only occur if we build standards, security, infrastructure, and human engagement throughout our ecosystem and supply chain. In simple form, the steps to do so include connecting assets, collecting and contextualizing data, and then driving business transformation with actionable insights gained from the data. With impact on every function, and every person, in the enterprise, from equipment operators in the fab through the C-Suite in HQ. Maintenance, Engineering, R D, Operations, Scheduling, IT, Procurement, Finance, HR all contribute, collaborate and benefit. Regardless of the technology, from device level analytics to predictive maintenance and optimization, the people that reside in these disparate groups need to come together with the smart machines to create a common strategy to achieve transformational results. Aligning an enterprise’s goals with its human capital is paramount to success. Therefore, we must challenge our team members and ourselves to work outside our comfort zones, and we need to be forever aware of the need for us to grow with the technology. Smart manufacturing is not necessarily about having fewer people in the fab, but it does suggest having people in the fab, perhaps with different, or upgraded, skill sets, who are even more efficient in their roles as a result of the boost they are getting from Industry 4.0. Fortunately, we now have techniques that let us combine the best, brightest, and latest and greatest analytics with our invaluable SMEs throughout the data analysis lifecycle. We’ll not only be able to deliver higher quality semiconductor manufacturing solutions all in all, but we’ll also be providing methods to more easily distribute, scale, maintain, and continually refine those hard-earned solutions. We expect that subject matter experts will continue to put the “smart” in machine-based smart manufacturing today, and for the foreseeable future. SME contributions are not an option, but, rather, an imperative for ensuring a semiconductor manufacturer’s sustained prosperity, much less its survival. Nancy Greco (IBM Watson), Dave Mayewski (Rockwell Automation), James Moyne (University of Michigan / Applied Materials), and Paul Werbaneth (Intevac, Inc.), along with Julie Jacob (Ernst Young), and Carson Henry (Micron Technology), were members of the SEMI ASMC 2018 panel discussing Industry 4.0 and the Future of Commercial Semiconductor Device Manufacturing. All opinions here are purely our own. Please contact Paul Werbaneth via email at [email protected]. The SEMICON West (July 9-11, 2018, in San Francisco) Smart Manufacturing Pavilion features working production equipment on the floor and three full days of speakers providing insights on building the infrastructure needed to enable AI. Equipment from Bosch Rexroth, Cimetrix, Rudolph Technologies, INFICON, Final Phase Systems, OMRON, DISCO and Edwards Vacuum will showcase cutting-edge smart manufacturing technologies. For information on the SEMI Smart Manufacturing initiative and how to get involved, please click here.

Part 1 of this two-part piece explores best-practice perspectives on collecting and utilizing smart data in industries outside semiconductor manufacturing, one of the important takeaways from the Smart Manufacturing panel discussion at SEMI ASMC 2018. Part 2 examines the potential benefits to be realized by pairing human Subject Matter Experts with smart silicon assistants, and what these new arrangements mean for semiconductor device manufacturing. The spacecraft Discovery and its HAL 9000 computer system had a digital twin. Did you know? Stanley Kubrick’s seminal film “2001: A Space Odyssey” had its theatrical release 50 years ago this April. “2001” isn’t just a great science fiction film. Rather, it’s a great work of cinema overall, across any category. (The American Film Institute lists “2001” as #15 in the AFI Top 100; a bit below “Vertigo,” a bit above “It’s A Wonderful Life.”) It’s a film so distinguished and so prescient that its lessons can inform our thinking about smart manufacturing, Industry 4.0, and artificial intelligence (AI) today. Not to give too much away, but the earth-bound digital twin of Discovery / HAL identifies a diagnostic error the onboard, Jupiter-bound HAL 9000 has made, things go awry from there, and one of the mission pilots, astronaut Dave Bowman, is forced to intervene. At the recent SEMI Advanced Semiconductor Manufacturing Conference, ASMC 2018, on 02 May 2018 in Saratoga Springs, NY, five diverse panelists representing capital equipment, IDMs, academia, the semiconductor supply chain, and smart manufacturing best practices outside the semiconductor industry engaged in a lively discussion with the ASMC attendees. They explored where “smart” is in our industry today, where it’s headed, and what that’s going to mean for us -- the professionals who have brought semiconductor manufacturing to the current state of smart, and are looking to implement an ever-smarter tomorrow. Not to give too much away, but the panelists and audience agreed that there’s nothing artificial about pairing human intelligence with machine-based smart manufacturing. Implementing an ever-smarter tomorrow in semiconductor manufacturing requires smart people just as much as it requires smart machines. Moving towards “smart” means understanding how to derive useful information and actionable intelligence from the ever-increasing pool of big data created during semiconductor manufacturing. Modern manufacturing sites are extensively instrumented today, and create massive amounts of data to consume, decipher, base decisions upon, or discard. As we dig into this problem we realize that equipment and processes in our industry are both obviously complex, but, also, subtly complex. Semiconductor manufacturing tools easily contain 100s to 1000s of components working together to produce nanometer scale, angstrom scale, or even atomic scale features using complex chemical, physical, and plasma processes. There is a plethora of potential failure points and modes, and despite our best efforts to collect more data, many processes continue to be only poorly observable. On top of that, semiconductor fabrication processes are always drifting, and the operational context is continually changing as we change product mix, process maintenance swap-out kit components, and operating conditions and recipes. Sounds like … hospitals, and healthcare? When you see your doctor, she will collect and look at your instrumented data – blood work, blood pressure, weight, and other quantifiable factors. But, typically, your doctor won’t draw a conclusion based on that analysis alone. Rather, your doctor will sit with you, ask probing questions, and record what she asked, your responses, and what she saw, what she heard, and what she thought. Then she’ll build a hypothesis, combining the “anecdotal” data with the instrumented data, and derive from that data set both a likely diagnosis and an effective course of action. In this case, beyond the instrumented data, two humans, and their natural language input, are part of the equation: the patient, with his observations and thoughts, as well as the doctor, with hers. And it’s been a formula for success. Healthcare has made huge, step-function improvements across a spectrum of deadly diseases, as well as with less-deadly chronic afflictions, by harvesting this complex input, committing the proven disease presentation – disease diagnosis – and disease treatment models to medicine’s collective memory, and then teaching the next generation of healthcare providers both the general methods and the standard protocols essential to maintaining good health and successful outcomes. Maybe, in medicine, what seems a big data environment is really just clusters and clusters of loose small data connected by the collective neural network of highly trained doctors and their colleagues. Nancy Greco (IBM Watson), Dave Mayewski (Rockwell Automation), James Moyne (University of Michigan / Applied Materials), and Paul Werbaneth (Intevac, Inc.), along with Julie Jacob (Ernst Young), and Carson Henry (Micron Technology), were members of the SEMI ASMC 2018 panel discussing Industry 4.0 and the Future of Commercial Semiconductor Device Manufacturing. All opinions here are purely our own. Please contact Paul Werbaneth via email at [email protected]. The SEMICON West (July 9-11, 2018, in San Francisco) Smart Manufacturing Pavilion features working production equipment on the floor and three full days of speakers providing insights on building the infrastructure needed to enable AI. Equipment from Bosch Rexroth, Cimetrix, Rudolph Technologies, INFICON, Final Phase Systems, OMRON, DISCO and Edwards Vacuum will showcase cutting-edge smart manufacturing technologies. For information on the SEMI Smart Manufacturing initiative and how to get involved, please click here.

Do you email your doctor when you have a tickle in your throat? Wear a fitness tracker or use an app to monitor your sugar levels, exercise or nutrition? If so, congratulations! You are a part of the rapid growth of digital medicine.Since you’re on the leading edge of this trend to enhance the efficiency of healthcare delivery, you might enjoy learning more about how the medical industry is transforming healthcare in this collection of podcast episodes and video. These are my top picks and just the tip of the proverbial iceberg in how modern medicine is taking today’s technology and applying it to best practices for remote patient monitoring, medical diagnosis, rural healthcare and more.Enjoy! And let me know if you find any others worth the listen!1. Inside Angle: 3M Health Information Systems - Telemedicine: Enhancing Access to Improve OutcomesAccess to healthcare can be a matter of life or death. For some patients, this may mean taking a day off work and driving for hours because services are not available in their hometown.Inside Angle host Dr. Gordon Moore interviews Barb Johnston, co-founder and CEO of HealthLinkNow, about the implementation of telemedicine programs. They discuss how technology impacts telemedicine adoption and related regulations and benefits clinicians and patients in the telepsychiatry and mental health industry. 2. NPR’s The Salt: What’s On Your Plate – This Chef Lost 50 Pounds and Reversed Prediabetes With A Digital ProgramThis short audio clip and article dives into lifestyle and wellness apps designed to motivate users to eat healthier, exercise more and – in some cases – save them from a preventable disease, like diabetes.Wellness apps like Omada Health rely on smartphones, e-coaching, electronic nudging and other methods to encourage users to make and, more importantly, stick to changes that can improve their health. And it’s catching on as other organizations, such as The Centers for Disease Control and Prevention, recognize the difference lifestyle-change programs designed to prevent diabetes are making. 3. Red Hot Healthcare: Episode 57 - Bluer Skies for TelemedicineLast year alone, venture capitalists poured $7 billion into telemedicine. As an emerging concept, telemedicine has a long road ahead until it’s fully integrated and adopted into modern medical practices. Nathaniel Lacktman, partner and health care lawyer with Foley Lardner LLP, discusses legal issues and hurdles surrounding telemedicine today with Red Hot Healthcare host Dr. Steve Ambrose.Lacktman pointed to healthcare providers such as Mercy Virtual Care Center, Mayo Clinic and MDLive that are likely to lead the telemedicine race. This podcast episode is a great listen for entrepreneurs and medical professionals who are interested in learning about compliance and business considerations for the implementation of telemedicine. 4. Digital Health Today: Episode 56 – Eren Bali on Building the World’s Largest Connected Care NetworkEren Bali, CEO and co-founder of Carbon Health, is out to change our fragmented traditional healthcare system with his aim to build the world’s largest connected care network.For Bali, it all started with his sister’s experience consolidating his mother’s health records – scattered over 20 different systems. And from that challenge, his idea to create a universal network that aggregates patient medical records was born.Bali and Digital Health Today host Dan Kendall discuss Bali’s launch of Carbon Health, the new medical records system’s first implementation in a San Francisco primary care clinic, and how providers and patients can get on board with this model. 5. Digital Health Today: Episode 58 – Brennan Spiegel Gets Real About Virtual RealityThis episode of Digital Health Today centers on how Virtual Reality (VR) is being used to enhance patient care. Host Dan Kendall speaks with Dr. Brennan Spiegel, Director of Health Services Research at Cedars-Sinai Health System and Professor of Medicine and Public Health at UCLA, about how immersive technology like VR and Augmented Reality (AR) can improve patients’ experience as well as alleviate pain, anxiety, depression, addiction and more. In a particularly interesting segment, Dr. Spiegel calls the hospital a biopsychosocial jail cell and underscores its importance in not just treating physical ailments but, more wholistically, also addressing the psychological and social wellbeing of patients. 6. TED2017: Raj Panjabi – No one should die because they live too far from a doctor What do you do when access to a doctor means rowing a boat for hours? Millions of people around the world lack access to health care because they live in a remote town or village.In this TED talk, Raj Panjabi, physician in the Division of Global Health Equity at Harvard Medical School, Brigham and Women’s Hospital, and co-founder of Last Mile Health, offers a solution to the problem of healthcare access in the form of the Community Health Academy, a global platform to train and connect community health workers by leveraging devices like smartphones to bring preventative healthcare to even the most far-flung regions of the world. 7. GeekWire’s Health Tech Podcast: How AI is making humans the ‘fundamental thing in the internet of things’Can AI predict which patients are at risk for chronic diseases using their old medical records? This episode of Health Tech Podcast dives deep into the future of healthcare with a look at the potential for AI -- “augmented intelligence” or “assistive intelligence” – to improve patient outcomes, the focus of Ankur Teredesai, a data scientist at the University of Washington and co-founder and CTO of health AI startup KenSci.Clare McGrane, host of GeekWire’s Health Tech Podcast, speaks with numerous experts in this field. They compare precision health to a modern car constantly monitored by microprocessors. The minute something is wrong, you get a warning to take the car to a shop to resolve the issue. The same concept can be applied to humans and deliver big healthcare impacts as research in AI and machine learning continues to evolve. 8. NPR’s Shots: Can Home Health Visits Help Keep People Out Of The ER?In Washington D.C., the city with the highest per capita 911 call volume in all of the U.S., Mary’s Center is piloting a program to provide primary care telemedicine to patients who cannot, or in some cases, do not want to visit the clinic. NPR covers the story of Medicaid patient Dennis Lebron Dolman, who is currently receiving a mix of home visits and virtual treatment.Besides providing healthcare access to rural regions, telemedicine has the potential to reduce emergency room visits in cities as well as improve the health of patients in the long run. Learn more at SEMICON West’s Smart MedTech TechXPOT on Digital Medicine and Remote Patient Monitoring. Hosted by NBMC on July 12, 2018, from 10:30 AM to 12:30 PM, the event will feature healthcare industry leaders exploring state-of-the-art healthcare practices and the future of medical technology. Registration is now open!Amy Ly is a Technical Programs Marketing Coordinator at SEMI.

Artificial intelligence (AI) is making headlines everywhere, offering a range of capabilities, including location and motion awareness — determining whether a user is sitting, walking, running or sleeping. Behind the scenes, AI is capturing volumes of data. Makers of smartphones and fitness and sports trackers, along with application developers, are all clamoring for this data because it helps them analyze real-world user behavior in depth. Manufacturers gain a competitive edge by tapping this intelligence: Using it to improve user engagement, they increase the perceived value of their devices, potentially reducing customer churn. How can consumer-product manufacturers tap the built-in capabilities of MEMS inertial sensors — which are already ubiquitous in end-user devices — to make the most of AI? Machine learningProduct manufacturers can easily build an activity classification engine using commonly available smart sensors and open-source software. Activity trackers, for example, use raw data first collected via the MEMS inertial sensors that are already installed in smartphones, wearables and other consumer products.With the building blocks in place, consumer-product manufacturers can apply machine learning techniques to classify and analyze this data. There are several possible approaches, ranging from logistic regression to deep learning neural networks.One well-documented method used for classifying sequences in AI is Support Vector Machines (SVM). Physical activities, whether walking or playing sports, consist of specific sequential repetitive movements that MEMS sensors gather as data. MEMS sensors make good use of this collected data, which can be easily processed into well-structured models that are classifiable with SVMs.Consumer-product manufacturers have gravitated toward the SVM model since it is easy to use, scale and predict. Using an SVM to set up multiple simultaneous experiments for optimizing classification over diverse, complex real-life datasets is far simpler than with other approaches. An SVM also introduces a wide range of size and performance optimization opportunities for the underlying classifier.Cost impacts of processing, storage and transmissionIn practice, recognizing user activity hinges on accurate live classification of AI data. Therefore, the key to optimizing product cost is to balance transmission, storage and processing costs without compromising classification accuracy.This is not as simple as it sounds. Storing and processing AI data in the cloud would leave users with a substantial data bill. A WiFi, Bluetooth or 4G module would drive up device costs and require uninterrupted internet access, which is not always possible.Relegating all AI processing to the main processor would consume significant CPU resources, reducing available processing power. Likewise, storing all AI data on the device would push up storage costs.Resolving the issuesTo resolve these technology conflicts, we need to do four things to marry the capabilities of AI with MEMS sensors.First, decouple feature processing from the execution of the classification engine to a more powerful external processor. This minimizes the size of the feature processor size while eliminating the need for continuous live data transmission.Next, reduce storage and processing demands by deploying only the features required for accurate activity recognition. In one example created by UC Irvine Machine Learning Repository (UCI), when an AI model was trained using a dataset of activities with 561 features, it identified user activity with an accuracy of 91.84 percent. However, using just the 19 most determinative features, the model still achieved an impressive accuracy of 85.38 percent. Notably, pre-processing alone could not identify these determinative features. Only sensor fusion enabled the data reliability required for accurate classification. Third, install low-power MEMS sensors that can incorporate data from multiple sensors (sensor fusion) and enable pre-processing for always-on execution. A low-power or application-specific MEMS sensor hub can slash the number of CPU cycles that the classification engine needs. The onboard software can then directly generate fused sensor outputs at various sensor data rates to support efficient feature processing.Finally, retrain the model with system-supported data that can accurately identify the user’s activities.Additionally, cutting the data capture rate can reduce the computational and transmission resource requirements to a bare minimum. Typically, a 50 Hz sample rate is adequate for everyday human activities. This may soar, however, to 200 Hz for fast-moving sports. Reducing dynamic data rate selection and processing in this way lowers manufacturing costs while making the product lighter and/or more powerful for the consumer.High efficiency in processing AI data is key to fulfilling its potential, driving down costs and delivering the most value to consumers. MEMS sensors, in combination with sensor fusion and software partitioning, are critical to driving this efficiency. Operating at very low power, MEMS sensors simplify application development while accurately analyzing motion sensor data.Combining AI and MEMS sensors into a symbiotic system promises a new world of undreamt-of opportunities for designers and end users.This blog post is based on an original article that first ran in EDN. It appears here with the permission of the publisher.