Reader small image

You're reading from  Automated Machine Learning

Product typeBook
Published inFeb 2021
Reading LevelBeginner
PublisherPackt
ISBN-139781800567689
Edition1st Edition
Languages
Right arrow
Author (1)
Adnan Masood
Adnan Masood
author image
Adnan Masood

Adnan Masood, PhD is an artificial intelligence and machine learning researcher, visiting scholar at Stanford AI Lab, software engineer, Microsoft MVP (Most Valuable Professional), and Microsoft's regional director for artificial intelligence. As chief architect of AI and machine learning at UST Global, he collaborates with Stanford AI Lab and MIT CSAIL, and leads a team of data scientists and engineers building artificial intelligence solutions to produce business value and insights that affect a range of businesses, products, and initiatives.
Read more about Adnan Masood

Right arrow

Preface

Every machine learning engineer deals with systems that have hyperparameters, and the most basic task in automated machine learning (AutoML) is to automatically set these hyperparameters to optimize performance. The latest deep neural networks have a wide range of hyperparameters for their architecture, regularization, and optimization, which can be customized effectively to save time and effort.

This book reviews the underlying techniques of automated feature engineering, model and hyperparameter tuning, gradient-based approaches, and more. You'll explore different ways of implementing these techniques in open source tools. Next, you'll focus on enterprise tools, learning about different ways of implementing AutoML in three major cloud service providers: Microsoft Azure, Amazon Web Services (AWS), and Google Cloud Platform (GCP). As you progress, you'll explore the features of cloud AutoML platforms by building machine learning models using AutoML. Later chapters will show you how to develop accurate models by automating time-consuming and repetitive tasks involved in the machine learning development life cycle.

By the end of this book, you'll be able to build and deploy AutoML models that are not only accurate, but that also increase productivity, allow interoperability, and minimize featuring engineering tasks.

Who this book is for

Citizen data scientists, machine learning developers, AI enthusiasts, or anyone looking to automatically build machine learning models using the features offered by open source tools, Microsoft Azure Machine Learning, AWS, and Google Cloud Platform will find this book useful.

What this book covers

Chapter 1, A Lap around Automated Machine Learning, presents a detailed overview of AutoML methods by both providing a solid overview for novices and serving as a reference for experienced machine learning practitioners. This chapter starts with the machine learning development life cycle and navigates the problem of hyperparameter optimization that AutoML solves.

Chapter 2, Automated Machine Learning, Algorithms, and Techniques, allows citizen data scientists to build AI solutions without extensive experience. In this chapter, we review the current developments of AutoML in terms of three categories: automated feature engineering (AutoFE), automated model and hyperparameter learning (AutoMHL), and automated deep learning (AutoDL). State-of-the-art techniques adopted in these three categories are presented, including Bayesian optimization, reinforcement learning, evolutionary algorithms, and gradient-based approaches. In this chapter, we'll summarize popular AutoML frameworks and conclude with the current open challenges of AutoML.

Chapter 3, Automated Machine Learning with Open Source Tools and Libraries, teaches you about AutoML open source software (OSS) tools and libraries that automate the entire life cycle of the ideation, conceptualization, development, and deployment of predictive models. From data preparation through model training to validation as well as deployment, these tools do everything with almost zero human intervention. In this chapter, we'll review the major OSS tools, including TPOT, AutoKeras, Auto-Sklearn, Featuretools, H2O AutoML, Auto-PyTorch, Microsoft NNI, and Amazon AutoGluon, and help you to understand the different value propositions and approaches used in each of these libraries.

Chapter 4, Getting Started with Azure Machine Learning, covers Azure Machine Learning, which helps accelerate the end-to-end machine learning life cycle using the power of the Windows Azure platform and services. In this chapter, we will review how to get started with an enterprise-grade machine learning service to build and deploy models that empower developers and data scientists for building, training, and deploying machine learning models faster. With examples, we will set up the groundwork to build and deploy AutoML solutions.

Chapter 5, Automated Machine Learning with Microsoft Azure, reviews in detail and with code examples, how can we automate time-consuming and iterative tasks of model development using an Azure machine learning stack and perform operations such as regression, classification, and time series analysis using Azure AutoML. This chapter will enable you to perform hyperparameter tuning to find the optimal parameters and find the optimal model with Azure AutoML.

Chapter 6, Machine Learning with Amazon Web Services, covers Amazon SageMaker Studio, Amazon SageMaker Autopilot, Amazon SageMaker Ground Truth, and Amazon SageMaker Neo, along with the other AI services and frameworks offered by AWS. As well as hyperscalers (cloud offerings), AWS offers one of the broadest and deepest sets of machine learning services and supporting cloud infrastructure, putting machine learning in the hands of every developer, data scientist, and expert practitioner. AWS offers machine learning services, AI services, deep learning frameworks, and learning tools to build, train, and deploy machine learning models fast.

Chapter 7, Doing Automated Machine Learning with Amazon SageMaker Autopilot, takes us on a deep dive into Amazon SageMaker Studio, using SageMaker Autopilot to run several candidates to figure out the optimal combination of data preprocessing steps, machine learning algorithms, and hyperparameters. The chapter provides a hands-on, illustrative overview of training an inference pipeline, for easy deployment on a real-time endpoint or batch processing.

Chapter 8, Machine Learning with Google Cloud Platform, reviews Google's AI and machine learning offerings. Google Cloud offers innovative machine learning products and services on a trusted and scalable platform. These services include AI Hub, AI building blocks such as sight, language, conversation, and structured data services, and AI Platform. In this chapter, you will become familiar with these offerings and understand how AI Platform supports Kubeflow, Google's open source platform, which lets developers build portable machine learning pipelines with access to cutting-edge Google AI technology such as TensorFlow, TPUs, and TFX tools to deploy your AI applications to production.

Chapter 9, Automated Machine Learning with GCP Cloud AutoML, shows you how to train custom business-specific machine learning models, with minimum effort and machine learning expertise. With hands-on examples and code walk-throughs, we will explore the Google Cloud AutoML platform to create customized deep learning models in natural language, vision, unstructured data, language translation, and video intelligence, without any knowledge of data science or programming.

Chapter 10, AutoML in the Enterprise, presents AutoML in an enterprise setting as a system to automate data science by generating fully automated reports that include an analysis of the data, as well as predictive models and a comparison of their performance. A unique feature of AutoML is that it provides natural-language descriptions of the results, suitable for non-experts in machine learning. We emphasize the operationalization of an MLOps pipeline with a discussion on approaches that perform well on practical problems and determine the best overall approach. The chapter details ideas and concepts behind real-world challenges and provides a journey map to address these problems.

To get the most out of this book

This book is an introduction to AutoML. Familiarity with data science, machine learning, and deep learning methodologies will be helpful to understand how AutoML improves upon existing methods.

If you are using the digital version of this book, we advise you to type the code yourself or access the code via the GitHub repository (link available in the next section). Doing so will help you avoid any potential errors related to the copying and pasting of code.

Download the color images

We also provide a PDF file that has color images of the screenshots/diagrams used in this book. You can download it here: https://static.packt-cdn.com/downloads/9781800567689_ColorImages.pdf.

Conventions used

There are a number of text conventions used throughout this book.

Code in text: Indicates code words in text, database table names, folder names, filenames, file extensions, pathnames, dummy URLs, user input, and Twitter handles. Here is an example: "Open the autopilot_customer_churn notebook from the amazonsagemaker-examples/autopilot folder."

A block of code is set as follows:

Bold: Indicates a new term, an important word, or words that you see onscreen. For example, words in menus or dialog boxes appear in the text like this. Here is an example: "From Amazon SageMaker Studio, start a data science notebook by clicking on the Python 3 button."

Tips or important notes

Appear like this.

Get in touch

Feedback from our readers is always welcome.

General feedback: If you have questions about any aspect of this book, mention the book title in the subject of your message and email us at customercare@packtpub.com.

Errata: Although we have taken every care to ensure the accuracy of our content, mistakes do happen. If you have found a mistake in this book, we would be grateful if you would report this to us. Please visit www.packtpub.com/support/errata, selecting your book, clicking on the Errata Submission Form link, and entering the details.

Piracy: If you come across any illegal copies of our works in any form on the Internet, we would be grateful if you would provide us with the location address or website name. Please contact us at copyright@packt.com with a link to the material.

If you are interested in becoming an author: If there is a topic that you have expertise in and you are interested in either writing or contributing to a book, please visit authors.packtpub.com.

Reviews

Please leave a review. Once you have read and used this book, why not leave a review on the site that you purchased it from? Potential readers can then see and use your unbiased opinion to make purchase decisions, we at Packt can understand what you think about our products, and our authors can see your feedback on their book. Thank you!

For more information about Packt, please visit packt.com.

lock icon
The rest of the chapter is locked
You have been reading a chapter from
Automated Machine Learning
Published in: Feb 2021Publisher: PacktISBN-13: 9781800567689
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
undefined
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime

Author (1)

author image
Adnan Masood

Adnan Masood, PhD is an artificial intelligence and machine learning researcher, visiting scholar at Stanford AI Lab, software engineer, Microsoft MVP (Most Valuable Professional), and Microsoft's regional director for artificial intelligence. As chief architect of AI and machine learning at UST Global, he collaborates with Stanford AI Lab and MIT CSAIL, and leads a team of data scientists and engineers building artificial intelligence solutions to produce business value and insights that affect a range of businesses, products, and initiatives.
Read more about Adnan Masood