Reader small image

You're reading from  AI & Data Literacy

Product typeBook
Published inJul 2023
PublisherPackt
ISBN-139781835083505
Edition1st Edition
Right arrow
Author (1)
Bill Schmarzo
Bill Schmarzo
author image
Bill Schmarzo

Bill Schmarzo, The Dean of Big Data is a University of San Francisco School of Management Executive Fellow and an Honorary Professor at the School of Business and Economics at the National University of Ireland-Galway where he teaches and mentors students in his courses “Big Data MBA” and “Thinking Like a Data Scientist". He is the author of Big Data: Understanding How Data Powers Big Business, Big Data MBA: Driving Business Strategies with Data Science, and The Art of Thinking Like a Data Scientist. He has written countless whitepapers, articles and blogs, and given keynote presentations and university lectures on the topics of data science, artificial intelligence/machine learning, data economics, design thinking and team empowerment.
Read more about Bill Schmarzo

Right arrow

Join our book community on Discord

https://packt.link/EarlyAccessCommunity

Qr code Description automatically generated
“The Horror. The Horror.”–Colonel Walter E. Kurtz (Marlon Brando), Apocalypse Now

While writing this book, ChatGPT exploded onto the scene, providing me with a perfect opportunity to test many of the concepts detailed in the book.ChatGPT changes everything concerning our expectations for a world dominated by AI and Big Data. Unlike previous AI usage that worked behind the scenes to optimize business and operational use cases such as GPS navigation, hiring, financing, and college applications, ChatGPT is front-and-center, engaging in intelligent conversations with humans. And while ChatGPT may make mistakes today, we know that AI is a learning technology, and ChatGPT and other Generative AI products will learn and grow exponentially.ChatGPT and GPT-4 have created a massive debate regarding what we should do to contain or control AI before it’s too late. AI Industry leaders such as...

What are ChatGPT and Generative AI?

Generative AI is an artificial intelligence system that relies on unsupervised or semi-supervised learning algorithms to create new original digital content (e.g., articles, program code, poetry, photographs, artwork, and music) by learning from existing data or content.ChatGPT (Generative Pre-trained Transformer) is a Generative AI chatbot launched by OpenAI in November 2022. It is built on OpenAI's GPT-3.5 family of Large Language Models (LLMs) and fine-tuned with supervised and reinforcement learning techniques.ChatGPT uses supervised learning to train its LLM. The supervised learning model uses the labeled data gleaned from websites and digital books to identify statistical language patterns buried in the massive data sets to train a LLM. The LLM then leverages these statistical language patterns and Natural Language Processing (NLP) to generate human-like responses.ChatGPT also uses Reinforcement Learning from Human Feedback (RLHF) to continue...

How does ChatGPT work?

ADD

Beginner Level 101 (Mother-in-Law Level)

If I had to explain ChatGPT to my mother-in-law, I’d say that ChatGPT is a simple concept that does four things exceptionally well:

  1. Analyzes the public internet and creates a contextual knowledge base.

For example, ChatGPT accesses and is trained on all recipes, ingredients, instructions, and expected outcomes on public cooking websites.

  1. Determines relevant language usage patterns and relationships.

In our cooking example, ChatGPT uses its AI brain to analyze all the cooking websites to identify relevant patterns and relationships concerning recipes, ingredients, cooking instructions, and expected outcomes.

  1. Parses user requests to determine user intent (better than most humans).

In our cooking example, my mother-in-law types in a cooking request. ChatGPT reads the request and uses its AI brain to determine my mother-in-law’s intent and what she is asking.

  1. Predicts what content is most relevant based...

ADD

ADD

Role of LLMs

A LLM is an artificial intelligence algorithm that can learn language patterns and relationships between words and phrases in textual data. It uses those patterns and relationships to predict a given context's next word or phrase.LLMs, such as GPT-3, are the backbone of intelligent AI chatbots like ChatGPT. Key aspects and concerns of an LLM include:

  • Training data: LLMs are trained on vast amounts of text data, such as digital books, articles, and web pages. The LLM uses this data to learn patterns in language (word and position of words in sentences, paragraphs, and articles) and develop the ability to understand and generate human-like text.
  • Natural Language Process: These intelligent AI chatbots leverage a NLP system to understand and generate human-like language
  • Applications: LLMs have a wide range of applications, including language translation, content generation, text summarization, language generation, answering questions, and more.
  • Architecture: LLMs...
lock icon
The rest of the chapter is locked
You have been reading a chapter from
AI & Data Literacy
Published in: Jul 2023Publisher: PacktISBN-13: 9781835083505
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
undefined
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime

Author (1)

author image
Bill Schmarzo

Bill Schmarzo, The Dean of Big Data is a University of San Francisco School of Management Executive Fellow and an Honorary Professor at the School of Business and Economics at the National University of Ireland-Galway where he teaches and mentors students in his courses “Big Data MBA” and “Thinking Like a Data Scientist". He is the author of Big Data: Understanding How Data Powers Big Business, Big Data MBA: Driving Business Strategies with Data Science, and The Art of Thinking Like a Data Scientist. He has written countless whitepapers, articles and blogs, and given keynote presentations and university lectures on the topics of data science, artificial intelligence/machine learning, data economics, design thinking and team empowerment.
Read more about Bill Schmarzo