Search icon
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Machine Learning with Swift

You're reading from  Machine Learning with Swift

Product type Book
Published in Feb 2018
Publisher Packt
ISBN-13 9781787121515
Pages 378 pages
Edition 1st Edition
Languages
Authors (3):
Jojo Moolayil Jojo Moolayil
Profile icon Jojo Moolayil
Alexander Sosnovshchenko Alexander Sosnovshchenko
Profile icon Alexander Sosnovshchenko
Oleksandr Baiev Oleksandr Baiev
View More author details

Table of Contents (18) Chapters

Title Page
Packt Upsell
Contributors
Preface
Getting Started with Machine Learning Classification – Decision Tree Learning K-Nearest Neighbors Classifier K-Means Clustering Association Rule Learning Linear Regression and Gradient Descent Linear Classifier and Logistic Regression Neural Networks Convolutional Neural Networks Natural Language Processing Machine Learning Libraries Optimizing Neural Networks for Mobile Devices Best Practices Index

Building a neural layer in Swift


A fully-connected layer is easy to implement, because it can be expressed as two operations:

  • A matrix multiplication between weights matrix W and input vector x.
  • A point wise application of activation function f :

Figure 8.5: One layer in detail

In many frameworks, the two operations are separated so that matrix multiplication happens in the fully-connected layer and activation happens in the next nonlinearity layer. This is handy because in this way we can easily replace the weighted sum with convolution. In the next chapter, we will discuss convolutional NNs.

But for now, let's see how NNs can perform logical operations. One neuron is enough to model any logical gate, except XOR. This finding caused the first AI winter in the 1960s; however, XOR is trivial to a model having a network with two layers.

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime}