Introduction to Artificial Intelligence and Machine Learning

Artificial Intelligence is a field of study that affects all aspects of modern living. Therefore, in this module we would explain the concept of AI as well as give a formal definition of the subject. You can just go ahead to the topic: Get Started With Machine Learning or you can choose from any of the topics below

 

We would examine the following:

  1. AI and Machine Learning
  2. Supervised and Unsupervised Learning
  3. Introduction to Neural Networks
  4. What is Deep Learning

 

Machine Learning is the branch of Artificial Intelligence concerned with machine machines exhibit intelligence similar to that of humans. Machine Learning is becoming very very popular as the focus is shifting to things like Computer Vision, Image Recognition, Self-Driving Cars etc. Read more…

What is AI? AI have been defined in a number of ways. For example, “the process of building systems that could carry out functions the ordinarily would require human intervention”

The point is that there is no one definition that could generally be accepted but all the definition relate to the idea of creating machines that could mimic human activities.

 

1. What is Machine Learning?

To understand the basics of machine learning, think of how how normal computer programs works. You write a program, and feed it into the computer. Then you provide some input data to the program. Some calculation or processing with the input data and then you have your output. This is illustrated in Figure 1.

 

Figure 1: Maching Learning

Figure 1: Machine Learning vs Conventional Programming

 

With Machine Learning algorithms, you provide an input dataset along with the outputs for the data. The algorithm would then examine this data and build a model it would use to deduce the outputs of new inputs.

The input and output dataset is called Training Data and the process where the algorithm examines the data to build a model(program) is called Training or Learning.

 

2. Supervised and Unsupervised Learning

Machine Learning is divided into two broad paradigms

Supervised Learning: In this variation, the system is provided with a given set of feature/label pairs and the learning algorithm would have to deduce the implicit relationship between the pairs. That is find a rule that predicts the label associated with a previously unseen input.

Unsupervised Learning: In this variation a given set of features (feature vector) without labels, the task of the algorithms is to find a way to create a label for the group. Maybe by grouping the data into some kind of natural clusters.

There is a third variation called Reinforcement Learning. This variation is has to to with finding a suitable action to take in a given situation with the goal of maximizing certain reward for the action. This technique was highlighted in 1998 by Sutto & Barto. Here the algorithm is not given optimal inputs, but must deduce via a trial and error process.

Figure 2: Variations of Machine Learning

Figure 2: Variations of Machine Learning

 

3. Introduction to Neural Networks

Between the two more topics I would like to introduce: Neural Networks and Deep Learning, I choose to start with Neural Networks since you need some basics of knowledge of Neural Network as a prerequisite for Deep Learning.

In the heart of machine learning is Artificial Neural Network. This is simply a machine learning approach of mimicking the working of the human brain. This is such that attempts are made to deduce the mathematical representation of the way the human brain processes information.

A Neural Network is a network of nodes and edges where the nodes are called Neurons. A neuron is a single processing unit and has an input and an output. The input and output of a neuron are connected to other neurons as well, to form a network. However the arrangement of the connection are arranged in a layered form as shown in the Figure 3.

Neural Network

Figure 3: Neural Network

 

What is a Perceptron? A Perceptron is also a neural network but with just one neuron! Read more on Perceptrons

 

4. What is Deep Learning?

Deep Learning is a subset of Machine Learning which based on complex neural networks. Deep Learning works with Neural Networks that have several hidden layers where hidden layers are layers between the input layer and the output layer.

More on Difference Between Machine Learning and Deep Learning.