Category: Expert stories
Linear regression is one of the most popular algorithms in both Statistics and Machine Learning. It is the simplest type of Machine Learning Algorithm.
The article on Linear Regression is the first of a set of blog articles that will go into this level of detail about different aspects of Machine Learning.
By Alan Lehane, Developer
Following on from my previous blog: Machine learning in theory:
This article will go into more technical detail about a specific type of Machine Learning Algorithm: Linear Regression.
Linear regression is one of the most popular algorithms in both Statistics and Machine Learning. It is the simplest type of Machine Learning Algorithm. This means that it is a good place to start. In this blog, I am going to explain how ML Algorithms work in general using Linear Regression as an example.
This type of algorithm is best used to predict trends or to find correlations in data sets. It is best trained using a supervised learning environment.
One would use a linear Regression algorithm to establish a linear connection between the input variables(x) and an output variable(y). For example, the output variable can be calculated using a linear combination of the input variables.
When a linear regression algorithm learns/trains on a data set, basically the algorithm is trying to work out what the Coefficients of the Linear Equation should be.
Supervised learning refers to the type of dataset used to train the ML algorithm. In a supervised dataset, the output variable(y) of each piece of example data in the dataset is a known value. I will cover unsupervised learning in a future blog.
If I am training an algorithm to predict house prices in my area, I would gather a dataset of houses that have previously been sold in my area.
I would gather as many features of the sold houses as I could, certain features are more important than others, but all features play some role so the more the better.
In our example, our goal is a linear equation that will predict the selling price of a house in the future.
When training our example the ML Model will iterate through the dataset, inserting the input values into the formula and the model will compare its predicted price to the actual price. If the predicted price and the actual price differ the model will adjust the coefficients and continue.
This process will continue for a set number of iterations or until an accuracy threshold has been achieved. The amount that the coefficient is altered depends on the type of Linear Regression Algorithm used.
Typically, non-discrete (non-numerical) input or output variables are assigned a numeric value to represent each possible option of the variable.
For example: For the Color input variable, White=1, Yellow=2, Red=3 etc. For binary input variables like Garage: No=-1 & yes=1.
Ordinary Least Squares attempts to minimize the sum of the square residuals. Imagine our dataset as a 2d Matrix of points where each point in the matrix is an example in our dataset. OLS attempts to draw a line through the matrix that has the shortest distance from the line to every point in the matrix.
With Gradient descent the coefficients are initially determined randomly, they are then adjusted depending on the learning rate (α), which is set by the user. The coefficient is adjusted in the direction of reducing the error.
Regularization attempts to reduce the complexity of the model while also reducing the error at the same time. 2 examples of Regularization are:
Lasso Regression is a modified OLS that also minimizes the absolute sum of the coefficients.
Ridge Regression is also a modified OLS that minimizes the squared absolute sum of the coefficients.
In this blog, we learned:
Alan Lehane, Software Developer
Alan has been working with Aspira for 4 years as a Software Developer, specialising in Data Analytics and Machine Learning. He has provided a wide variety of services to Aspira’s clients including Software Development, Test Automation, Data Analysis and Machine Learning.
This article discusses how the integration of artificial intelligence (AI) and machine learning (ML) into project management is driving a cultural shift towards innovation and agility within organizations.
Discover the future of the automotive industry with insights into the rise of autonomous driving, electric vehicles, and AI innovations. Learn about new regulations, industry challenges, and groundbreaking technologies transforming transportation and car manufacturing.
Learn the ins and outs of the world’s first comprehensive legal framework on AI, the new EU AI Act and its anticipated impact on businesses.
This article discusses practical strategies to align development requirements with actionable tasks, aiming for more efficient development cycles and better collaboration in the team.
Software developer & emagineer explores the possibilities of building an application prototype with Chat GPT in this step-by-step guide.
From simplifying HTTP requests to optimizing data mapping, front-end developer and emagineer Kamil Naja discusses the different approaches to generating front-end code.
Watch our on-demand webinar on how to increase time to market by more than 25% while improving quality, featuring Danfoss E-commerce.
Dive deep into the dynamic duo of Intelligent Automation and Advanced Analytics. Discover how they work hand-in-hand to streamline data processing, extract profound insights, and drive impactful business actions.
Join emagineer and software architect Mateusz Pruchniak as he explores Microsoft Dev Box, virtualized solution that enables IT engineers to quickly launch self-service workstations while maintaining centralized management.
On-demand webinar for attendees:
We dive deep into the dynamic duo of Intelligent Automation and Advanced Analytics. Discover how they work hand-in-hand to streamline data processing, extract profound insights, and drive impactful business actions. The topics will include real-life case studies, expert insights, and the latest trends.
We constantly hear that AI will take control of everything and that we as humans will become less necessary or even redundant—is that really the case? In the following article, Cloud Administrator and emagineer Paweł Pancerz discusses how this revolution will unfold in the near future.
How does voice recognition function in vehicles, and what technologies and expertise drive its success? Let’s delve into the future by exploring what goes on behind the cockpit.
In the realm of front-end solutions, the vital role of back-end applications cannot be overstated. In this article, emagineer Kamil Naja delves into the world of backend development, uncovering effective methods to optimize the process.
Explore how businesses can strike a balance between embracing AI’s immense potential and maintaining the human touch that fosters trust and connection.
Logistic Regression is a Linear Model for classification; a traditional linear model is used to predict a numerical value. Learn how logistic Regression works and how it differs from Linear Regression.
Join us in this webinar as we delve into the intricacies of IT transitions, spotlighting the key players: the customer, the outgoing vendor, and the incoming vendor.
Automation and RPA is on the rise as businesses vie to remain competitive. Understand the factors driving this trend as companies work to stay ahead of the curve.
Artificial intelligence (AI) is revolutionising the banking industry by transforming how banks operate, interact with their customers, and influence decisions. A key benefit often discussed is the noteworthy cost savings leveraged by AI tools, but what are the others?
In this blog, I give a simple overview and an example of a non-linear Algorithm, Decision Trees, how they work and how they are created. Part of the Machine Learning Blog Series.
Linear regression is one of the most popular algorithms in both Statistics and Machine Learning. It is the simplest type of Machine Learning Algorithm. This means that it is a good place to start. In this blog, Allan Lehane is going to explain how ML Algorithms work in general using Linear Regression as an example.
As organizations strive to deliver high-quality software and services at scale, many are turning to a microservices architecture as a way to break down monolithic applications into smaller, more manageable components.
In this article we are going to discuss how a Machine Learning algorithm works in theory and I’m also going to discuss an example of a full stack application with a Machine Learning Component, which is hosted on Microsoft Azure.