{"id":6527,"date":"2021-09-27T14:38:33","date_gmt":"2021-09-27T09:08:33","guid":{"rendered":"https:\/\/www.goseeko.com\/blog\/?p=5673"},"modified":"2021-09-27T14:38:33","modified_gmt":"2021-09-27T09:08:33","slug":"what-is-the-method-of-least-squares","status":"publish","type":"post","link":"https:\/\/www.goseeko.com\/blog\/what-is-the-method-of-least-squares\/","title":{"rendered":"What is the method of least squares?"},"content":{"rendered":"\n

Overview<\/strong><\/h2>\n\n\n\n

Introduction to the method of least squares- When we find the area of a triangle then it depends on base and height, hence we can say that area of the triangle is the function of base and height. Symbolically and mathematically the relationship is defined as below-<\/p>\n\n\n\n

z is called a function of two variables x and y if z has one definite value for every pair of values of x and y.<\/p>\n\n\n\n

it is written as<\/p>\n\n\n\n

z = f (x, y)<\/p>\n\n\n\n

The variable x and y are called independent variables while z is called the dependent variable.<\/p>\n\n\n\n

Note- the function z = f (x, y) represents a surface.<\/p>\n\n\n\n

Method of least squares<\/strong><\/h2>\n\n\n\n

Suppose<\/p>\n\n\n\n

y = a + bx \u2026\u2026\u2026. (1)<\/p>\n\n\n\n

is the straight line has to be fitted for the data points given-<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Let y1 be the theoretical value for x1<\/p>\n\n\n\n

Now-<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

For the minimum value of S –<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Or<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Now<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Or<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

On solving equation (1) and (2), we get-<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

These two equations are known as the normal equations.<\/p>\n\n\n\n

Now on solving these two equations we get the values of a and b.<\/p>\n\n\n\n

Solved example<\/strong>s<\/h2>\n\n\n\n

Example: Find the straight line that best fits of the following data by using method of least square.<\/strong><\/p>\n\n\n\n

X<\/strong><\/td>1<\/strong><\/td>2<\/strong><\/td>3<\/strong><\/td>4<\/strong><\/td>5<\/strong><\/td><\/tr>
y<\/strong><\/td>14<\/strong><\/td>27<\/strong><\/td>40<\/strong><\/td>55<\/strong><\/td>68<\/strong><\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

Sol.<\/p>\n\n\n\n

Suppose the straight line<\/p>\n\n\n\n

y = a + bx\u2026\u2026.. (1)<\/p>\n\n\n\n

Fits the best-<\/p>\n\n\n\n

Then-<\/p>\n\n\n\n

x<\/td>y<\/td>xy<\/td>x^2<\/td><\/tr>
1<\/td>14<\/td>14<\/td>1<\/td><\/tr>
2<\/td>27<\/td>54<\/td>4<\/td><\/tr>
3<\/td>40<\/td>120<\/td>9<\/td><\/tr>
4<\/td>55<\/td>220<\/td>16<\/td><\/tr>
5<\/td>68<\/td>340<\/td>25<\/td><\/tr>
Sum = 15<\/td>204<\/td>748<\/td>55<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

Normal equations are-<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Put the values from the table, we get two normal equations-<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

On solving the above equations, we get-<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

So that the best fit line will be- (on putting the values of a and b in equation (1))<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Example: Find the best values of a and b so that y = a + bx fits the data given in the table<\/strong><\/p>\n\n\n\n

x<\/strong><\/td>0<\/strong><\/td>1<\/strong><\/td>2<\/strong><\/td>3<\/strong><\/td>4<\/strong><\/td><\/tr>
y<\/strong><\/td>1.0<\/strong><\/td>2.9<\/strong><\/td>4.8<\/strong><\/td>6.7<\/strong><\/td>8.6<\/strong><\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

Solution:<\/strong><\/p>\n\n\n\n

 y = a + bx<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Normal equations, <\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

On putting the values of in (2) and (3), we get<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

On solving (4) and (5) we get,<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Substituting the values of a and b in (1) we obtain<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Interested in learning about similar topics? Here are a few hand-picked blogs for you!<\/p>\n\n\n\n