ArticleslgStudy

mathematics

Linear approximation

Linear approximation is a mathematics topic covered in the lgStudy science library. This page brings together a partial reference excerpt, illustrations, worked examples, real-world applications and a short study plan, so you can understand Linear approximation rather than just read about it. In short: In mathematics, a linear approximation is an approximation of a general function using a linear function (more precisely, an affine function). They are widely used in the method of finite differences to produce first order methods for solving or approximating solutions to equations.

Linear approximation — main illustration
Linear approximation — illustration

Key takeaways

  • Linear approximation belongs to mathematics; place it in that map before memorising details.
  • Learn the definition first, then one example that makes the definition concrete.
  • Connect Linear approximation to a quantity you can measure, compute or draw — that is where exam questions come from.
  • Reproduce the core statement of Linear approximation from memory before moving on to harder problems.

Reference excerpt

In mathematics, a linear approximation is an approximation of a general function using a linear function (more precisely, an affine function). They are widely used in the method of finite differences to produce first order methods for solving or approximating solutions to equations.

Definition Given a twice continuously differentiable function f {\displaystyle f} of one real variable, Taylor's theorem for the case n = 1 {\displaystyle n=1} states that

f ( x ) = f ( a ) + f ′ ( a ) ( x − a ) + R 2 {\displaystyle f(x)=f(a)+f'(a)(x-a)+R_{2}}

where R 2 {\displaystyle R_{2}} is the remainder term. The linear approximation is obtained by dropping the remainder:

f ( x ) ≈ f ( a ) + f ′ ( a ) ( x − a ) . {\displaystyle f(x)\approx f(a)+f'(a)(x-a).}

This is a good approximation when x {\displaystyle x} is close enough to a {\displaystyle a} ; since a curve, when closely observed, will begin to resemble a straight line. Therefore, the expression on the right-hand side is just the equation for the tangent line to the graph of f {\displaystyle f} at ( a , f ( a ) ) {\displaystyle (a,f(a))} . For this reason, this process is also called the tangent line approximation. Linear approximations in this case are further improved when the second derivative of a, f ″ ( a ) {\displaystyle f''(a)} , is sufficiently small (close to zero) (i.e., at or near an inflection point). If f {\displaystyle f} is concave down in the interval between x {\displaystyle x} and a {\displaystyle a} , the approximation will be an overestimate (since the derivative is decreasing in that interval). If f {\displaystyle f} is concave up, the approximation will be an underestimate. Linear approximations for vector functions of a vector variable are obtained in the same way, with the derivative at a point replaced by the Jacobian matrix. For example, given a differentiable function f ( x , y ) {\displaystyle f(x,y)} with real values, one can approximate f ( x , y ) {\displaystyle f(x,y)} for ( x , y ) {\displaystyle (x,y)} close to ( a , b ) {\displaystyle (a,b)} by the formula

f ( x , y ) ≈ f ( a , b ) + ∂ f ∂ x ( a , b ) ( x − a ) + ∂ f ∂ y ( a , b ) ( y − b ) . {\displaystyle f\left(x,y\right)\approx f\left(a,b\right)+{\frac {\partial f}{\partial x}}\left(a,b\right)\left(x-a\right)+{\frac {\partial f}{\partial y}}\left(a,b\right)\left(y-b\right).}

The right-hand side is the equation of the plane tangent to the graph of z = f ( x , y ) {\displaystyle z=f(x,y)} at ( a , b ) . {\displaystyle (a,b).}

In the more general case of Banach spaces, one has

f ( x ) ≈ f ( a ) + D f ( a ) ( x − a ) {\displaystyle f(x)\approx f(a)+Df(a)(x-a)}

where D f ( a ) {\displaystyle Df(a)} is the Fréchet derivative of f {\displaystyle f} at a {\displaystyle a} .

Applications

Optics

Gaussian optics is a technique in geometrical optics that describes the behaviour of light rays in optical systems by using the paraxial approximation, in which only rays which make small angles with the optical axis of the system are considered. In this approximation, trigonometric functions can be expressed as linear functions of the angles. Gaussian optics applies to systems in which all the optical surfaces are either flat or are portions of a sphere. In this case, simple explicit formulae can be given for parameters of an imaging system such as focal distance, magnification and brightness, in terms of the geometrical shapes and material properties of the constituent elements.

Period of oscillation

… excerpt ends here. Continue reading the full article.

Illustrations

Linear approximation: Tangent line at (a, f(a))
Tangent line at (a, f(a))

Worked examples

Example 1 — a first encounter with Linear approximation

Start with the simplest possible case. Write down what Linear approximation claims or describes in one sentence, then invent the smallest concrete situation in which that sentence is true. In mathematics, the smallest case is usually a single object, a single equation or a single measurement. Check that every symbol or term in your sentence has a meaning in that case.

Example 2 — changing one variable

Take the situation from Example 1 and change exactly one quantity: double it, halve it, or set it to zero. Predict what should happen to Linear approximation before you calculate. Comparing your prediction with the result is the fastest way to find out whether you understand the idea or only the words.

Example 3 — an exam-style question

Typical questions about Linear approximation ask you to (a) state it precisely, (b) apply it to given data, and (c) explain a limitation. Practise writing all three answers in under five minutes; the third part is what separates a full-mark answer from an average one.

Applications of Linear approximation

In research
Linear approximation appears in mathematics research whenever the underlying quantities have to be modelled precisely. Papers usually cite it as a starting assumption and then explore where it breaks down.
In technology and industry
Engineering practice reuses Linear approximation in design rules, simulations and safety margins. Knowing the idea lets you read a specification sheet and understand why the numbers look the way they do.
In the classroom
Linear approximation is common in secondary-school and first-year university syllabi. It links to neighbouring topics Differential calculus, First order methods, Numerical analysis, so understanding it makes those chapters shorter.
In everyday life
Look for Linear approximation outside the textbook — in sport, cooking, traffic, electronics or the sky above you. An example you found yourself is remembered far longer than one you were given.

Affiliate

Preply — study more efficiently by working with a personal tutor. 50% off.

How to study Linear approximation in 20 minutes

  1. Read the reference excerpt below once, without taking notes.
  2. Close the page and write down what Linear approximation means in your own words.
  3. Compare your version with the excerpt and mark what you missed.
  4. Work through the three examples above with pen and paper.
  5. Explain Linear approximation out loud to somebody else — or to Teacher Smith in the lgStudy chat.

Frequently asked questions

What is Linear approximation in simple terms?

In mathematics, a linear approximation is an approximation of a general function using a linear function (more precisely, an affine function). They are widely used in the method of finite differences to produce first order methods for solving or approximating solutions to equations.

Why does Linear approximation matter?

Because it connects several mathematics ideas at once: it gives you a definition you can apply, a quantity you can calculate, and a way to check whether a result is plausible.

How should I study Linear approximation?

Read the excerpt, restate it from memory, then work through the examples and applications listed on this page. The five-step study plan above takes about twenty minutes.

What does this page cover?

It gives you a compact reference excerpt plus original lgStudy explanations, examples, applications and study material on Linear approximation.

Tags

  • Differential calculus
  • First order methods
  • Numerical analysis

Keep exploring