ArticleslgStudy

mathematics

Orthogonalization

Orthogonalization is a mathematics topic covered in the lgStudy science library. This page brings together a partial reference excerpt, illustrations, worked examples, real-world applications and a short study plan, so you can understand Orthogonalization rather than just read about it. In short: In linear algebra, orthogonalization is the process of finding a set of orthogonal vectors that span a particular subspace. Formally, starting with a linearly independent set of vectors {v1, ... , vk} in an inner product space (most commonly the Euclidean space Rn), orthogonalization results in a set of orthogonal vectors {u1, ... , uk} that generate the same subspace as the vectors v1, ... , vk.

Key takeaways

  • Orthogonalization belongs to mathematics; place it in that map before memorising details.
  • Learn the definition first, then one example that makes the definition concrete.
  • Connect Orthogonalization to a quantity you can measure, compute or draw — that is where exam questions come from.
  • Reproduce the core statement of Orthogonalization from memory before moving on to harder problems.

Reference excerpt

In linear algebra, orthogonalization is the process of finding a set of orthogonal vectors that span a particular subspace. Formally, starting with a linearly independent set of vectors {v1, ... , vk} in an inner product space (most commonly the Euclidean space Rn), orthogonalization results in a set of orthogonal vectors {u1, ... , uk} that generate the same subspace as the vectors v1, ... , vk. Every vector in the new set is orthogonal to every other vector in the new set; and the new set and the old set have the same linear span. In addition, if we want the resulting vectors to all be unit vectors, then we normalize each vector and the procedure is called orthonormalization. Orthogonalization is also possible with respect to any symmetric bilinear form (not necessarily an inner product, not necessarily over real numbers), but standard algorithms may encounter division by zero in this more general setting.

Orthogonalization algorithms Methods for performing orthogonalization include:

Gram–Schmidt process, which uses projection Householder transformation, which uses reflection Givens rotation Symmetric orthogonalization, which uses the Singular value decomposition When performing orthogonalization on a computer, the Householder transformation is usually preferred over the Gram–Schmidt process since it is more numerically stable, i.e. rounding errors tend to have less serious effects. On the other hand, the Gram–Schmidt process produces the jth orthogonalized vector after the jth iteration, while orthogonalization using Householder reflections produces all the vectors only at the end. This makes only the Gram–Schmidt process applicable for iterative methods like the Arnoldi iteration. The Givens rotation is more easily parallelized than Householder transformations. Symmetric orthogonalization was formulated by Per-Olov Löwdin.

Local orthogonalization To compensate for the loss of useful signal in traditional noise attenuation approaches because of incorrect parameter selection or inadequacy of denoising assumptions, a weighting operator can be applied on the initially denoised section for the retrieval of useful signal from the initial noise section. The new denoising process is referred to as the local orthogonalization of signal and noise. It has a wide range of applications in many signals processing and seismic exploration fields.

See also

Orthogonality Biorthogonal system Orthogonal basis

References

Worked examples

Example 1 — a first encounter with Orthogonalization

Start with the simplest possible case. Write down what Orthogonalization claims or describes in one sentence, then invent the smallest concrete situation in which that sentence is true. In mathematics, the smallest case is usually a single object, a single equation or a single measurement. Check that every symbol or term in your sentence has a meaning in that case.

Example 2 — changing one variable

Take the situation from Example 1 and change exactly one quantity: double it, halve it, or set it to zero. Predict what should happen to Orthogonalization before you calculate. Comparing your prediction with the result is the fastest way to find out whether you understand the idea or only the words.

Example 3 — an exam-style question

Typical questions about Orthogonalization ask you to (a) state it precisely, (b) apply it to given data, and (c) explain a limitation. Practise writing all three answers in under five minutes; the third part is what separates a full-mark answer from an average one.

Applications of Orthogonalization

In research
Orthogonalization appears in mathematics research whenever the underlying quantities have to be modelled precisely. Papers usually cite it as a starting assumption and then explore where it breaks down.
In technology and industry
Engineering practice reuses Orthogonalization in design rules, simulations and safety margins. Knowing the idea lets you read a specification sheet and understand why the numbers look the way they do.
In the classroom
Orthogonalization is common in secondary-school and first-year university syllabi. It links to neighbouring topics Linear algebra, so understanding it makes those chapters shorter.
In everyday life
Look for Orthogonalization outside the textbook — in sport, cooking, traffic, electronics or the sky above you. An example you found yourself is remembered far longer than one you were given.

Affiliate

Preply — study more efficiently by working with a personal tutor. 50% off.

How to study Orthogonalization in 20 minutes

  1. Read the reference excerpt below once, without taking notes.
  2. Close the page and write down what Orthogonalization means in your own words.
  3. Compare your version with the excerpt and mark what you missed.
  4. Work through the three examples above with pen and paper.
  5. Explain Orthogonalization out loud to somebody else — or to Teacher Smith in the lgStudy chat.

Frequently asked questions

What is Orthogonalization in simple terms?

In linear algebra, orthogonalization is the process of finding a set of orthogonal vectors that span a particular subspace. Formally, starting with a linearly independent set of vectors {v1, ... , vk} in an inner product space (most commonly the Euclidean space Rn), orthogonalization results in a s…

Why does Orthogonalization matter?

Because it connects several mathematics ideas at once: it gives you a definition you can apply, a quantity you can calculate, and a way to check whether a result is plausible.

How should I study Orthogonalization?

Read the excerpt, restate it from memory, then work through the examples and applications listed on this page. The five-step study plan above takes about twenty minutes.

What does this page cover?

It gives you a compact reference excerpt plus original lgStudy explanations, examples, applications and study material on Orthogonalization.

Tags

  • Linear algebra

Keep exploring