ArticleslgStudy

science

Sub-Gaussian distribution

Sub-Gaussian distribution is a science topic covered in the lgStudy science library. This page brings together a partial reference excerpt, illustrations, worked examples, real-world applications and a short study plan, so you can understand Sub-Gaussian distribution rather than just read about it. In short: In probability theory, a subgaussian distribution, the distribution of a subgaussian random variable, is a probability distribution with strong tail decay. More specifically, the tails of a subgaussian distribution are dominated by (i.e. decay at least as fast as) the tails of a Gaussian.

Sub-Gaussian distribution — main illustration
Sub-Gaussian distribution — illustration

Key takeaways

  • Sub-Gaussian distribution belongs to science; place it in that map before memorising details.
  • Learn the definition first, then one example that makes the definition concrete.
  • Connect Sub-Gaussian distribution to a quantity you can measure, compute or draw — that is where exam questions come from.
  • Reproduce the core statement of Sub-Gaussian distribution from memory before moving on to harder problems.

Reference excerpt

In probability theory, a subgaussian distribution, the distribution of a subgaussian random variable, is a probability distribution with strong tail decay. More specifically, the tails of a subgaussian distribution are dominated by (i.e. decay at least as fast as) the tails of a Gaussian. This property gives subgaussian distributions their name. Often in analysis, we divide an object (such as a random variable) into two parts, a central bulk and a distant tail, then analyze each separately. In probability, this division usually goes like "Everything interesting happens near the center. The tail event is so rare, we may safely ignore that." Subgaussian distributions are worthy of study, because the gaussian distribution is well-understood, and so we can give sharp bounds on the rarity of the tail event. An analogous class, sometimes called subexponential distributions, is also useful; note however that the more established meaning of subexponential is almost the opposite -- that decay is slower than exponential rather than that the tail is lighter than exponential -- and so care must be taken with that term. Formally, the probability distribution of a random variable X {\displaystyle X} is called subgaussian if there is a positive constant C such that for every t ≥ 0 {\displaystyle t\geq 0} ,

P ( | X | ≥ t ) ≤ 2 exp ⁡ ( − t 2 / C 2 ) {\textstyle \mathbb {P} (|X|\geq t)\leq 2\exp {(-t^{2}/C^{2})}} . There are many equivalent definitions. For example, a random variable X {\displaystyle X} is sub-Gaussian iff its distribution function is bounded from above (up to a constant) by the distribution function of a Gaussian:

P ( | X | ≥ t ) ≤ c P ( | Z | ≥ t ) ∀ t > 0 {\displaystyle \mathbb {P} (|X|\geq t)\leq c\,\mathbb {P} (|Z|\geq t)\quad \forall t>0}

where c ≥ 0 {\displaystyle c\geq 0} is constant and Z {\displaystyle Z} is a mean zero Gaussian random variable.

Definitions

Subgaussian norm The subgaussian norm of X {\displaystyle X} , denoted as ‖ X ‖ ψ 2 {\displaystyle \Vert X\Vert _{\psi _{2}}} , is ‖ X ‖ ψ 2 = inf { c > 0 : E [ exp ⁡ ( X 2 c 2 ) ] ≤ 2 } . {\displaystyle \Vert X\Vert _{\psi _{2}}=\inf \left\{c>0:\mathbb {E} \left[\exp {\left({\frac {X^{2}}{c^{2}}}\right)}\right]\leq 2\right\}.} In other words, it is the Orlicz norm of X {\displaystyle X} generated by the Orlicz function Φ ( u ) = e u 2 − 1. {\displaystyle \Phi (u)=e^{u^{2}}-1.} By condition ( 2 ) {\displaystyle (2)} below, subgaussian random variables can be characterized as those random variables with finite subgaussian norm.

… excerpt ends here. Continue reading the full article.

Illustrations

Sub-Gaussian distribution: Density of a mixture of three normal distributions (μ = 5, 10, 15, σ = 2) with equal weights. Each component is shown as a weighted density (each integrating to 1/3)
Density of a mixture of three normal distributions (μ = 5, 10, 15, σ = 2) with equal weights. Each component is shown as a weighted density (each integrating to 1/3)

Worked examples

Example 1 — a first encounter with Sub-Gaussian distribution

Start with the simplest possible case. Write down what Sub-Gaussian distribution claims or describes in one sentence, then invent the smallest concrete situation in which that sentence is true. In science, the smallest case is usually a single object, a single equation or a single measurement. Check that every symbol or term in your sentence has a meaning in that case.

Example 2 — changing one variable

Take the situation from Example 1 and change exactly one quantity: double it, halve it, or set it to zero. Predict what should happen to Sub-Gaussian distribution before you calculate. Comparing your prediction with the result is the fastest way to find out whether you understand the idea or only the words.

Example 3 — an exam-style question

Typical questions about Sub-Gaussian distribution ask you to (a) state it precisely, (b) apply it to given data, and (c) explain a limitation. Practise writing all three answers in under five minutes; the third part is what separates a full-mark answer from an average one.

Applications of Sub-Gaussian distribution

In research
Sub-Gaussian distribution appears in science research whenever the underlying quantities have to be modelled precisely. Papers usually cite it as a starting assumption and then explore where it breaks down.
In technology and industry
Engineering practice reuses Sub-Gaussian distribution in design rules, simulations and safety margins. Knowing the idea lets you read a specification sheet and understand why the numbers look the way they do.
In the classroom
Sub-Gaussian distribution is common in secondary-school and first-year university syllabi. It links to neighbouring topics Continuous distributions, so understanding it makes those chapters shorter.
In everyday life
Look for Sub-Gaussian distribution outside the textbook — in sport, cooking, traffic, electronics or the sky above you. An example you found yourself is remembered far longer than one you were given.

Affiliate

Preply — study more efficiently by working with a personal tutor. 50% off.

How to study Sub-Gaussian distribution in 20 minutes

  1. Read the reference excerpt below once, without taking notes.
  2. Close the page and write down what Sub-Gaussian distribution means in your own words.
  3. Compare your version with the excerpt and mark what you missed.
  4. Work through the three examples above with pen and paper.
  5. Explain Sub-Gaussian distribution out loud to somebody else — or to Teacher Smith in the lgStudy chat.

Frequently asked questions

What is Sub-Gaussian distribution in simple terms?

In probability theory, a subgaussian distribution, the distribution of a subgaussian random variable, is a probability distribution with strong tail decay. More specifically, the tails of a subgaussian distribution are dominated by (i.e. decay at least as fast as) the tails of a Gaussian.

Why does Sub-Gaussian distribution matter?

Because it connects several science ideas at once: it gives you a definition you can apply, a quantity you can calculate, and a way to check whether a result is plausible.

How should I study Sub-Gaussian distribution?

Read the excerpt, restate it from memory, then work through the examples and applications listed on this page. The five-step study plan above takes about twenty minutes.

What does this page cover?

It gives you a compact reference excerpt plus original lgStudy explanations, examples, applications and study material on Sub-Gaussian distribution.

Tags

  • Continuous distributions

Keep exploring