ArticleslgStudy

mathematics

Hamming space

Hamming space is a mathematics topic covered in the lgStudy science library. This page brings together a partial reference excerpt, illustrations, worked examples, real-world applications and a short study plan, so you can understand Hamming space rather than just read about it. In short: In statistics and coding theory, a Hamming space is usually the set of all 2 N {\displaystyle 2^{N}} binary strings of length N, where different binary strings are considered to be adjacent when they differ only in one position. The total distance between any two binary strings is then the total number of positions at which the corresponding bits are different, called the Hamming distance.

Hamming space — main illustration
Hamming space — illustration

Key takeaways

  • Hamming space belongs to mathematics; place it in that map before memorising details.
  • Learn the definition first, then one example that makes the definition concrete.
  • Connect Hamming space to a quantity you can measure, compute or draw — that is where exam questions come from.
  • Reproduce the core statement of Hamming space from memory before moving on to harder problems.

Reference excerpt

In statistics and coding theory, a Hamming space is usually the set of all 2 N {\displaystyle 2^{N}} binary strings of length N, where different binary strings are considered to be adjacent when they differ only in one position. The total distance between any two binary strings is then the total number of positions at which the corresponding bits are different, called the Hamming distance. Hamming spaces are named after American mathematician Richard Hamming, who introduced the concept in 1950. They are used in the theory of coding signals and transmission. More generally, a Hamming space can be defined over any alphabet (set) Q as the set of words of a fixed length N with letters from Q. If Q is a finite field, then a Hamming space over Q is an N-dimensional vector space over Q. In the typical, binary case, the field is thus GF(2) (also denoted by Z2). In coding theory, if Q has q elements, then any subset C (usually assumed of cardinality at least two) of the N-dimensional Hamming space over Q is called a q-ary code of length N; the elements of C are called codewords. In the case where C is a linear subspace of its Hamming space, it is called a linear code. A typical example of linear code is the Hamming code. Codes defined via a Hamming space necessarily have the same length for every codeword, so they are called block codes when it is necessary to distinguish them from variable-length codes that are defined by unique factorization on a monoid. The Hamming distance endows a Hamming space with a metric, which is essential in defining basic notions of coding theory such as error detecting and error correcting codes. Hamming spaces over non-field alphabets have also been considered, especially over finite rings (most notably over Z4) giving rise to modules instead of vector spaces and ring-linear codes (identified with submodules) instead of linear codes. The typical metric used in this case the Lee distance. There exist a Gray isometry between Z 2 2 m {\displaystyle \mathbb {Z} _{2}^{2m}} (i.e. GF(22m)) with the Hamming distance and Z 4 m {\displaystyle \mathbb {Z} _{4}^{m}} (also denoted as GR(4,m)) with the Lee distance.

References

Illustrations

Hamming space: The Hamming space of binary strings of length 3. The distance between vertices in the cube graph equals the Hamming distance between the strings.
The Hamming space of binary strings of length 3. The distance between vertices in the cube graph equals the Hamming distance between the strings.

Worked examples

Example 1 — a first encounter with Hamming space

Start with the simplest possible case. Write down what Hamming space claims or describes in one sentence, then invent the smallest concrete situation in which that sentence is true. In mathematics, the smallest case is usually a single object, a single equation or a single measurement. Check that every symbol or term in your sentence has a meaning in that case.

Example 2 — changing one variable

Take the situation from Example 1 and change exactly one quantity: double it, halve it, or set it to zero. Predict what should happen to Hamming space before you calculate. Comparing your prediction with the result is the fastest way to find out whether you understand the idea or only the words.

Example 3 — an exam-style question

Typical questions about Hamming space ask you to (a) state it precisely, (b) apply it to given data, and (c) explain a limitation. Practise writing all three answers in under five minutes; the third part is what separates a full-mark answer from an average one.

Applications of Hamming space

In research
Hamming space appears in mathematics research whenever the underlying quantities have to be modelled precisely. Papers usually cite it as a starting assumption and then explore where it breaks down.
In technology and industry
Engineering practice reuses Hamming space in design rules, simulations and safety margins. Knowing the idea lets you read a specification sheet and understand why the numbers look the way they do.
In the classroom
Hamming space is common in secondary-school and first-year university syllabi. It links to neighbouring topics Coding theory, Linear algebra, Linear algebra stubs, so understanding it makes those chapters shorter.
In everyday life
Look for Hamming space outside the textbook — in sport, cooking, traffic, electronics or the sky above you. An example you found yourself is remembered far longer than one you were given.

Affiliate

Preply — study more efficiently by working with a personal tutor. 50% off.

How to study Hamming space in 20 minutes

  1. Read the reference excerpt below once, without taking notes.
  2. Close the page and write down what Hamming space means in your own words.
  3. Compare your version with the excerpt and mark what you missed.
  4. Work through the three examples above with pen and paper.
  5. Explain Hamming space out loud to somebody else — or to Teacher Smith in the lgStudy chat.

Frequently asked questions

What is Hamming space in simple terms?

In statistics and coding theory, a Hamming space is usually the set of all 2 N {\displaystyle 2^{N}} binary strings of length N, where different binary strings are considered to be adjacent when they differ only in one position. The total distance between any two binary strings is then the total nu…

Why does Hamming space matter?

Because it connects several mathematics ideas at once: it gives you a definition you can apply, a quantity you can calculate, and a way to check whether a result is plausible.

How should I study Hamming space?

Read the excerpt, restate it from memory, then work through the examples and applications listed on this page. The five-step study plan above takes about twenty minutes.

What does this page cover?

It gives you a compact reference excerpt plus original lgStudy explanations, examples, applications and study material on Hamming space.

Tags

  • Coding theory
  • Linear algebra
  • Linear algebra stubs

Keep exploring