ArticleslgStudy

physics

Von Neumann entropy

Von Neumann entropy is a physics topic covered in the lgStudy science library. This page brings together a partial reference excerpt, illustrations, worked examples, real-world applications and a short study plan, so you can understand Von Neumann entropy rather than just read about it. In short: In physics, the von Neumann entropy, named after John von Neumann, is a measure of the statistical uncertainty within a description of a quantum system. It extends the concept of Gibbs entropy from classical statistical mechanics to quantum statistical mechanics, and it is the quantum counterpart of the Shannon entropy from classical information theory.

Von Neumann entropy — main illustration
Von Neumann entropy — illustration

Key takeaways

  • Von Neumann entropy belongs to physics; place it in that map before memorising details.
  • Learn the definition first, then one example that makes the definition concrete.
  • Connect Von Neumann entropy to a quantity you can measure, compute or draw — that is where exam questions come from.
  • Reproduce the core statement of Von Neumann entropy from memory before moving on to harder problems.

Reference excerpt

In physics, the von Neumann entropy, named after John von Neumann, is a measure of the statistical uncertainty within a description of a quantum system. It extends the concept of Gibbs entropy from classical statistical mechanics to quantum statistical mechanics, and it is the quantum counterpart of the Shannon entropy from classical information theory. For a quantum-mechanical system described by a density matrix ρ, the von Neumann entropy is

S = − tr ⁡ ( ρ ln ⁡ ρ ) , {\displaystyle S=-\operatorname {tr} (\rho \ln \rho ),}

where tr {\displaystyle \operatorname {tr} } denotes the trace and ln {\displaystyle \operatorname {ln} } denotes the matrix version of the natural logarithm. If the density matrix ρ is written in a basis of its eigenvectors | 1 ⟩ , | 2 ⟩ , | 3 ⟩ , … {\displaystyle |1\rangle ,|2\rangle ,|3\rangle ,\dots } as

ρ = ∑ j η j | j ⟩ ⟨ j | , {\displaystyle \rho =\sum _{j}\eta _{j}\left|j\right\rangle \left\langle j\right|,}

then the von Neumann entropy is merely

S = − ∑ j η j ln ⁡ η j . {\displaystyle S=-\sum _{j}\eta _{j}\ln \eta _{j}.}

In this form, S can be seen as the Shannon entropy of the eigenvalues, reinterpreted as probabilities. The von Neumann entropy and quantities based upon it are widely used in the study of quantum entanglement.

Fundamentals

In quantum mechanics, probabilities for the outcomes of experiments made upon a system are calculated from the quantum state describing that system. Each physical system is associated with a vector space, or more specifically a Hilbert space. The dimension of the Hilbert space may be infinite, as it is for the space of square-integrable functions on a line, which is used to define the quantum physics of a continuous degree of freedom. Alternatively, the Hilbert space may be finite-dimensional, as occurs for spin degrees of freedom. A density operator, the mathematical representation of a quantum state, is a positive semi-definite, self-adjoint operator of trace one acting on the Hilbert space of the system. A density operator that is a rank-1 projection is known as a pure quantum state, and all quantum states that are not pure are designated mixed. Pure states are also known as wavefunctions. Assigning a pure state to a quantum system implies certainty about the outcome of some measurement on that system (i.e., P ( x ) = 1 {\displaystyle P(x)=1} for some outcome x {\displaystyle x} ). The state space of a quantum system is the set of all states, pure and mixed, that can be assigned to it. For any system, the state space is a convex set: Any mixed state can be written as a convex combination of pure states, though not in a unique way. The von Neumann entropy quantifies the extent to which a state is mixed. The prototypical example of a finite-dimensional Hilbert space is a qubit, a quantum system whose Hilbert space is 2-dimensional. An arbitrary state for a qubit can be written as a linear combination of the Pauli matrices, which provide a basis for 2 × 2 {\displaystyle 2\times 2} self-adjoint matrices:

ρ = 1 2 ( I + r x σ x + r y σ y + r z σ z ) , {\displaystyle \rho ={\tfrac {1}{2}}\left(I+r_{x}\sigma _{x}+r_{y}\sigma _{y}+r_{z}\sigma _{z}\right),}

where the real numbers ( r x , r y , r z ) {\displaystyle (r_{x},r_{y},r_{z})} are the coordinates of a point within the unit ball and

… excerpt ends here. Continue reading the full article.

Illustrations

Von Neumann entropy: John von Neumann, whom the concept is named after
John von Neumann, whom the concept is named after

Worked examples

Example 1 — a first encounter with Von Neumann entropy

Start with the simplest possible case. Write down what Von Neumann entropy claims or describes in one sentence, then invent the smallest concrete situation in which that sentence is true. In physics, the smallest case is usually a single object, a single equation or a single measurement. Check that every symbol or term in your sentence has a meaning in that case.

Example 2 — changing one variable

Take the situation from Example 1 and change exactly one quantity: double it, halve it, or set it to zero. Predict what should happen to Von Neumann entropy before you calculate. Comparing your prediction with the result is the fastest way to find out whether you understand the idea or only the words.

Example 3 — an exam-style question

Typical questions about Von Neumann entropy ask you to (a) state it precisely, (b) apply it to given data, and (c) explain a limitation. Practise writing all three answers in under five minutes; the third part is what separates a full-mark answer from an average one.

Applications of Von Neumann entropy

In research
Von Neumann entropy appears in physics research whenever the underlying quantities have to be modelled precisely. Papers usually cite it as a starting assumption and then explore where it breaks down.
In technology and industry
Engineering practice reuses Von Neumann entropy in design rules, simulations and safety margins. Knowing the idea lets you read a specification sheet and understand why the numbers look the way they do.
In the classroom
Von Neumann entropy is common in secondary-school and first-year university syllabi. It links to neighbouring topics John von Neumann, Quantum mechanical entropy, so understanding it makes those chapters shorter.
In everyday life
Look for Von Neumann entropy outside the textbook — in sport, cooking, traffic, electronics or the sky above you. An example you found yourself is remembered far longer than one you were given.
Ask Teacher Smith questions about this articleOpens your AI tutor with a question about “Von Neumann entropy” →

Affiliate

Preply — study more efficiently by working with a personal tutor. 50% off.

How to study Von Neumann entropy in 20 minutes

  1. Read the reference excerpt below once, without taking notes.
  2. Close the page and write down what Von Neumann entropy means in your own words.
  3. Compare your version with the excerpt and mark what you missed.
  4. Work through the three examples above with pen and paper.
  5. Explain Von Neumann entropy out loud to somebody else — or to Teacher Smith in the lgStudy chat.

Frequently asked questions

What is Von Neumann entropy in simple terms?

In physics, the von Neumann entropy, named after John von Neumann, is a measure of the statistical uncertainty within a description of a quantum system. It extends the concept of Gibbs entropy from classical statistical mechanics to quantum statistical mechanics, and it is the quantum counterpart o…

Why does Von Neumann entropy matter?

Because it connects several physics ideas at once: it gives you a definition you can apply, a quantity you can calculate, and a way to check whether a result is plausible.

How should I study Von Neumann entropy?

Read the excerpt, restate it from memory, then work through the examples and applications listed on this page. The five-step study plan above takes about twenty minutes.

What does this page cover?

It gives you a compact reference excerpt plus original lgStudy explanations, examples, applications and study material on Von Neumann entropy.

Tags

  • John von Neumann
  • Quantum mechanical entropy

Keep exploring