mathematics

Principle of marginality

Principle of marginality is a mathematics topic covered in the lgStudy science library. This page brings together a partial reference excerpt, illustrations, worked examples, real-world applications and a short study plan, so you can understand Principle of marginality rather than just read about it. In short: In statistics, the principle of marginality, sometimes called hierarchical principle, is the fact that the average (or main) effects of variables in an analysis are marginal to their interaction effect—that is, the main effect of one explanatory variable captures the effect of that variable averaged over all values of a second explanatory variable whose value influences the first variable's effect. The principle of…

Key takeaways

Principle of marginality belongs to mathematics; place it in that map before memorising details.
Learn the definition first, then one example that makes the definition concrete.
Connect Principle of marginality to a quantity you can measure, compute or draw — that is where exam questions come from.
Reproduce the core statement of Principle of marginality from memory before moving on to harder problems.

Reference excerpt

In statistics, the principle of marginality, sometimes called hierarchical principle, is the fact that the average (or main) effects of variables in an analysis are marginal to their interaction effect—that is, the main effect of one explanatory variable captures the effect of that variable averaged over all values of a second explanatory variable whose value influences the first variable's effect. The principle of marginality implies that, in general, it is wrong to test, estimate, or interpret main effects of explanatory variables where the variables interact or, similarly, to model interaction effects but delete main effects that are marginal to them. While such models are interpretable, they lack applicability, as they ignore the dependence of a variable's effect upon another variable's value. Nelder and Venables have argued strongly for the importance of this principle in regression analysis.

Regression form If two independent continuous variables, say x and z, both influence a dependent variable y, and if the extent of the effect of each independent variable depends on the level of the other independent variable then the regression equation can be written as:

y i = a + b x i + c z i + d ( x i z i ) + e i , {\displaystyle y_{i}=a+bx_{i}+cz_{i}+d(x_{i}z_{i})+e_{i},}

where i indexes observations, a is the intercept term, b, c, and d are effect size parameters to be estimated, and e is the error term. If this is the correct model, then the omission of any of the right-side terms would be incorrect, resulting in misleading interpretation of the regression results. With this model, the effect of x upon y is given by the partial derivative of y with respect to x; this is b + d z i {\displaystyle b+dz_{i}} , which depends on the specific value z i {\displaystyle z_{i}} at which the partial derivative is being evaluated. Hence, the main effect of x – the effect averaged over all values of z – is meaningless as it depends on the design of the experiment (specifically on the relative frequencies of the various values of z) and not just on the underlying relationships. Hence:

In the case of interaction, it is wrong to try to test, estimate, or interpret a "main effect" coefficient b or c, omitting the interaction term. In addition:

In the case of interaction, it is wrong to not include b or c, because this will give incorrect estimates of the interaction.

Worked examples

Example 1 — a first encounter with Principle of marginality

Start with the simplest possible case. Write down what Principle of marginality claims or describes in one sentence, then invent the smallest concrete situation in which that sentence is true. In mathematics, the smallest case is usually a single object, a single equation or a single measurement. Check that every symbol or term in your sentence has a meaning in that case.

Example 2 — changing one variable

Take the situation from Example 1 and change exactly one quantity: double it, halve it, or set it to zero. Predict what should happen to Principle of marginality before you calculate. Comparing your prediction with the result is the fastest way to find out whether you understand the idea or only the words.

Example 3 — an exam-style question

Typical questions about Principle of marginality ask you to (a) state it precisely, (b) apply it to given data, and (c) explain a limitation. Practise writing all three answers in under five minutes; the third part is what separates a full-mark answer from an average one.

Applications of Principle of marginality

In research: Principle of marginality appears in mathematics research whenever the underlying quantities have to be modelled precisely. Papers usually cite it as a starting assumption and then explore where it breaks down.
In technology and industry: Engineering practice reuses Principle of marginality in design rules, simulations and safety margins. Knowing the idea lets you read a specification sheet and understand why the numbers look the way they do.
In the classroom: Principle of marginality is common in secondary-school and first-year university syllabi. It links to neighbouring topics Analysis of variance, Regression analysis, Statistical principles, so understanding it makes those chapters shorter.
In everyday life: Look for Principle of marginality outside the textbook — in sport, cooking, traffic, electronics or the sky above you. An example you found yourself is remembered far longer than one you were given.

Ask Teacher Smith questions about this articleOpens your AI tutor with a question about “Principle of marginality” →

Affiliate

Preply — study more efficiently by working with a personal tutor. 50% off.

How to study Principle of marginality in 20 minutes

Read the reference excerpt below once, without taking notes.
Close the page and write down what Principle of marginality means in your own words.
Compare your version with the excerpt and mark what you missed.
Work through the three examples above with pen and paper.
Explain Principle of marginality out loud to somebody else — or to Teacher Smith in the lgStudy chat.

Frequently asked questions

What is Principle of marginality in simple terms?

Why does Principle of marginality matter?

Because it connects several mathematics ideas at once: it gives you a definition you can apply, a quantity you can calculate, and a way to check whether a result is plausible.

How should I study Principle of marginality?

Read the excerpt, restate it from memory, then work through the examples and applications listed on this page. The five-step study plan above takes about twenty minutes.

What does this page cover?

It gives you a compact reference excerpt plus original lgStudy explanations, examples, applications and study material on Principle of marginality.