ArticleslgStudy

mathematics

Path analysis (statistics)

Path analysis (statistics) is a mathematics topic covered in the lgStudy science library. This page brings together a partial reference excerpt, illustrations, worked examples, real-world applications and a short study plan, so you can understand Path analysis (statistics) rather than just read about it. In short: In statistics, path analysis is used to describe the directed dependencies among a set of variables. This includes models equivalent to any form of multiple regression analysis, factor analysis, canonical correlation analysis, discriminant analysis, as well as more general families of models in the multivariate analysis of variance and covariance analyses (MANOVA, ANOVA, ANCOVA).

Path analysis (statistics) — main illustration
Path analysis (statistics) — illustration

Key takeaways

  • Path analysis (statistics) belongs to mathematics; place it in that map before memorising details.
  • Learn the definition first, then one example that makes the definition concrete.
  • Connect Path analysis (statistics) to a quantity you can measure, compute or draw — that is where exam questions come from.
  • Reproduce the core statement of Path analysis (statistics) from memory before moving on to harder problems.

Reference excerpt

In statistics, path analysis is used to describe the directed dependencies among a set of variables. This includes models equivalent to any form of multiple regression analysis, factor analysis, canonical correlation analysis, discriminant analysis, as well as more general families of models in the multivariate analysis of variance and covariance analyses (MANOVA, ANOVA, ANCOVA). In addition to being thought of as a form of multiple regression focusing on causality, path analysis can be viewed as a special case of structural equation modeling (SEM) – one in which only single indicators are employed for each of the variables in the causal model. That is, path analysis is SEM with a structural model, but no measurement model. Other terms used to refer to path analysis include causal modeling and analysis of covariance structures. Path analysis is considered by Judea Pearl to be a direct ancestor to the techniques of causal inference.

History Path analysis was developed around 1918 by geneticist Sewall Wright, who wrote about it more extensively in the 1920s. It has since been applied to a vast array of complex modeling areas, including biology, psychology, sociology, and econometrics.

Path modeling Typically, path models consist of independent and dependent variables depicted graphically by boxes or rectangles. Variables that are independent variables, and not dependent variables, are called 'exogenous'. Graphically, these exogenous variable boxes lie at outside edges of the model and have only single-headed arrows exiting from them. No single-headed arrows point at exogenous variables. Variables that are solely dependent variables, or are both independent and dependent variables, are termed 'endogenous'. Graphically, endogenous variables have at least one single-headed arrow pointing at them. In the model below, the two exogenous variables (Ex1 and Ex2) are modeled as being correlated as depicted by the double-headed arrow. Both of these variables have direct and indirect (through En1) effects on En2 (the two dependent or 'endogenous' variables/factors). In most real-world models, the endogenous variables may also be affected by variables and factors stemming from outside the model (external effects including measurement error). These effects are depicted by the "e" or error terms in the model.

Using the same variables, alternative models are conceivable. For example, it may be hypothesized that Ex1 has only an indirect effect on En2, deleting the arrow from Ex1 to En2; and the likelihood or 'fit' of these two models can be compared statistically.

Path tracing rules In order to validly calculate the relationship between any two boxes in the diagram, Wright (1934) proposed a simple set of path tracing rules, for calculating the correlation between two variables. The correlation is equal to the sum of the contribution of all the pathways through which the two variables are connected. The strength of each of these contributing pathways is calculated as the product of the path-coefficients along that pathway. The rules for path tracing are:

You can trace backward up an arrow and then forward along the next, or forwards from one variable to the other, but never forward and then back. Another way to think of this rule is that you can never pass out of one arrow head and into another arrowhead: tails-tails, heads-tails, or tails-heads, but not heads-heads. You can pass through each variable only once in a given chain of paths. No more than one bi-directional arrow can be included in each path-chain. Again, the expected correlation due to each chain traced between two variables is the product of the standardized path coefficients, and the total expected correlation between two variables is the sum of these contributing path-chains. NB: Wright's rules assume a model without feedback loops: the directed graph of the model must contain no cycles, i.e. it is a directed acyclic graph, which has been extensively studied in the causal analysis framework of Judea Pearl.

Path tracing in unstandardized models If the modeled variables have not been standardized, an additional rule allows the expected covariances to be calculated as long as no paths exist connecting dependent variables to other dependent variables. The simplest case obtains where all residual variances are modeled explicitly. In this case, in addition to the three rules above, calculate expected covariances by:

Compute the product of coefficients in each route between the variables of interest, tracing backwards, changing direction at a two-headed arrow, then tracing forwards. Sum over all distinct routes, where pathways are considered distinct if they contain different coefficients, or encounter those coefficients in a different order. Where residual variances are not explicitly included, or as a more general solution, at any change of direction encountered in a route (except for at two-way arrows), include the variance of the variable at the point of change. That is, in tracing a path from a dependent variable to an independent variable, include the variance of the independent-variable except where so doing would violate rule 1 above (passing through adjacent arrowheads: i.e., when the independent variable also connects to a double-headed arrow connecting it to another independent variable). In deriving variances (which is necessary in the case where they are not modeled explicitly), the path from a dependent variable into an independent variable and back is counted once only.

See also Bayesian network Causality Causal loop diagram Hidden Markov model Latent variable model Path coefficient Structural equation model (SEM)

References

External links Ωnyx, a free software environment for Structural Equation Modeling OpenMx - Advanced Structural Equation Modeling LISREL: model, methods and software for Structural Equation Modeling

Worked examples

Example 1 — a first encounter with Path analysis (statistics)

Start with the simplest possible case. Write down what Path analysis (statistics) claims or describes in one sentence, then invent the smallest concrete situation in which that sentence is true. In mathematics, the smallest case is usually a single object, a single equation or a single measurement. Check that every symbol or term in your sentence has a meaning in that case.

Example 2 — changing one variable

Take the situation from Example 1 and change exactly one quantity: double it, halve it, or set it to zero. Predict what should happen to Path analysis (statistics) before you calculate. Comparing your prediction with the result is the fastest way to find out whether you understand the idea or only the words.

Example 3 — an exam-style question

Typical questions about Path analysis (statistics) ask you to (a) state it precisely, (b) apply it to given data, and (c) explain a limitation. Practise writing all three answers in under five minutes; the third part is what separates a full-mark answer from an average one.

Applications of Path analysis (statistics)

In research
Path analysis (statistics) appears in mathematics research whenever the underlying quantities have to be modelled precisely. Papers usually cite it as a starting assumption and then explore where it breaks down.
In technology and industry
Engineering practice reuses Path analysis (statistics) in design rules, simulations and safety margins. Knowing the idea lets you read a specification sheet and understand why the numbers look the way they do.
In the classroom
Path analysis (statistics) is common in secondary-school and first-year university syllabi. It links to neighbouring topics Graphical models, Independence (probability theory), Structural equation models, so understanding it makes those chapters shorter.
In everyday life
Look for Path analysis (statistics) outside the textbook — in sport, cooking, traffic, electronics or the sky above you. An example you found yourself is remembered far longer than one you were given.

Affiliate

Preply — study more efficiently by working with a personal tutor. 50% off.

How to study Path analysis (statistics) in 20 minutes

  1. Read the reference excerpt below once, without taking notes.
  2. Close the page and write down what Path analysis (statistics) means in your own words.
  3. Compare your version with the excerpt and mark what you missed.
  4. Work through the three examples above with pen and paper.
  5. Explain Path analysis (statistics) out loud to somebody else — or to Teacher Smith in the lgStudy chat.

Frequently asked questions

What is Path analysis (statistics) in simple terms?

In statistics, path analysis is used to describe the directed dependencies among a set of variables. This includes models equivalent to any form of multiple regression analysis, factor analysis, canonical correlation analysis, discriminant analysis, as well as more general families of models in the…

Why does Path analysis (statistics) matter?

Because it connects several mathematics ideas at once: it gives you a definition you can apply, a quantity you can calculate, and a way to check whether a result is plausible.

How should I study Path analysis (statistics)?

Read the excerpt, restate it from memory, then work through the examples and applications listed on this page. The five-step study plan above takes about twenty minutes.

What does this page cover?

It gives you a compact reference excerpt plus original lgStudy explanations, examples, applications and study material on Path analysis (statistics).

Tags

  • Graphical models
  • Independence (probability theory)
  • Structural equation models

Keep exploring