ArticleslgStudy

mathematics

Seemingly unrelated regressions

Seemingly unrelated regressions is a mathematics topic covered in the lgStudy science library. This page brings together a partial reference excerpt, illustrations, worked examples, real-world applications and a short study plan, so you can understand Seemingly unrelated regressions rather than just read about it. In short: In econometrics, the seemingly unrelated regressions (SUR) or seemingly unrelated regression equations (SURE) model, proposed by Arnold Zellner in (1962), is a generalization of a linear regression model that consists of several regression equations, each having its own dependent variable and potentially different sets of exogenous explanatory variables. Each equation is a valid linear regression on its own and can…

Key takeaways

  • Seemingly unrelated regressions belongs to mathematics; place it in that map before memorising details.
  • Learn the definition first, then one example that makes the definition concrete.
  • Connect Seemingly unrelated regressions to a quantity you can measure, compute or draw — that is where exam questions come from.
  • Reproduce the core statement of Seemingly unrelated regressions from memory before moving on to harder problems.

Reference excerpt

In econometrics, the seemingly unrelated regressions (SUR) or seemingly unrelated regression equations (SURE) model, proposed by Arnold Zellner in (1962), is a generalization of a linear regression model that consists of several regression equations, each having its own dependent variable and potentially different sets of exogenous explanatory variables. Each equation is a valid linear regression on its own and can be estimated separately, which is why the system is called seemingly unrelated, although some authors suggest that the term seemingly related would be more appropriate, since the error terms are assumed to be correlated across the equations. The model can be estimated equation-by-equation using standard ordinary least squares (OLS). Such estimates are consistent, however generally not as efficient as the SUR method, which amounts to feasible generalized least squares with a specific form of the variance-covariance matrix. Two important cases when SUR is in fact equivalent to OLS are when the error terms are in fact uncorrelated between the equations (so that they are truly unrelated) and when each equation contains exactly the same set of regressors on the right-hand-side. The SUR model can be viewed as either the simplification of the general linear model where certain coefficients in matrix B {\displaystyle \mathrm {B} } are restricted to be equal to zero, or as the generalization of the general linear model where the regressors on the right-hand-side are allowed to be different in each equation. The SUR model can be further generalized into the simultaneous equations model, where the right-hand side regressors are allowed to be the endogenous variables as well.

The model Suppose there are m regression equations

y i r = x i r T β i + ε i r , i = 1 , … , m . {\displaystyle y_{ir}=x_{ir}^{\mathsf {T}}\;\!\beta _{i}+\varepsilon _{ir},\quad i=1,\ldots ,m.}

Here i represents the equation number, r = 1, …, R is the individual observation, and we are taking the transpose of the x i r {\displaystyle x_{ir}} column vector. The number of observations R is assumed to be large, so that in the analysis we take R → ∞ {\displaystyle \infty } , whereas the number of equations m remains fixed. Each equation i has a single response variable yir, and a ki-dimensional vector of regressors xir. If we stack observations corresponding to the i-th equation into R-dimensional vectors and matrices, then the model can be written in vector form as

y i = X i β i + ε i , i = 1 , … , m , {\displaystyle y_{i}=X_{i}\beta _{i}+\varepsilon _{i},\quad i=1,\ldots ,m,}

where yi and εi are R×1 vectors, Xi is a R×ki matrix, and βi is a ki×1 vector. Finally, if we stack these m vector equations on top of each other, the system will take the form

The assumption of the model is that error terms εir are independent across observations, but may have cross-equation correlations within observations. Thus, we assume that E[ εir εis | X ] = 0 whenever r ≠ s, whereas E[ εir εjr | X ] = σij. Denoting Σ = [σij] the m×m skedasticity matrix of each observation, the covariance matrix of the stacked error terms ε will be equal to

Ω ≡ E ⁡ [ ε ε T | X ] = Σ ⊗ I R , {\displaystyle \Omega \equiv \operatorname {E} [\,\varepsilon \varepsilon ^{\mathsf {T}}\,|X\,]=\Sigma \otimes I_{R},}

where IR is the R-dimensional identity matrix and ⊗ denotes the matrix Kronecker product.

Estimation The SUR model is usually estimated using the feasible generalized least squares (FGLS) method. This is a two-step method where in the first step we run ordinary least squares regression for (1). The residuals from this regression are used to estimate the elements of matrix Σ {\displaystyle \Sigma } :

σ ^ i j = 1 R ε ^ i T ε ^ j . {\displaystyle {\hat {\sigma }}_{ij}={\frac {1}{R}}\,{\hat {\varepsilon }}_{i}^{\mathsf {T}}{\hat {\varepsilon }}_{j}.}

… excerpt ends here. Continue reading the full article.

Worked examples

Example 1 — a first encounter with Seemingly unrelated regressions

Start with the simplest possible case. Write down what Seemingly unrelated regressions claims or describes in one sentence, then invent the smallest concrete situation in which that sentence is true. In mathematics, the smallest case is usually a single object, a single equation or a single measurement. Check that every symbol or term in your sentence has a meaning in that case.

Example 2 — changing one variable

Take the situation from Example 1 and change exactly one quantity: double it, halve it, or set it to zero. Predict what should happen to Seemingly unrelated regressions before you calculate. Comparing your prediction with the result is the fastest way to find out whether you understand the idea or only the words.

Example 3 — an exam-style question

Typical questions about Seemingly unrelated regressions ask you to (a) state it precisely, (b) apply it to given data, and (c) explain a limitation. Practise writing all three answers in under five minutes; the third part is what separates a full-mark answer from an average one.

Applications of Seemingly unrelated regressions

In research
Seemingly unrelated regressions appears in mathematics research whenever the underlying quantities have to be modelled precisely. Papers usually cite it as a starting assumption and then explore where it breaks down.
In technology and industry
Engineering practice reuses Seemingly unrelated regressions in design rules, simulations and safety margins. Knowing the idea lets you read a specification sheet and understand why the numbers look the way they do.
In the classroom
Seemingly unrelated regressions is common in secondary-school and first-year university syllabi. It links to neighbouring topics Simultaneous equation methods (econometrics), so understanding it makes those chapters shorter.
In everyday life
Look for Seemingly unrelated regressions outside the textbook — in sport, cooking, traffic, electronics or the sky above you. An example you found yourself is remembered far longer than one you were given.
Ask Teacher Smith questions about this articleOpens your AI tutor with a question about “Seemingly unrelated regressions” →

Affiliate

Preply — study more efficiently by working with a personal tutor. 50% off.

How to study Seemingly unrelated regressions in 20 minutes

  1. Read the reference excerpt below once, without taking notes.
  2. Close the page and write down what Seemingly unrelated regressions means in your own words.
  3. Compare your version with the excerpt and mark what you missed.
  4. Work through the three examples above with pen and paper.
  5. Explain Seemingly unrelated regressions out loud to somebody else — or to Teacher Smith in the lgStudy chat.

Frequently asked questions

What is Seemingly unrelated regressions in simple terms?

In econometrics, the seemingly unrelated regressions (SUR) or seemingly unrelated regression equations (SURE) model, proposed by Arnold Zellner in (1962), is a generalization of a linear regression model that consists of several regression equations, each having its own dependent variable and poten…

Why does Seemingly unrelated regressions matter?

Because it connects several mathematics ideas at once: it gives you a definition you can apply, a quantity you can calculate, and a way to check whether a result is plausible.

How should I study Seemingly unrelated regressions?

Read the excerpt, restate it from memory, then work through the examples and applications listed on this page. The five-step study plan above takes about twenty minutes.

What does this page cover?

It gives you a compact reference excerpt plus original lgStudy explanations, examples, applications and study material on Seemingly unrelated regressions.

Tags

  • Simultaneous equation methods (econometrics)

Keep exploring