ArticleslgStudy

mathematics

Iterative proportional fitting

Iterative proportional fitting is a mathematics topic covered in the lgStudy science library. This page brings together a partial reference excerpt, illustrations, worked examples, real-world applications and a short study plan, so you can understand Iterative proportional fitting rather than just read about it. In short: The iterative proportional fitting procedure (IPF or IPFP, also known as biproportional fitting or biproportion in statistics or economics (input-output analysis, etc.), RAS algorithm in economics, raking in survey statistics, and matrix scaling in computer science) is the operation of finding the fitted matrix X {\displaystyle X} which is the closest to an initial matrix Z {\displaystyle Z} but with the row and col…

Key takeaways

  • Iterative proportional fitting belongs to mathematics; place it in that map before memorising details.
  • Learn the definition first, then one example that makes the definition concrete.
  • Connect Iterative proportional fitting to a quantity you can measure, compute or draw — that is where exam questions come from.
  • Reproduce the core statement of Iterative proportional fitting from memory before moving on to harder problems.

Reference excerpt

The iterative proportional fitting procedure (IPF or IPFP, also known as biproportional fitting or biproportion in statistics or economics (input-output analysis, etc.), RAS algorithm in economics, raking in survey statistics, and matrix scaling in computer science) is the operation of finding the fitted matrix X {\displaystyle X} which is the closest to an initial matrix Z {\displaystyle Z} but with the row and column totals of a target matrix Y {\displaystyle Y} (which provides the constraints of the problem; the interior of Y {\displaystyle Y} is unknown). The fitted matrix being of the form X = P Z Q {\displaystyle X=PZQ} , where P {\displaystyle P} and Q {\displaystyle Q} are diagonal matrices such that X {\displaystyle X} has the margins (row and column sums) of Y {\displaystyle Y} . Some algorithms can be chosen to perform biproportion. We have also the entropy maximization, information loss minimization (or cross-entropy) or RAS which consists of factoring the matrix rows to match the specified row totals, then factoring its columns to match the specified column totals; each step usually disturbs the previous step's match, so these steps are repeated in cycles, re-adjusting the rows and columns in turn, until all specified marginal totals are satisfactorily approximated. However, all algorithms give the same solution. In three- or more-dimensional cases, adjustment steps are applied for the marginals of each dimension in turn, the steps likewise repeated in cycles.

History IPF has been "re-invented" many times, the earliest by Kruithof in 1937 in relation to telephone traffic ("Kruithof’s double factor method"), Deming and Stephan in 1940 for adjusting census crosstabulations, and G.V. Sheleikhovskii for traffic as reported by Bregman. (Deming and Stephan proposed IPFP as an algorithm leading to a minimizer of the Pearson X-squared statistic, which Stephan later reported it does not). Early proofs of uniqueness and convergence came from Sinkhorn (1964), Bacharach (1965), Bishop (1967), and Fienberg (1970). Bishop's proof that IPFP finds the maximum likelihood estimator for any number of dimensions extended a 1959 proof by Brown for 2x2x2... cases. Fienberg's proof by differential geometry exploits the method's constant crossproduct ratios, for strictly positive tables. Csiszár (1975). found necessary and sufficient conditions for general tables having zero entries. Pukelsheim and Simeone (2009) give further results on convergence and error behavior. An exhaustive treatment of the algorithm and its mathematical foundations can be found in the book of Bishop et al. (1975). Idel (2016) gives a more recent survey. Other general algorithms can be modified to yield the same limit as the IPFP, for instance the Newton–Raphson method and the EM algorithm. In most cases, IPFP is preferred due to its computational speed, low storage requirements, numerical stability and algebraic simplicity. Applications of IPFP have grown to include trip distribution models, Fratar or Furness and other applications in transportation planning (Lamond and Stewart), survey weighting, synthesis of cross-classified demographic data, adjusting input–output models in economics, estimating expected quasi-independent contingency tables, biproportional apportionment systems of political representation, and for a preconditioner in linear algebra.

Biproportion Biproportion, whatever the algorithm used to solve it, is the following concept: Z {\displaystyle Z} , matrix Y {\displaystyle Y} and matrix X {\displaystyle X} are known real nonnegative matrices of dimension n , m {\displaystyle n,m} ; the interior of Y {\displaystyle Y} is unknown and X {\displaystyle X} is searched such that X {\displaystyle X} has the same margins than Y {\displaystyle Y} , i.e. X s = Y s {\displaystyle Xs=Ys} and s ′ X = s ′ Y {\displaystyle s'X=s'Y} ( s {\displaystyle s} being the sum vector), and such that X {\displaystyle X} is close to Z {\displaystyle Z} following a given criterion, the fitted matrix being of the form X = K ( Z , Y ) = P Z Q {\displaystyle X=K(Z,Y)=PZQ} , where P {\displaystyle P} and Q {\displaystyle Q} are diagonal matrices.

… excerpt ends here. Continue reading the full article.

Worked examples

Example 1 — a first encounter with Iterative proportional fitting

Start with the simplest possible case. Write down what Iterative proportional fitting claims or describes in one sentence, then invent the smallest concrete situation in which that sentence is true. In mathematics, the smallest case is usually a single object, a single equation or a single measurement. Check that every symbol or term in your sentence has a meaning in that case.

Example 2 — changing one variable

Take the situation from Example 1 and change exactly one quantity: double it, halve it, or set it to zero. Predict what should happen to Iterative proportional fitting before you calculate. Comparing your prediction with the result is the fastest way to find out whether you understand the idea or only the words.

Example 3 — an exam-style question

Typical questions about Iterative proportional fitting ask you to (a) state it precisely, (b) apply it to given data, and (c) explain a limitation. Practise writing all three answers in under five minutes; the third part is what separates a full-mark answer from an average one.

Applications of Iterative proportional fitting

In research
Iterative proportional fitting appears in mathematics research whenever the underlying quantities have to be modelled precisely. Papers usually cite it as a starting assumption and then explore where it breaks down.
In technology and industry
Engineering practice reuses Iterative proportional fitting in design rules, simulations and safety margins. Knowing the idea lets you read a specification sheet and understand why the numbers look the way they do.
In the classroom
Iterative proportional fitting is common in secondary-school and first-year university syllabi. It links to neighbouring topics Contingency table, Statistical algorithms, so understanding it makes those chapters shorter.
In everyday life
Look for Iterative proportional fitting outside the textbook — in sport, cooking, traffic, electronics or the sky above you. An example you found yourself is remembered far longer than one you were given.

Affiliate

Preply — study more efficiently by working with a personal tutor. 50% off.

How to study Iterative proportional fitting in 20 minutes

  1. Read the reference excerpt below once, without taking notes.
  2. Close the page and write down what Iterative proportional fitting means in your own words.
  3. Compare your version with the excerpt and mark what you missed.
  4. Work through the three examples above with pen and paper.
  5. Explain Iterative proportional fitting out loud to somebody else — or to Teacher Smith in the lgStudy chat.

Frequently asked questions

What is Iterative proportional fitting in simple terms?

The iterative proportional fitting procedure (IPF or IPFP, also known as biproportional fitting or biproportion in statistics or economics (input-output analysis, etc.), RAS algorithm in economics, raking in survey statistics, and matrix scaling in computer science) is the operation of finding the…

Why does Iterative proportional fitting matter?

Because it connects several mathematics ideas at once: it gives you a definition you can apply, a quantity you can calculate, and a way to check whether a result is plausible.

How should I study Iterative proportional fitting?

Read the excerpt, restate it from memory, then work through the examples and applications listed on this page. The five-step study plan above takes about twenty minutes.

What does this page cover?

It gives you a compact reference excerpt plus original lgStudy explanations, examples, applications and study material on Iterative proportional fitting.

Tags

  • Contingency table
  • Statistical algorithms

Keep exploring