ArticleslgStudy

computer science

Simon model

Simon model is a computer science topic covered in the lgStudy science library. This page brings together a partial reference excerpt, illustrations, worked examples, real-world applications and a short study plan, so you can understand Simon model rather than just read about it. In short: In applied probability theory, the Simon model is a class of stochastic models that results in a power-law distribution function. It was proposed by Herbert A.

Key takeaways

  • Simon model belongs to computer science; place it in that map before memorising details.
  • Learn the definition first, then one example that makes the definition concrete.
  • Connect Simon model to a quantity you can measure, compute or draw — that is where exam questions come from.
  • Reproduce the core statement of Simon model from memory before moving on to harder problems.

Reference excerpt

In applied probability theory, the Simon model is a class of stochastic models that results in a power-law distribution function. It was proposed by Herbert A. Simon to account for the wide range of empirical distributions following a power-law. It models the dynamics of a system of elements with associated counters (e.g., words and their frequencies in texts, or nodes in a network and their connectivity k {\displaystyle k} ). In this model the dynamics of the system is based on constant growth via addition of new elements (new instances of words) as well as incrementing the counters (new occurrences of a word) at a rate proportional to their current values.

Description To model this type of network growth as described above, Bornholdt and Ebel considered a network with n {\displaystyle n} nodes, and each node with connectivities k i {\displaystyle k_{i}} , i = 1 , … , n {\displaystyle i=1,\ldots ,n} . These nodes form classes [ k ] {\displaystyle [k]} of f ( k ) {\displaystyle f(k)} nodes with identical connectivity k {\displaystyle k} . Repeat the following steps:

With probability α {\displaystyle \alpha } add a new node and attach a link to it from an arbitrarily chosen node. With probability 1 − α {\displaystyle 1-\alpha } add one link from an arbitrary node to a node j {\displaystyle j} of class [ k ] {\displaystyle [k]} chosen with a probability proportional to k f ( k ) {\displaystyle kf(k)} . For this stochastic process, Simon found a stationary solution exhibiting power-law scaling, P ( k ) ∝ k − γ {\displaystyle P(k)\propto k^{-\gamma }} , with exponent γ = 1 + 1 1 − α . {\displaystyle \gamma =1+{\frac {1}{1-\alpha }}.}

Properties Barabási-Albert (BA) model can be mapped to the subclass α = 1 / 2 {\displaystyle \alpha =1/2} of Simon's model, when using the simpler probability for a node being connected to another node i {\displaystyle i} with connectivity k i {\displaystyle k_{i}} P ( n e w l i n k t o i ) ∝ k i {\displaystyle P(\mathrm {new\ link\ to\ } i)\propto k_{i}} (same as the preferential attachment at BA model). In other words, the Simon model describes a general class of stochastic processes that can result in a scale-free network, appropriate to capture Pareto and Zipf's laws. The only free parameter of the model α {\displaystyle \alpha } reflects the relative growth of number of nodes versus the number of links. In general α {\displaystyle \alpha } has small values; therefore, the scaling exponents can be predicted to be γ ≈ 2 {\displaystyle \gamma \approx 2} . For instance, Bornholdt and Ebel studied the linking dynamics of World Wide Web, and predicted the scaling exponent as γ ≈ 2.1 {\displaystyle \gamma \approx 2.1} , which was consistent with observation. The interest in the scale-free model comes from its ability to describe the topology of complex networks. The Simon model does not have an underlying network structure, as it was designed to describe events whose frequency follows a power-law. Thus network measures going beyond the degree distribution such as the average path length, spectral properties, and clustering coefficient, cannot be obtained from this mapping. The Simon model is related to generalized scale-free models with growth and preferential attachment properties. For more reference, see.

See also Price's model

References

Worked examples

Example 1 — a first encounter with Simon model

Start with the simplest possible case. Write down what Simon model claims or describes in one sentence, then invent the smallest concrete situation in which that sentence is true. In computer science, the smallest case is usually a single object, a single equation or a single measurement. Check that every symbol or term in your sentence has a meaning in that case.

Example 2 — changing one variable

Take the situation from Example 1 and change exactly one quantity: double it, halve it, or set it to zero. Predict what should happen to Simon model before you calculate. Comparing your prediction with the result is the fastest way to find out whether you understand the idea or only the words.

Example 3 — an exam-style question

Typical questions about Simon model ask you to (a) state it precisely, (b) apply it to given data, and (c) explain a limitation. Practise writing all three answers in under five minutes; the third part is what separates a full-mark answer from an average one.

Applications of Simon model

In research
Simon model appears in computer science research whenever the underlying quantities have to be modelled precisely. Papers usually cite it as a starting assumption and then explore where it breaks down.
In technology and industry
Engineering practice reuses Simon model in design rules, simulations and safety margins. Knowing the idea lets you read a specification sheet and understand why the numbers look the way they do.
In the classroom
Simon model is common in secondary-school and first-year university syllabi. It links to neighbouring topics Networks, Power laws, so understanding it makes those chapters shorter.
In everyday life
Look for Simon model outside the textbook — in sport, cooking, traffic, electronics or the sky above you. An example you found yourself is remembered far longer than one you were given.

Affiliate

Preply — study more efficiently by working with a personal tutor. 50% off.

How to study Simon model in 20 minutes

  1. Read the reference excerpt below once, without taking notes.
  2. Close the page and write down what Simon model means in your own words.
  3. Compare your version with the excerpt and mark what you missed.
  4. Work through the three examples above with pen and paper.
  5. Explain Simon model out loud to somebody else — or to Teacher Smith in the lgStudy chat.

Frequently asked questions

What is Simon model in simple terms?

In applied probability theory, the Simon model is a class of stochastic models that results in a power-law distribution function. It was proposed by Herbert A.

Why does Simon model matter?

Because it connects several computer science ideas at once: it gives you a definition you can apply, a quantity you can calculate, and a way to check whether a result is plausible.

How should I study Simon model?

Read the excerpt, restate it from memory, then work through the examples and applications listed on this page. The five-step study plan above takes about twenty minutes.

What does this page cover?

It gives you a compact reference excerpt plus original lgStudy explanations, examples, applications and study material on Simon model.

Tags

  • Networks
  • Power laws

Keep exploring