ArticleslgStudy

computer science

Pooling layer

Pooling layer is a computer science topic covered in the lgStudy science library. This page brings together a partial reference excerpt, illustrations, worked examples, real-world applications and a short study plan, so you can understand Pooling layer rather than just read about it. In short: In neural networks, a pooling layer is a kind of network layer that downsamples and aggregates information that is dispersed among many vectors into fewer vectors. It has several uses.

Pooling layer — main illustration
Pooling layer — illustration

Key takeaways

  • Pooling layer belongs to computer science; place it in that map before memorising details.
  • Learn the definition first, then one example that makes the definition concrete.
  • Connect Pooling layer to a quantity you can measure, compute or draw — that is where exam questions come from.
  • Reproduce the core statement of Pooling layer from memory before moving on to harder problems.

Reference excerpt

In neural networks, a pooling layer is a kind of network layer that downsamples and aggregates information that is dispersed among many vectors into fewer vectors. It has several uses. It removes redundant information, thus reducing the amount of computation and memory required, which makes the model more robust to small variations in the input; and it increases the receptive field of neurons in later layers in the network.

Convolutional neural network pooling Pooling is most commonly used in convolutional neural networks (CNN). Below is a description of pooling in 2-dimensional CNNs. The generalization to n-dimensions is immediate. As notation, we consider a tensor x ∈ R H × W × C {\displaystyle x\in \mathbb {R} ^{H\times W\times C}} , where H {\displaystyle H} is height, W {\displaystyle W} is width, and C {\displaystyle C} is the number of channels. A pooling layer outputs a tensor y ∈ R H ′ × W ′ × C ′ {\displaystyle y\in \mathbb {R} ^{H'\times W'\times C'}} . We define two variables f , s {\displaystyle f,s} called "filter size" (aka "kernel size") and "stride". Sometimes, it is necessary to use a different filter size and stride for horizontal and vertical directions. In such cases, we define 4 variables: f H , f W , s H , s W {\displaystyle f_{H},f_{W},s_{H},s_{W}} . The receptive field of an entry in the output tensor, y {\displaystyle y} , are all the entries in x {\displaystyle x} that can affect that entry.

Max pooling

Max Pooling (MaxPool) is commonly used in CNNs to reduce the spatial dimensions of feature maps.

… excerpt ends here. Continue reading the full article.

Illustrations

Pooling layer: Three example padding conditions. Replication condition means that the pixel outside is padded with the closest pixel inside. The reflection padding is where the pixel outside is padded with the pixel inside, reflected across the boundary of the image. The circular padding is where the pixel outside wraps around to the other side of the image.
Three example padding conditions. Replication condition means that the pixel outside is padded with the closest pixel inside. The reflection padding is where the pixel outside is padded with the pixel inside, reflected across the boundary of the image. The circular padding is where the pixel outside wraps around to the other side of the image.
Pooling layer: RoI pooling to size 2x2. In this example, the RoI proposal has size 7x5. It is divided into 4 rectangles. Because 7 is not divisible by 2, it is divided to the nearest integers, as 7 = 3 + 4. Similarly, 5 is divided to 2 + 3. This gives 4 sub-rectangles. The maximum of each sub-rectangle is taken. This is the output of the RoI pooling.
RoI pooling to size 2x2. In this example, the RoI proposal has size 7x5. It is divided into 4 rectangles. Because 7 is not divisible by 2, it is divided to the nearest integers, as 7 = 3 + 4. Similarly, 5 is divided to 2 + 3. This gives 4 sub-rectangles. The maximum of each sub-rectangle is taken. This is the output of the RoI pooling.

Worked examples

Example 1 — a first encounter with Pooling layer

Start with the simplest possible case. Write down what Pooling layer claims or describes in one sentence, then invent the smallest concrete situation in which that sentence is true. In computer science, the smallest case is usually a single object, a single equation or a single measurement. Check that every symbol or term in your sentence has a meaning in that case.

Example 2 — changing one variable

Take the situation from Example 1 and change exactly one quantity: double it, halve it, or set it to zero. Predict what should happen to Pooling layer before you calculate. Comparing your prediction with the result is the fastest way to find out whether you understand the idea or only the words.

Example 3 — an exam-style question

Typical questions about Pooling layer ask you to (a) state it precisely, (b) apply it to given data, and (c) explain a limitation. Practise writing all three answers in under five minutes; the third part is what separates a full-mark answer from an average one.

Applications of Pooling layer

In research
Pooling layer appears in computer science research whenever the underlying quantities have to be modelled precisely. Papers usually cite it as a starting assumption and then explore where it breaks down.
In technology and industry
Engineering practice reuses Pooling layer in design rules, simulations and safety margins. Knowing the idea lets you read a specification sheet and understand why the numbers look the way they do.
In the classroom
Pooling layer is common in secondary-school and first-year university syllabi. It links to neighbouring topics Computational neuroscience, Computer vision, Neural network architectures, so understanding it makes those chapters shorter.
In everyday life
Look for Pooling layer outside the textbook — in sport, cooking, traffic, electronics or the sky above you. An example you found yourself is remembered far longer than one you were given.

Affiliate

Preply — study more efficiently by working with a personal tutor. 50% off.

How to study Pooling layer in 20 minutes

  1. Read the reference excerpt below once, without taking notes.
  2. Close the page and write down what Pooling layer means in your own words.
  3. Compare your version with the excerpt and mark what you missed.
  4. Work through the three examples above with pen and paper.
  5. Explain Pooling layer out loud to somebody else — or to Teacher Smith in the lgStudy chat.

Frequently asked questions

What is Pooling layer in simple terms?

In neural networks, a pooling layer is a kind of network layer that downsamples and aggregates information that is dispersed among many vectors into fewer vectors. It has several uses.

Why does Pooling layer matter?

Because it connects several computer science ideas at once: it gives you a definition you can apply, a quantity you can calculate, and a way to check whether a result is plausible.

How should I study Pooling layer?

Read the excerpt, restate it from memory, then work through the examples and applications listed on this page. The five-step study plan above takes about twenty minutes.

What does this page cover?

It gives you a compact reference excerpt plus original lgStudy explanations, examples, applications and study material on Pooling layer.

Tags

  • Computational neuroscience
  • Computer vision
  • Neural network architectures

Keep exploring