computer science

View synthesis

View synthesis is a computer science topic covered in the lgStudy science library. This page brings together a partial reference excerpt, illustrations, worked examples, real-world applications and a short study plan, so you can understand View synthesis rather than just read about it. In short: In computer graphics, view synthesis, or novel view synthesis, is a task which consists of generating images of a specific subject or scene from a specific point of view, when the only available information is pictures taken from different points of view. This task was only recently (late 2010s – early 2020s) tackled with significant success, mostly as a result of advances in machine learning.

Key takeaways

View synthesis belongs to computer science; place it in that map before memorising details.
Learn the definition first, then one example that makes the definition concrete.
Connect View synthesis to a quantity you can measure, compute or draw — that is where exam questions come from.
Reproduce the core statement of View synthesis from memory before moving on to harder problems.

Reference excerpt

In computer graphics, view synthesis, or novel view synthesis, is a task which consists of generating images of a specific subject or scene from a specific point of view, when the only available information is pictures taken from different points of view. This task was only recently (late 2010s – early 2020s) tackled with significant success, mostly as a result of advances in machine learning. Notable successful methods are Neural radiance fields and 3D Gaussian Splatting. Applications of view synthesis are numerous, one of them being Free view point television. The technique has also been applied to real-estate marketing, where novel views of a listing's interior are generated from a limited set of photographs for use in virtual home staging.

See also 3D reconstruction from multiple images Image-based modeling and rendering Image synthesis

References

External links Shuai Li; Ce Zhu; Ming-Ting Sun (2018). "Hole Filling with Multiple Reference Views in DIBR View Synthesis". IEEE Transactions on Multimedia. 20 (8): 1948–1959. arXiv:1802.03079. Bibcode:2018arXiv180203079L. doi:10.1109/TMM.2018.2791810. S2CID 33449031. Ce Zhu; Shuai Li (2016). "Depth Image Based View Synthesis: New Insights and Perspectives on Hole Generation and Filling". IEEE Transactions on Broadcasting. 62 (1): 82–93. doi:10.1109/TBC.2015.2475697. S2CID 19100077. Mansi Sharma; Santanu Chaudhury; Brejesh Lall (2014). Kinect-Variety Fusion: A Novel Hybrid Approach for Artifacts-Free 3DTV Content Generation. In 22nd International Conference on Pattern Recognition (ICPR), Stockholm, 2014. doi:10.1109/ICPR.2014.395. Webcam lets users eyeball others BBC View Synthesis by Image Interpolation Elements of Geometric Computer Vision Contributions to the problem of novel view synthesis from still pictures The Spinning Statue http://www.hpl.hp.com/research/mmsl/projects/graphics/chromaglyph/index.html

Worked examples

Example 1 — a first encounter with View synthesis

Start with the simplest possible case. Write down what View synthesis claims or describes in one sentence, then invent the smallest concrete situation in which that sentence is true. In computer science, the smallest case is usually a single object, a single equation or a single measurement. Check that every symbol or term in your sentence has a meaning in that case.

Example 2 — changing one variable

Take the situation from Example 1 and change exactly one quantity: double it, halve it, or set it to zero. Predict what should happen to View synthesis before you calculate. Comparing your prediction with the result is the fastest way to find out whether you understand the idea or only the words.

Example 3 — an exam-style question

Typical questions about View synthesis ask you to (a) state it precisely, (b) apply it to given data, and (c) explain a limitation. Practise writing all three answers in under five minutes; the third part is what separates a full-mark answer from an average one.

Applications of View synthesis

In research: View synthesis appears in computer science research whenever the underlying quantities have to be modelled precisely. Papers usually cite it as a starting assumption and then explore where it breaks down.
In technology and industry: Engineering practice reuses View synthesis in design rules, simulations and safety margins. Knowing the idea lets you read a specification sheet and understand why the numbers look the way they do.
In the classroom: View synthesis is common in secondary-school and first-year university syllabi. It links to neighbouring topics 3D imaging, Applications of computer vision, Computer graphics, so understanding it makes those chapters shorter.
In everyday life: Look for View synthesis outside the textbook — in sport, cooking, traffic, electronics or the sky above you. An example you found yourself is remembered far longer than one you were given.

Affiliate

Preply — study more efficiently by working with a personal tutor. 50% off.

How to study View synthesis in 20 minutes

Read the reference excerpt below once, without taking notes.
Close the page and write down what View synthesis means in your own words.
Compare your version with the excerpt and mark what you missed.
Work through the three examples above with pen and paper.
Explain View synthesis out loud to somebody else — or to Teacher Smith in the lgStudy chat.

Frequently asked questions

What is View synthesis in simple terms?

Why does View synthesis matter?

Because it connects several computer science ideas at once: it gives you a definition you can apply, a quantity you can calculate, and a way to check whether a result is plausible.

How should I study View synthesis?

Read the excerpt, restate it from memory, then work through the examples and applications listed on this page. The five-step study plan above takes about twenty minutes.

What does this page cover?

It gives you a compact reference excerpt plus original lgStudy explanations, examples, applications and study material on View synthesis.