computer science

Inside–outside–beginning (tagging)

Inside–outside–beginning (tagging) is a computer science topic covered in the lgStudy science library. This page brings together a partial reference excerpt, illustrations, worked examples, real-world applications and a short study plan, so you can understand Inside–outside–beginning (tagging) rather than just read about it. In short: The IOB format (or BIO format) is a common tagging format for tagging tokens in a chunking task in computational linguistics, especially in named-entity recognition (NER). IOB stands for "inside, outside, beginning".

Key takeaways

Inside–outside–beginning (tagging) belongs to computer science; place it in that map before memorising details.
Learn the definition first, then one example that makes the definition concrete.
Connect Inside–outside–beginning (tagging) to a quantity you can measure, compute or draw — that is where exam questions come from.
Reproduce the core statement of Inside–outside–beginning (tagging) from memory before moving on to harder problems.

Reference excerpt

The IOB format (or BIO format) is a common tagging format for tagging tokens in a chunking task in computational linguistics, especially in named-entity recognition (NER). IOB stands for "inside, outside, beginning". It was proposed in 1995.

Example A sentence can be parsed in many ways. Usually, a full parsing would result in a parse tree. In a tree, a constituent can contain other constituents. In chunking, a sentence is not parsed into a tree with overlapping constituents, but into non-overlapping "chunks".

For example, in a sentence "The morning flight from Denver has arrived", chunked into noun phrases (NP), verb phrases (VP), and prepositional phrases (PP).The(B-NP) morning(I-NP) flight(I-NP) from(B-PP) Denver(B-NP) has(B-VP) arrived(I-VP)The I- prefix before a tag indicates that the tag is inside a chunk. The B- prefix before a tag indicates that the tag is the beginning of a chunk. Whereas, to chunk only the NP, would result in:The(B-NP) morning(I-NP) flight(I-NP) from(O) Denver(B-NP) has(O) arrived(O)Here, all the tokens outside of NP are tagged as "O" for "outside".The same example after filtering out stop words: Related tagging schemes sometimes include BIOES: This consists of the tags B, E, I, S or O where S is used to represent a chunk containing a single token. Chunks of length greater than or equal to two always start with the B tag and end with the E tag.The(B-NP) morning(I-NP) flight(E-NP) from(S-PP) Denver(S-NP) has(B-VP) arrived(E-VP)This is also called BILOU, where "E" becomes "L" ("last") and "S" becomes "U" ("unit"). This is also called BMEWO, where "I" becomes "M" ("middle") and "S" becomes "W" ("whole").

Drawbacks IOB syntax does not permit any nesting, so cannot (unless extended) also represent even very simple phenomena such as sentence boundaries (which are not trivial to locate reliably), the scope of parenthetical expressions in sentences, grammatical structures, nested Named Entities such as "University of Wisconsin Dept. of Computer Science", and so on. It also leaves no place for metadata such as an identifier for the particular sample, the confidence level of the NER assignment, and so on, which are commonplace in NLP systems. Because of these limitations, data must often be converted out of IOB format, or projects must create custom extensions, which has led to a large number of not-quite-interoperable "IOB-like" formats. Many extended variations will also "pass" a non-extended parser, so it is easy to process incorrectly without noticing. The space and "O" (meaning "not in any chunk") convey no information and could simply be omitted. The same is true for putting the "type" suffix on "I-" or "E-" markers as in some variants of "BIOES"; and for marking both "I" and "E" (if you have begun and not ended you are "in", and if you are "in", you have begun and not ended). Some other formats deploy verbosity to improve readability and/or error-checking, but no such benefits appear to come to IOB in exchange for its verbosity. IOB's "one token per tag" depends on the tokenization used, even though tokenization is not standardized in NLP, and details of tokenization do not have to be entangled with the representations of NERs. "11/31/2019" could be anywhere from one to five tokens in different systems, but the NER is the same. Some systems even permit whitespace within tokens, and space as a delimiter collides with this, narrowing the applicability of IOB and motivating more extensions. "space" might or might not include tab, multiple spaces, hard spaces, and so on, differences which are difficult to detect when proofreading. IOB variants that allow multiple tokens per tag often use "/" or another reserved character to separate the tag from the token. This effectively "reserves" that character, which then cannot occur in tokens, or must be escaped, introducing more incompatibilities. IOB files have no place to put commonly-needed meta-data, such as the character encoding being used, the data source, internal location-markers, and so on.

XML format More powerful formats (like XML, JSON or s-expressions) can handle far more diverse annotations, have far less variation between implementations, and are often shorter and more readable as well. For example:

It also supports sentence boundaries, part-of-speech annotations, location markers, and other features commonly needed in NLP systems. Breaking all tokens in particular places is not strictly part of the NER task; but if every token were tagged (like "<T>is</T>"):

References Jurafsky, Daniel; Martin, James H. (2008). "13.5 Partial Parsing". Speech and Language Processing (2nd ed.). Upper Saddle River, N.J.: Prentice Hall. ISBN 978-0131873216.

External links Bob Carpenter (2009). "Coding Chunkers as Taggers: IO, BIO, BMEWO, and BMEWO+". Archived from the original on 5 August 2017.

Worked examples

Example 1 — a first encounter with Inside–outside–beginning (tagging)

Start with the simplest possible case. Write down what Inside–outside–beginning (tagging) claims or describes in one sentence, then invent the smallest concrete situation in which that sentence is true. In computer science, the smallest case is usually a single object, a single equation or a single measurement. Check that every symbol or term in your sentence has a meaning in that case.

Example 2 — changing one variable

Take the situation from Example 1 and change exactly one quantity: double it, halve it, or set it to zero. Predict what should happen to Inside–outside–beginning (tagging) before you calculate. Comparing your prediction with the result is the fastest way to find out whether you understand the idea or only the words.

Example 3 — an exam-style question

Typical questions about Inside–outside–beginning (tagging) ask you to (a) state it precisely, (b) apply it to given data, and (c) explain a limitation. Practise writing all three answers in under five minutes; the third part is what separates a full-mark answer from an average one.

Applications of Inside–outside–beginning (tagging)

In research: Inside–outside–beginning (tagging) appears in computer science research whenever the underlying quantities have to be modelled precisely. Papers usually cite it as a starting assumption and then explore where it breaks down.
In technology and industry: Engineering practice reuses Inside–outside–beginning (tagging) in design rules, simulations and safety margins. Knowing the idea lets you read a specification sheet and understand why the numbers look the way they do.
In the classroom: Inside–outside–beginning (tagging) is common in secondary-school and first-year university syllabi. It links to neighbouring topics Computational linguistics, so understanding it makes those chapters shorter.
In everyday life: Look for Inside–outside–beginning (tagging) outside the textbook — in sport, cooking, traffic, electronics or the sky above you. An example you found yourself is remembered far longer than one you were given.

Ask Teacher Smith questions about this articleOpens your AI tutor with a question about “Inside–outside–beginning (tagging)” →

Affiliate

Preply — study more efficiently by working with a personal tutor. 50% off.

How to study Inside–outside–beginning (tagging) in 20 minutes

Read the reference excerpt below once, without taking notes.
Close the page and write down what Inside–outside–beginning (tagging) means in your own words.
Compare your version with the excerpt and mark what you missed.
Work through the three examples above with pen and paper.
Explain Inside–outside–beginning (tagging) out loud to somebody else — or to Teacher Smith in the lgStudy chat.

Frequently asked questions

What is Inside–outside–beginning (tagging) in simple terms?

Why does Inside–outside–beginning (tagging) matter?

Because it connects several computer science ideas at once: it gives you a definition you can apply, a quantity you can calculate, and a way to check whether a result is plausible.

How should I study Inside–outside–beginning (tagging)?

Read the excerpt, restate it from memory, then work through the examples and applications listed on this page. The five-step study plan above takes about twenty minutes.

What does this page cover?

It gives you a compact reference excerpt plus original lgStudy explanations, examples, applications and study material on Inside–outside–beginning (tagging).