Backus–Naur form

BNF specifications outline how symbols are combined to form syntactically valid sequences. Each BNF consists of three core components: a set of non-terminal symbols, a set of terminal symbols, and a series of derivation rules.{{cite web |last1=Janikow |first1=Cezary Z. |title=What is BNF? |url=http://www.cs.umsl.edu/~janikow/cs4280/bnf.pdf}} Non-terminal symbols represent categories or variables that can be replaced, while terminal symbols are the fixed, literal elements (such as keywords or punctuation) that appear in the final sequence. Derivation rules provide the instructions for replacing non-terminal symbols with specific combinations of symbols.

A derivation rule is written in the format:

::= __expression__

where:

• <symbol>{{cite web |last=Naur |first=Peter |date=1961 |title=A COURSE OF ALGOL 60 PROGRAMMING with special reference to the DASK ALGOL system |url=http://archive.computerhistory.org/resources/text/algol/ACM_Algol_bulletin/1064048/frontmatter.pdf |access-date=26 March 2015 |publisher=Regnecentralen |publication-place=Copenhagen}} is a non-terminal symbol, enclosed in angle brackets (<>), identifying the category to be replaced
• {{Code|1=::=}} is a metasymbol meaning "is replaced by,"
• __expression__ is the replacement, consisting of one or more sequences of symbols—either terminal symbols (e.g., literal text like "Sr." or ",") or non-terminal symbols (e.g., {{Code|1=|2=bnf}})—with options separated by a vertical bar (|) to indicate alternatives.

For example, in the rule {{Code|1= ::= "Sr." {{!}} "Jr." {{!}} ""|2=bnf}}, the entire line is the derivation rule, "Sr.", "Jr.", and "" (an empty string) are terminal symbols, and {{Code|1=|2=bnf}} is a non-terminal symbol.

Generating a valid sequence involves starting with a designated start symbol and iteratively applying the derivation rules.{{cite web |last1=Janikow |first1=Cezary Z. |title=What is BNF? |url=http://www.cs.umsl.edu/~janikow/cs4280/bnf.pdf}} This process can extend sequences incrementally. To allow flexibility, some BNF definitions include an optional "delete" symbol (represented as an empty alternative, e.g., {{Code|1= ::= {{!}}|2=bnf}} ), enabling the removal of certain elements while maintaining syntactic validity.

A practical illustration of BNF is a specification for a simplified U.S. postal address:

::=

::= |

::= | "."

::=

::= ","

::= "Sr." | "Jr." | | ""

::= "Apt" | ""

This translates into English as:

• A postal address consists of a name-part, followed by a street-address part, followed by a zip-code part.
• A name-part consists of either: a personal-part followed by a last name followed by an optional suffix (Jr. Sr., or dynastic number) and end-of-line, or a personal part followed by a name part (this rule illustrates the use of recursion in BNFs, covering the case of people who use multiple first and middle names and initials).{{FOLDOC|Backus-Naur+Form}}
• A personal-part consists of either a first name or an initial followed by a dot.
• A street address consists of a house number, followed by a street name, followed by an optional apartment specifier, followed by an end-of-line.
• A zip-part consists of a town-name, followed by a comma, followed by a state code, followed by a ZIP-code followed by an end-of-line.
• An opt-suffix-part consists of a suffix, such as "Sr.", "Jr." or a roman-numeral, or an empty string (i.e. nothing).
• An opt-apt-num consists of a prefix "Apt" followed by an apartment number, or an empty string (i.e. nothing).

Note that many things (such as the format of a first-name, apartment number, ZIP-code, and Roman numeral) are left unspecified here. If necessary, they may be described using additional BNF rules.

The concept of using rewriting rules to describe language structure traces back to at least Pāṇini, an ancient Indian Sanskrit grammarian who lived sometime between the 6th and 4th centuries BC.{{cite web |title=Panini biography |url=http://www-gap.dcs.st-and.ac.uk/~history/Biographies/Panini.html |access-date=2014-03-22 |publisher=School of Mathematics and Statistics, University of St Andrews, Scotland}} His notation for describing Sanskrit word structure is equivalent in power to that of BNF and exhibits many similar properties.{{cite journal |last=Ingerman |first=Peter Zilahy |date=March 1967 |title="Pāṇini-Backus Form" Suggested |journal=Communications of the ACM |volume=10 |issue=3 |page=137 |doi=10.1145/363162.363165 |s2cid=52817672 |doi-access=free}}

In Western society, grammar was long regarded as a subject for teaching rather than scientific study; descriptions were informal and targeted at practical usage. This perspective shifted in the first half of the 20th century, when linguists such as Leonard Bloomfield and Zellig Harris began attempts to formalize language description, including phrase structure. Meanwhile, mathematicians explored related ideas through string rewriting rules as formal logical systems, such as Axel Thue in 1914, Emil Post in the 1920s–40s,{{cite journal |last=Post |first=Emil L. |year=1943 |title=Formal Reductions of the General Combinatorial Decision Problem |journal=American Journal of Mathematics |volume=65 |issue=2 |pages=197–215 |doi=10.2307/2371804}} and Alan Turing in 1936. Noam Chomsky, teaching linguistics to students of information theory at MIT combined linguistics and mathematics, adapting Thue's formalism to describe natural language syntax. In 1956, he introduced a clear distinction between generative rules (those of context-free grammars) and transformation rules.{{cite journal |last=Chomsky |first=Noam |year=1956 |title=Three models for the description of language |journal=IRE Transactions on Information Theory |volume=2 |issue=3 |pages=113–24 |doi=10.1109/TIT.1956.1056813 |s2cid=19519474}}{{cite book |last=Chomsky |first=Noam |title=Syntactic Structures |title-link=Syntactic Structures |publisher=Mouton |year=1957 |location=The Hague}}

BNF itself emerged when John Backus, a programming language designer at IBM, proposed a metalanguage of metalinguistic formulas to define the syntax of the new programming language IAL, known today as ALGOL 58, in 1959.{{Cite book |last=Backus |first=J. W. |title=Proceedings of the International Conference on Information Processing |publisher=UNESCO |year=1959 |pages=125–132 |contribution=The syntax and semantics of the proposed international algebraic language of the Zurich ACM-GAMM Conference}} This notation was formalized in the ALGOL 60 report, where Peter Naur named it Backus normal form in the committee's 1963 report.Revised ALGOL 60 report section 1.1. {{cite web |title=ALGOL 60 |url=http://www.masswerk.at/algol60/report.htm |access-date=April 18, 2015}} Whether Backus was directly influenced by Chomsky's work is uncertain.{{cite web |last=Fulton |first=Scott M., III |date=20 March 2007 |title=John W. Backus (1924 - 2007) |url=http://betanews.com/2007/03/20/john-w-backus-1924-2007 |access-date=Jun 3, 2014 |publisher=BetaNews, Inc.}}{{cite report |url=https://archive.computerhistory.org/resources/text/Oral_History/Backus_John/Backus_John_1.oral_history.2006.102657970.pdf |title=Oral History of John Backus |author=John Backus |date=Sep 2006 |publisher=Computer History Museum |editor=Grady Booch}} Here: p.25

Donald Knuth argued in 1964 that BNF should be read as Backus–Naur form, as it is "not a normal form in the conventional sense," unlike Chomsky normal form.{{cite journal |last=Knuth |first=Donald E. |year=1964 |title=Backus Normal Form vs. Backus Naur Form |journal=Communications of the ACM |volume=7 |issue=12 |pages=735–736 |doi=10.1145/355588.365140 |s2cid=47537431 |doi-access=free}} In 1967, Peter Zilahy Ingerman suggested renaming it Pāṇini Backus form to acknowledge Pāṇini's earlier, independent development of a similar notation.{{cite journal |last=Ingerman |first=P. Z. |year=1967 |title="Pāṇini Backus Form" suggested |journal=Communications of the ACM |volume=10 |issue=3 |page=137 |doi=10.1145/363162.363165 |s2cid=52817672 |doi-access=free}}

In the ALGOL 60 report, Naur described BNF as a metalinguistic formula:Revised ALGOL 60 report section. 1.1.{{cite web|url=http://www.masswerk.at/algol60/report.htm|title=ALGOL 60|access-date=April 18, 2015}}

{{blockquote|Sequences of characters enclosed in the brackets <> represent metalinguistic variables whose values are sequences of symbols. The marks "::{{=}}" and "{{pipe}}" (the latter with the meaning of "or") are metalinguistic connectives. Any mark in a formula, which is not a variable or a connective, denotes itself. Juxtaposition of marks or variables in a formula signifies juxtaposition of the sequence denoted.}}

This is exemplified in the report's section 2.3, where comments are specified:

For the purpose of including text among the symbols of a program the following "comment" conventions hold:

class="wikitable" ! The sequence of basic symbols: ! is equivalent to

--- | ; comment <any sequence not containing ';'>; | ;

--- | begin comment <any sequence not containing ';'>; | begin

--- | end <any sequence not containing 'end' or ';' or 'else'> | end

Equivalence here means that any of the three structures shown in the left column may be replaced, in any occurrence outside of strings, by the symbol shown in the same line in the right column without any effect on the action of the program.

Naur altered Backus's original symbols for ALGOL 60, changing :≡ to ::= and the overbarred "{{overline|or}}" to |, using commonly available characters.

{{Cite book |last=Backus |first=J. W. |author-link=John W. Backus |title=Proceedings of the International Conference on Information Processing |publisher=UNESCO |year=1959 |pages=125–132 |contribution=The syntax and semantics of the proposed international algebraic language of the Zurich ACM-GAMM Conference |contribution-url=http://www.softwarepreservation.org/projects/ALGOL/paper/Backus-Syntax_and_Semantics_of_Proposed_IAL.pdf/view}}{{rp|14}}

BNF is very similar to canonical-form Boolean algebra equations (used in logic-circuit design), reflecting Backus's mathematical background as a FORTRAN designer.{{cite web |last=Naur |first=Peter |date=1961 |title=A COURSE OF ALGOL 60 PROGRAMMING with special reference to the DASK ALGOL system |url=http://archive.computerhistory.org/resources/text/algol/ACM_Algol_bulletin/1064048/frontmatter.pdf |access-date=26 March 2015 |publisher=Regnecentralen |publication-place=Copenhagen}} Studies of Boolean algebra were commonly part of a mathematics curriculum, which may have informed Backus's approach. Neither Backus nor Naur described the names enclosed in < > as non-terminals—Chomsky's terminology was not originally used in describing BNF. Naur later called them "classes" in 1961 course materials. In the ALGOL 60 report, they were "metalinguistic variables," with other symbols defining the target language.

Saul Rosen, involved with the Association for Computing Machinery since 1947, contributed to the transition from IAL to ALGOL and edited Communications of the ACM. He described BNF as a metalanguage for ALGOL in his 1967 book.{{cite book |author=Saul Rosen |title=Programming Systems and Languages |location=New York |publisher=McGraw Hill |series=McGraw Hill Computer Science Series |date=Jan 1967 |isbn=978-0070537088 |url=https://archive.org/details/programmingsyste0000unse/mode/1up |url-access=registration}} Early ALGOL manuals from IBM, Honeywell, Burroughs, and Digital Equipment Corporation followed this usage.

BNF significantly influenced programming language development, notably as the basis for early compiler-compiler systems. Examples include Edgar T. Irons' "A Syntax Directed Compiler for ALGOL 60" and Brooker and Morris' "A Compiler Building System," which directly utilized BNF.{{cite book |last1=McKeeman |first1=W. M. |title=A Compiler Generator |last2=Horning |first2=J.J. |last3=Wortman |first3=D. B. |publisher=Prentice-Hall |year=1970 |isbn=978-0-13-155077-3}} Others, like Schorre's META II, adapted BNF into a programming language, replacing < > with quoted strings and adding operators like $ for repetition, as in: EXPR = TERM $('+' TERM .OUT('ADD') | '-' TERM .OUT('SUB')); This influenced tools like yacc, a widely used parser generator rooted in BNF principles, and Unix utilities like yacc.{{Citation |title=Source forge |type=project |url=http://bnfparser2.sourceforge.net/ |contribution=BNF parser²}} BNF remains one of the oldest computer-related notations still referenced today, though its variants often dominate modern applications.

Examples of its use as a metalanguage include defining arithmetic expressions: ::= | Here, {{Code|1=|2=bnf}} can recursively include itself, allowing repeated additions.

BNF today is one of the oldest computer-related languages still in use.{{citation needed|date=March 2020}}

File:Bnf-syntax-diagram.png]]

BNF's syntax itself may be represented with a BNF like the following:

::= |

::= "<" ">" "::="

::= " " | ""

::= | "|"

::= |

::= |

::= | "<" ">"

::= '"' '"' | "'" "'"

::= "" |

::= "" |

::= | |

::= "A" | "B" | "C" | "D" | "E" | "F" | "G" | "H" | "I" | "J" | "K" | "L" | "M" | "N" | "O" | "P" | "Q" | "R" | "S" | "T" | "U" | "V" | "W" | "X" | "Y" | "Z" | "a" | "b" | "c" | "d" | "e" | "f" | "g" | "h" | "i" | "j" | "k" | "l" | "m" | "n" | "o" | "p" | "q" | "r" | "s" | "t" | "u" | "v" | "w" | "x" | "y" | "z"

::= "0" | "1" | "2" | "3" | "4" | "5" | "6" | "7" | "8" | "9"

::= "|" | " " | "!" | "#" | "$" | "%" | "&" | "(" | ")" | "*" | "+" | "," | "-" | "." | "/" | ":" | ";" | ">" | "=" | "<" | "?" | "@" | "[" | "\" | "]" | "^" | "_" | "`" | "{" | "}" | "~"

::= | "'"

::= | '"'

::= |

::= | | "-"

Note that "" is the empty string.

The original BNF did not use quotes as shown in <literal> rule. This assumes that no whitespace is necessary for proper interpretation of the rule.

<EOL> represents the appropriate line-end specifier (in ASCII, carriage-return, line-feed or both depending on the operating system). <rule-name> and <text> are to be substituted with a declared rule's name/label or literal text, respectively.

In the U.S. postal address example above, the entire block-quote is a <syntax>. Each line or unbroken grouping of lines is a rule; for example one rule begins with <name-part> ::=. The other part of that rule (aside from a line-end) is an expression, which consists of two lists separated by a vertical bar |. These two lists consists of some terms (three terms and two terms, respectively). Each term in this particular rule is a rule-name.

{{Main|Extended Backus–Naur form}}

There are many variants and extensions of BNF, generally either for the sake of simplicity and succinctness, or to adapt it to a specific application. One common feature of many variants is the use of regular expression repetition operators such as * and +. The extended Backus–Naur form (EBNF) is a common one.

Another common extension is the use of square brackets around optional items. Although not present in the original ALGOL 60 report (instead introduced a few years later in IBM's PL/I definition), the notation is now universally recognised.

{{Main|ABNF}}

Augmented Backus–Naur form (ABNF) and Routing Backus–Naur form (RBNF)[http://tools.ietf.org/html/rfc5511 RBNF]. are extensions commonly used to describe Internet Engineering Task Force (IETF) protocols.

Parsing expression grammars build on the BNF and regular expression notations to form an alternative class of formal grammar, which is essentially analytic rather than generative in character.

Many BNF specifications found online today are intended to be human-readable and are non-formal. These often include many of the following syntax rules and extensions:

• Optional items enclosed in square brackets: [<item-x>].
• Items existing 0 or more times are enclosed in curly brackets or suffixed with an asterisk (*) such as <word> ::= <letter> {<letter>} or <word> ::= <letter> <letter>* respectively.
• Items existing 1 or more times are suffixed with an addition (plus) symbol, +, such as <word> ::= <letter>+.
• Terminals may appear in bold rather than italics, and non-terminals in plain text rather than angle brackets.
• Where items are grouped, they are enclosed in simple parentheses.

• ANTLR, a parser generator written in Java
• Coco/R, compiler generator accepting an attributed grammar in EBNF
• DMS Software Reengineering Toolkit, program analysis and transformation system for arbitrary languages
• GOLD, a BNF parser generator
• RPA BNF parser.{{Citation | url = http://www.rpatk.net/web/en/onlinedemo.php | title = RPatk | contribution = Online demo | access-date = 2011-07-03 | archive-date = 2012-11-02 | archive-url = https://web.archive.org/web/20121102161746/http://www.rpatk.net/web/en/onlinedemo.php | url-status = dead }} Online (PHP) demo parsing: JavaScript, XML
• XACT X4MR System,{{Citation | title = Act world | contribution = Tools | url = http://www.actworld.com/tools/| archive-url = https://web.archive.org/web/20130129075050/http://www.actworld.com/tools/| url-status = dead| archive-date = 2013-01-29}} a rule-based expert system for programming language translation
• XPL Analyzer, a tool which accepts simplified BNF for a language and produces a parser for that language in XPL; it may be integrated into the supplied SKELETON program, with which the language may be debuggedIf the target processor is System/360, or related, even up to z/System, and the target language is similar to PL/I (or, indeed, XPL), then the required code "emitters" may be adapted from XPL's "emitters" for System/360. (a SHARE contributed program, which was preceded by A Compiler Generator{{cite book |title=A Compiler Generator |first1=W. M. |last1=McKeeman |first2=J.J. |last2=Horning |first3=D. B. |last3=Wortman |year=1970 |publisher=Prentice-Hall |isbn=978-0-13-155077-3 |url=https://archive.org/details/compilergenerato00mcke |url-access=registration}})
• bnfparser²,{{Citation | url = http://bnfparser2.sourceforge.net/ | title = Source forge | contribution = BNF parser² | type = project}} a universal syntax verification utility
• bnf2xml,[http://sourceforge.net/projects/bnf2xml/ bnf2xml] Markup input with XML tags using advanced BNF matching
• JavaCC,{{Cite web |url=https://javacc.java.net/ |title=JavaCC |access-date=2013-09-25 |archive-url=https://web.archive.org/web/20130608172614/https://javacc.java.net/ |archive-date=2013-06-08 |url-status=dead }} Java Compiler Compiler tm (JavaCC tm) - The Java Parser Generator

• GNU bison, GNU version of yacc
• Yacc, parser generator (most commonly used with the Lex preprocessor)
• Racket's parser tools, lex and yacc-style parsing (Beautiful Racket edition)
• Qlik Sense, a BI tool, uses a variant of BNF for scripting {{cite web |title=Script Syntax - Qlik Sense on Windows |url=https://help.qlik.com/en-US/sense/May2021/Subsystems/Hub/Content/Sense_Hub/Scripting/script-syntax.htm |access-date=10 January 2022 |website=Qlik.com |publisher=QlikTech International AB |ref=qlikscriptsyntax}}
• BNF Converter (BNFC{{Citation |title=Language technology |url=http://bnfc.digitalgrammars.com/ |contribution=BNFC |place=SE |publisher=Chalmers}}), operating on a variant called "labeled Backus–Naur form" (LBNF). In this variant, each production for a given non-terminal is given a label, which can be used as a constructor of an algebraic data type representing that nonterminal. The converter is capable of producing types and parsers for abstract syntax in several languages, including Haskell and Java

• Augmented Backus–Naur form (ABNF)
• Compiler Description Language (CDL)
• Definite clause grammar – a more expressive alternative to BNF used in Prolog
• Extended Backus–Naur form (EBNF)
• Meta-II – an early compiler writing tool and notation
• Syntax diagram – railroad diagram
• Translational Backus–Naur form (TBNF)
• Van Wijngaarden grammar – used in preference to BNF to define Algol68
• Wirth syntax notation – an alternative to BNF from 1977

{{Reflist}}

• {{Citation | url = http://www.garshol.priv.no/download/text/bnf.html | title = BNF and EBNF: What are they and how do they work? | first = Lars Marius | last = Garshol | publisher = Priv | place = NO}}.
• {{IETF RFC|5234}} — Augmented BNF for Syntax Specifications: ABNF.
• {{IETF RFC|5511}} — Routing BNF: A Syntax Used in Various Protocol Specifications.
• ISO/IEC 14977:1996(E) Information technology – Syntactic metalanguage – Extended BNF, available from {{Citation | contribution = Publicly available | title = Standards | url = http://standards.iso.org/ittf/PubliclyAvailableStandards/ | publisher = ISO}} or from {{Citation | url = http://www.cl.cam.ac.uk/~mgk25/iso-14977.pdf | first = Marcus | last = Kuhn | publisher = CAM | place = UK | title = Iso 14977 }} (the latter is missing the cover page, but is otherwise much cleaner)

• {{Citation|url=http://blackbox.userweb.mwn.de/Algol-BNF.html |title=Algol-60 BNF |publisher=LRZ München |place=DE |last=Bernhard }}, the original BNF.
• {{Citation | url = http://savage.net.au/SQL/ | title = Savage | contribution = BNF grammars for SQL-92, SQL-99 and SQL-2003 | publisher = Net | place = AU}}, freely available BNF grammars for SQL.
• {{Citation | url = http://cui.unige.ch/db-research/Enseignement/analyseinfo/BNFweb.html | contribution = BNF Web Club | publisher = Unige | place = CH | title = DB research | access-date = 2007-01-25 | archive-url = https://web.archive.org/web/20070124000335/http://cui.unige.ch/db-research/Enseignement/analyseinfo/BNFweb.html | archive-date = 2007-01-24 | url-status = dead }}, freely available BNF grammars for SQL, Ada, Java.
• {{Citation | url = http://www.thefreecountry.com/sourcecode/grammars.shtml | contribution = Free Programming Language Grammars for Compiler Construction | title = Source code | publisher = The free country}}, freely available BNF/EBNF grammars for C/C++, Pascal, COBOL, Ada 95, PL/I.
• {{Citation | url = http://exp-engine.svn.sourceforge.net/viewvc/exp-engine/engine/trunk/docs/ | archive-url = https://archive.today/20121225083955/http://exp-engine.svn.sourceforge.net/viewvc/exp-engine/engine/trunk/docs/ | url-status = dead | archive-date = 2012-12-25 | contribution = BNF files related to the STEP standard | title = Exp engine | publisher = Source forge | type = SVN }}. Includes parts 11, 14, and 21 of the ISO 10303 (STEP) standard.

{{Metasyntax}}

{{DEFAULTSORT:Backus-Naur Form}}

Category:Formal languages

Category:Compiler construction

Category:Metalanguages