Decision list

Decision lists are a representation for Boolean functions which can be easily learnable from examples.{{cite journal|author=Ronald L. Rivest|authorlink=Ronald L. Rivest|title=Learning decision lists|journal=Machine Learning|volume=2|issue=3|pages=229–246|date=Nov 1987|doi=10.1023/A:1022607331053|url=http://people.csail.mit.edu/rivest/pubs/Riv87b.pdf|doi-access=free}} Single term decision lists are more expressive than disjunctions and conjunctions; however, 1-term decision lists are less expressive than the general disjunctive normal form and the conjunctive normal form.

The language specified by a k-length decision list includes as a subset the language specified by a k-depth decision tree.

Learning decision lists can be used for attribute efficient learning.Adam R. Klivans and Rocco A. Servedio, "Toward Attribute Efficient Learning of Decision Lists and Parities", Journal of Machine Learning Research 7:12:587-602 [http://dl.acm.org/citation.cfm?id=1248567&dl=ACM&coll=DL&CFID=344844478&CFTOKEN=13074001 ACM Digital Library] [http://www.jmlr.org/papers/volume7/klivans06a/klivans06a.pdf full text]

Definition

A decision list (DL) of length {{mvar|r}} is of the form:

if {{math|f1}} then

output {{math|b1}}

else if {{math|f2}} then

output {{math|b2}}

...

else if {{mvar|fr}} then

output {{mvar|br}}

where {{mvar|fi}} is the {{mvar|i}}th formula and {{mvar|bi}} is the {{mvar|i}}th boolean for i \in \{1...r\}. The last if-then-else is the default case, which means formula {{mvar|fr}} is always equal to true. A {{mvar|k}}-DL is a decision list where all of formulas have at most {{mvar|k}} terms. Sometimes "decision list" is used to refer to a 1-DL, where all of the formulas are either a variable or its negation.

See also

References