Cyc#OpenCyc

The project began in July 1984 by Douglas Lenat as a project of the Microelectronics and Computer Technology Corporation (MCC), a research consortium started by two United States–based corporations "to counter a then ominous Japanese effort in AI, the so-called 'fifth-generation' project."{{cite journal

|title=The World in a Box

|journal=Scientific American

|volume=286

|issue=1

|pages=18–19

|doi=10.1038/scientificamerican0102-18

|year=2002

|last1=Wood

|first1=Lamont

|bibcode=2002SciAm.286a..18W

}} The US passed the National Cooperative Research Act of 1984, which for the first time allowed US companies to "collude" on long-term research. Since January 1995, the project has been under active development by Cycorp, where Douglas Lenat was the CEO.

The CycL representation language started as an extension of RLL{{Cite web|url=http://www.aaai.org/Library/AAAI/1980/aaai80-047.php|title=A Representation Language Language|website=www.aaai.org|access-date=2017-11-27}}{{Cite report |last=Russell|first=Greiner|date=October 1980|title=RLL-1: A Representation Language Language|url=https://apps.dtic.mil/sti/citations/ADA096510|archive-url=https://web.archive.org/web/20150208123546/http://www.dtic.mil/docs/citations/ADA096510|url-status=live|archive-date=February 8, 2015|language=en}} (the Representation Language Language, developed in 1979–1980 by Lenat and his graduate student Russell Greiner while at Stanford University). In 1989,{{Cite journal |last1=Lenat |first1=Douglas B. |last2=Guha |first2=R. V. |date=June 1991 |title=The Evolution of CycL, the Cyc Representation Language |journal=ACM SIGART Bulletin |volume=2 |issue=3 |pages=84–87 |doi=10.1145/122296.122308 |issn=0163-5719 |s2cid=10306053}} CycL had expanded in expressive power to higher-order logic (HOL).

Cyc's ontology grew to about 100,000 terms in 1994, and as of 2017, it contained about 1,500,000 terms. The Cyc knowledge base involving ontological terms was largely created by hand axiom-writing; it was at about 1 million in 1994, and as of 2017, it is at about 24.5 million.

In 2008, Cyc resources were mapped to many Wikipedia articles.{{cite web|url=http://researchcommons.waikato.ac.nz/bitstream/handle/10289/2150/Medelyan_Legg_Wikiai08.pdf?sequence=1|title=Integrating Cyc and Wikipedia: Folksonomy meets rigorously defined common-sense|access-date=2013-05-10}} Cyc is presently connected to Wikidata.

The knowledge base is divided into microtheories. Unlike the knowledge base as a whole, each microtheory must be free from monotonic contradictions. Each microtheory is a first-class object in the Cyc ontology; it has a name that is a regular constant. The concept names in Cyc are CycL terms or constants. Constants start with an optional #$ and are case-sensitive. There are constants for:

• Individual items known as individuals, such as #$BillClinton or #$France.
• Collections, such as #$Tree-ThePlant (containing all trees) or #$EquivalenceRelation (containing all equivalence relations). A member of a collection is called an instance of that collection.
• Functions, which produce new terms from given ones. For example, #$FruitFn, when provided with an argument describing a type (or collection) of plants, will return the collection of its fruits. By convention, function constants start with an upper-case letter and end with the string Fn.
• Truth functions, which can apply to one or more other concepts and return either true or false. For example, #$siblings is the sibling relationship, true if the two arguments are siblings. By convention, truth function constants start with a lowercase letter.

For every instance of the collection #$ChordataPhylum (i.e., for every chordate), there exists a female animal (instance of #$FemaleAnimal), which is its mother (described by the predicate #$biologicalMother).

An inference engine is a computer program that tries to derive answers from a knowledge base. The Cyc inference engine performs general logical deduction.{{cite web|url=https://www.cyc.com/archives/service/cyc-inference-engines|title=cyc Inference engine|access-date=2015-06-04|archive-date=2019-12-09|archive-url=https://web.archive.org/web/20191209201932/https://www.cyc.com/archives/service/cyc-inference-engines|url-status=dead}} It also performs inductive reasoning, statistical machine learning and symbolic machine learning, and abductive reasoning.

The Cyc inference engine separates the epistemological problem from the heuristic problem. For the latter, Cyc used a community-of-agents architecture in which specialized modules, each with its own algorithm, became prioritized if they could make progress on the sub-problem.

The first version of OpenCyc was released in spring 2002 and contained only 6,000 concepts and 60,000 facts. The knowledge base was released under the Apache License. Cycorp stated its intention to release OpenCyc under parallel, unrestricted licences to meet the needs of its users. The CycL and SubL interpreter (the program that allows users to browse and edit the database as well as to draw inferences) was released free of charge, but only as a binary, without source code. It was made available for Linux and Microsoft Windows. The open source Texai{{cite web |title=The open source Texai project |url=http://www.texai.org |archive-url=https://web.archive.org/web/20090216201139/http://texai.org/blog |archive-date=2009-02-16}} project released the RDF-compatible content extracted from OpenCyc.{{cite web| url = http://sourceforge.net/project/showfiles.php?group_id=176781| title = Texai SourceForge project files}} The user interface was in Java 6.

Cycorp was a participant of a working group for the Semantic Web, Standard Upper Ontology Working Group, which was active from 2001 to 2003.{{Cite web |date=2013-01-15 |title=Standard Upper Ontology Working Group (SUO WG) - Home Page |url=http://suo.ieee.org/ |access-date=2024-12-16 |archive-url=https://web.archive.org/web/20130115180720/http://suo.ieee.org/ |archive-date=15 January 2013 }}

A Semantic Web version of OpenCyc was available starting in 2008, but ending sometime after 2016.{{Cite web |title=OpenCyc for the Semantic Web |url=http://sw.opencyc.org/ |archive-url=https://web.archive.org/web/20080821052740/http://sw.opencyc.org/ |archive-date=21 August 2008 |access-date=2024-12-16}}

OpenCyc 4.0 was released in June 2012.{{Cite web |date=2012-06-23 |title=OpenCyc.org |url=http://opencyc.org/ |access-date=2024-12-16 |archive-url=https://web.archive.org/web/20120623165538/http://opencyc.org/ |archive-date=23 June 2012 }} OpenCyc 4.0 contained 239,000 concepts and 2,093,000 facts; however, these are mainly taxonomic assertions.

4.0 was the last released version, and around March 2017, OpenCyc was shutdown for the purported reason that "because such “fragmenting” led to divergence, and led to confusion amongst its users and the technical community generally thought that OpenCyc fragment was Cyc.".{{Cite web |title=OpenCyc |url=http://opencyc.org/ |archive-url=https://web.archive.org/web/20170422212642/http://opencyc.org/ |archive-date=22 April 2017 |access-date=2024-12-16}}

In July 2006, Cycorp released the executable of ResearchCyc 1.0, a version of Cyc aimed at the research community, at no charge. (ResearchCyc was in beta stage of development during all of 2004; a beta version was released in February 2005.) In addition to the taxonomic information, ResearchCyc includes more semantic knowledge; it also includes a large lexicon, English parsing and generation tools, and Java-based interfaces for knowledge editing and querying. It contains a system for ontology-based data integration.

In 2001, GlaxoSmithKline was funding the Cyc, though for unknown applications.{{Cite news |last=HILTZIK |first=MICHAEL A. |date=2001-06-21 |title=Birth of a Thinking Machine |url=https://www.latimes.com/archives/la-xpm-2001-jun-21-mn-12881-story.html |archive-url=https://web.archive.org/web/20191213220632/https://www.latimes.com/archives/la-xpm-2001-jun-21-mn-12881-story.html |archive-date=13 Dec 2019 |access-date=2017-11-29 |work=Los Angeles Times |language=en-US |issn=0458-3035}} In 2007, the Cleveland Clinic has used Cyc to develop a natural-language query interface of biomedical information on cardiothoracic surgeries.{{Cite web |title=Case Study: A Semantic Web Content Repository for Clinical Research |url=http://www.w3.org/2001/sw/sweo/public/UseCases/ClevelandClinic/ |access-date=2018-02-28 |website=www.w3.org |language=en-US}} A query is parsed into a set of CycL fragments with open variables.{{Cite journal|last1=Lenat|first1=Douglas|last2=Witbrock|first2=Michael|last3=Baxter|first3=David|last4=Blackstone|first4=Eugene|last5=Deaton|first5=Chris|last6=Schneider|first6=Dave|last7=Scott|first7=Jerry|last8=Shepard|first8=Blake|date=2010-07-28|title=Harnessing Cyc to Answer Clinical Researchers' Ad Hoc Queries|journal=AI Magazine|language=en|volume=31|issue=3|page=13|doi=10.1609/aimag.v31i3.2299|issn=0738-4602|doi-access=free}} The Terrorism Knowledge Base was an application of Cyc that tried to contain knowledge about "terrorist"-related descriptions. The knowledge is stored as statements in mathematical logic. The project lasted from 2004 to 2008.{{cite journal |author1=Chris Deaton |author2=Blake Shepard |author3=Charles Klein |author4=Corrinne Mayans |author5=Brett Summers |author6=Antoine Brusseau |author7=Michael Witbrock |author8=Doug Lenat |year=2005 |title=The Comprehensive Terrorism Knowledge Base in Cyc |url=https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=b401fba6ece3a959b49aa5dfa2d04b54912bfa3c |journal=Proceedings of the 2005 International Conference on Intelligence Analysis |citeseerx=10.1.1.70.9247}}{{cite tech report|id=AFRL-RI-RS-TR-2008-125 |date=April 2008 |title=Terrorism Knowledge Base (TKB) Final Technical Report|url=https://www.researchgate.net/publication/235042082_Terrorism_Knowledge_Base_TKB|author1=Douglas B. Lenat |author2=Chris Deaton|institution=Air Force Research Laboratory Information Directorate|publication-place=Rome Research Site, Rome, New York }} Lycos used Cyc for search term disambiguation, but stopped in 2001.{{Cite web |date=2015-09-05 |title=Computer to Save World? |url=http://www.cyc.com/about/media-coverage/computer-save-world/ |access-date=2024-12-15 |archive-url=https://web.archive.org/web/20150905165226/http://www.cyc.com/about/media-coverage/computer-save-world/ |archive-date=5 September 2015 }} CycSecure was produced in 2002,{{Cite web |date=April 8, 2002 |title=Cyc in use |url=https://www.computerworld.com/article/1354418/cyc-in-use.html |access-date=2024-12-15 |website=Computerworld |language=en-US}} a network vulnerability assessment tool based on Cyc, with trials at the US STRATCOM Computer Emergency Response Team.{{Cite journal |last1=Shepard |first1=Blake |last2=Matuszek |first2=Cynthia |last3=Fraser |first3=C. Bruce |last4=Wechtenhiser |first4=William |last5=Crabbe |first5=David |last6=Güngördü |first6=Zelal |last7=Jantos |first7=John |last8=Hughes |first8=Todd |last9=Lefkowitz |first9=Larry |last10=Witbrock |first10=Michael |last11=Lenat |first11=Doug |last12=Larson |first12=Erik |date=2005-07-09 |title=A knowledge-based approach to network security: applying Cyc in the domain of network risk assessment |url=https://dl.acm.org/doi/abs/10.5555/1620092.1620110 |journal=Proceedings of the 17th Conference on Innovative Applications of Artificial Intelligence - Volume 3 |series=IAAI'05 |location=Pittsburgh, Pennsylvania |publisher=AAAI Press |pages=1563–1568 |isbn=978-1-57735-236-5}}

One Cyc application has the stated aim to help students doing math at a 6th grade level.{{Cite journal|last1=Lenat|first1=Douglas B.|last2=Durlach|first2=Paula J.|date=2014-09-01|title=Reinforcing Math Knowledge by Immersing Students in a Simulated Learning-By-Teaching Experience|journal=International Journal of Artificial Intelligence in Education|language=en|volume=24|issue=3|pages=216–250|doi=10.1007/s40593-014-0016-x|issn=1560-4292|doi-access=free}} The application, called MathCraft,{{Cite web|url=http://www.mathcraft.ai|title=Mathcraft by Cycorp|website=www.mathcraft.ai|access-date=2017-11-29}} was supposed to play the role of a fellow student who is slightly more confused than the user about the subject. As the user gives good advice, Cyc allows the avatar to make fewer mistakes.

The Cyc project has been described as "one of the most controversial endeavors of the artificial intelligence history".{{harvnb|Bertino|Piero|Zarria|2001|p=275}} Catherine Havasi, CEO of Luminoso, says that Cyc is the predecessor project to IBM's Watson.{{Cite news|url=https://techcrunch.com/2014/08/09/guide-to-common-sense-reasoning-whos-doing-it-and-why-it-matters/|title=Who's Doing Common-Sense Reasoning And Why It Matters|last=Havasi|first=Catherine|work=TechCrunch| date= Aug 9, 2014 |access-date=2017-11-29|language=en}} Machine-learning scientist Pedro Domingos refers to the project as a "catastrophic failure" for the unending amount of data required to produce any viable results and the inability for Cyc to evolve on its own.{{cite book |first=Pedro |last=Domingos |title=The Master Algorithm: How the Quest for the Ultimate Learning Machine Will Remake Our World |isbn=978-0465065707 |year=2015 |publisher=Basic Books |url-access=registration |url=https://archive.org/details/masteralgorithmh0000domi }}

Gary Marcus, a cognitive scientist and the cofounder of an AI company called Geometric Intelligence, says "it represents an approach that is very different from all the deep-learning stuff that has been in the news."{{Cite news|url=https://www.technologyreview.com/s/600984/an-ai-with-30-years-worth-of-knowledge-finally-goes-to-work/|title=An AI that spent 30 years learning some common sense is ready for work|last=Knight|first=Will|work=MIT Technology Review| date=Mar 14, 2016 | access-date=2017-11-29|language=en}} This is consistent with Doug Lenat's position that "Sometimes the veneer of intelligence is not enough".{{Cite web |author=Doug Lenat |date=May 15, 2017 |title=Sometimes the Veneer of Intelligence is Not Enough |url=https://cognitiveworld.com/articles/sometimes-veneer-intelligence-not-enough |access-date=2017-11-29 |website=CogWorld |language=en}}

This is a list of some of the notable people who work or have worked on Cyc either while it was a project at MCC (where Cyc was first started) or Cycorp.

{{div col|colwidth=18em}}

• Douglas Lenat
• Michael Witbrock
• Pat Hayes
• Ramanathan V. Guha
• Stuart J. Russell
• Srinija Srinivasan
• Jared Friedman
• John McCarthy

{{div col end}}

{{div col|colwidth=30em}}

• BabelNet
• DARPA Agent Markup Language
• DBpedia
• Fifth generation computer
• Freebase
• Wikidata
• List of notable artificial intelligence projects

{{div col end}}

{{Reflist}}

• Alan Belasco et al. (2004). [http://www.springeronline.com/sgw/cda/frontpage/0,11855,1-40109-22-36983341-0,00.html "Representing Knowledge Gaps Effectively"]. In: D. Karagiannis, U. Reimer (Eds.): Practical Aspects of Knowledge Management, Proceedings of PAKM 2004, Vienna, Austria, December 2–3, 2004. Springer-Verlag, Berlin Heidelberg.
• {{cite book |author1-link=Elisa Bertino |first1=Elisa |last1=Bertino |first2=Gian |last2=Piero |first3=B.C. |last3=Zarria |date=2001 |title=Intelligent Database Systems |publisher=Addison-Wesley Professional}}
• John Cabral & others (2005). [https://web.archive.org/web/20070927210738/http://www.cyc.com/doc/white_papers/ilp2005-semantic-ILP.pdf "Converting Semantic Meta-Knowledge into Inductive Bias"]. In: Proceedings of the 15th International Conference on Inductive Logic Programming. Bonn, Germany, August 2005.
• Jon Curtis et al. (2005). [https://web.archive.org/web/20060325020231/http://www.cyc.com/doc/white_papers/KRAQ2005.pdf "On the Effective Use of Cyc in a Question Answering System"]. In: Papers from the IJCAI Workshop on Knowledge and Reasoning for Answering Questions. Edinburgh, Scotland: 2005.
• Chris Deaton et al. (2005). [https://web.archive.org/web/20080517172142/http://www.cyc.com/doc/white_papers/TKB-IA2005.pdf "The Comprehensive Terrorism Knowledge Base in Cyc"]. In: Proceedings of the 2005 International Conference on Intelligence Analysis, McLean, Virginia, May 2005.
• Kenneth Forbus et al. (2005) .[https://web.archive.org/web/20060325020423/http://www.cyc.com/doc/white_papers/CombiningAnalogy-IA2005.pdf "Combining analogy, intelligent information retrieval, and knowledge integration for analysis: A preliminary report"]. In: Proceedings of the 2005 International Conference on Intelligence Analysis, McLean, Virginia, May 2005
• douglas foxvog (2010), "Cyc". In: [http://marte.aslab.upm.es/redmine/files/dmsf/p_oasys/160623124554_195_Poli_-_Theory_and_Applications_of_Ontology.pdf Theory and Applications of Ontology: Computer Applications] {{Webarchive|url=https://web.archive.org/web/20181112101452/http://marte.aslab.upm.es/redmine/files/dmsf/p_oasys/160623124554_195_Poli_-_Theory_and_Applications_of_Ontology.pdf |date=2018-11-12 }}, Springer.
• Fritz Lehmann and d. foxvog (1998), "[http://www.aaai.org/Papers/Workshops/1998/WS-98-04/WS98-04-007.pdf Putting Flesh on the Bones: Issues that Arise in Creating Anatomical Knowledge Bases with Rich Relational Structures]". In: Knowledge Sharing across Biological and Medical Knowledge Based Systems, AAAI.
• Douglas Lenat and R. V. Guha (1990). Building Large Knowledge-Based Systems: Representation and Inference in the Cyc Project. Addison-Wesley. {{ISBN|0-201-51752-3}}.
• James Masters (2002). [https://web.archive.org/web/20060325020711/http://www.cyc.com/doc/white_papers/fusion2002.pdf "Structured Knowledge Source Integration and its applications to information fusion"]. In: Proceedings of the Fifth International Conference on Information Fusion. Annapolis, MD, July 2002.
• James Masters and Z. Güngördü (2003). ."Structured Knowledge Source Integration: A Progress Report" In: Integration of Knowledge Intensive Multiagent Systems. Cambridge, Massachusetts, USA, 2003.
• Cynthia Matuszek et al. (2006). [https://web.archive.org/web/20121025045607/http://www.cyc.com/doc/white_papers/AAAI06SS-SyntaxAndContentOfCyc.pdf "An Introduction to the Syntax and Content of Cyc."]. In: Proc. of the 2006 AAAI Spring Symposium on Formalizing and Compiling Background Knowledge and Its Applications to Knowledge Representation and Question Answering. Stanford, 2006
• Cynthia Matuszek et al. (2005) .[https://web.archive.org/web/20060325020518/http://www.cyc.com/doc/white_papers/AAAI051MatuszekC.pdf "Searching for Common Sense: Populating Cyc from the Web"]. In: Proceedings of the Twentieth National Conference on Artificial Intelligence. Pittsburgh, Pennsylvania, July 2005.
• Tom O'Hara et al. (2003). [https://web.archive.org/web/20060325020408/http://www.cyc.com/doc/white_papers/inducing-criteria-for-mass.pdf "Inducing criteria for mass noun lexical mappings using the Cyc Knowledge Base and its Extension to WordNet"]. In: Proceedings of the Fifth International Workshop on Computational Semantics. Tilburg, 2003.
• Fabrizio Morbini and Lenhart Schubert (2009). [https://web.archive.org/web/20150923211804/http://www.cs.rochester.edu/~morbini/files/commonsense09.pdf "Evaluation of EPILOG: a Reasoner for Episodic Logic"]. University of Rochester, Commonsense '09 Conference (describes Cyc's library of ~1600 'Commonsense Tests')
• Kathy Panton et al. (2002). [https://web.archive.org/web/20060325020252/http://www.cyc.com/doc/white_papers/iaai.pdf "Knowledge Formation and Dialogue Using the KRAKEN Toolset"]. In: Eighteenth National Conference on Artificial Intelligence. Edmonton, Canada, 2002.
• Deepak Ramachandran P. Reagan & K. Goolsbey (2005). [http://reason.cs.uiuc.edu/deepak/CO05-FORCyc.pdf "First-Orderized ResearchCyc: Expressivity and Efficiency in a Common-Sense Ontology"] {{Webarchive|url=https://web.archive.org/web/20140324011058/http://reason.cs.uiuc.edu/deepak/CO05-FORCyc.pdf |date=2014-03-24 }}. In: Papers from the AAAI Workshop on Contexts and Ontologies: Theory, Practice and Applications. Pittsburgh, Pennsylvania, July 2005.
• Stephen Reed and D. Lenat (2002). [https://web.archive.org/web/20091122191538/http://www.cyc.com/doc/white_papers/mapping-ontologies-into-cyc_v31.pdf "Mapping Ontologies into Cyc"]. In: AAAI 2002 Conference Workshop on Ontologies For The Semantic Web. Edmonton, Canada, July 2002.
• Benjamin Rode et al. (2005). [https://web.archive.org/web/20060325020543/http://www.cyc.com/doc/white_papers/PatternRecovery-IA2005.pdf "Towards a Model of Pattern Recovery in Relational Data"]. In: Proceedings of the 2005 International Conference on Intelligence Analysis. McLean, Virginia, May 2005.
• Dave Schneider et al. (2005). [https://web.archive.org/web/20060325020457/http://www.cyc.com/doc/white_papers/GatheringAndManagingFacts-IA2005.pdf "Gathering and Managing Facts for Intelligence Analysis"]. In: Proceedings of the 2005 International Conference on Intelligence Analysis. McLean, Virginia, May 2005.
• Schneider, D., & Witbrock, M. J. (2015, May). [http://www.www2015.it/documents/proceedings/companion/p673.pdf "Semantic construction grammar: bridging the NL/Logic divide"] In Proceedings of the 24th International Conference on World Wide Web (pp. 673–678).
• Blake Shepard et al. (2005). [https://web.archive.org/web/20060325020558/http://www.cyc.com/doc/white_papers/IAAI-05-CycSecure.pdf "A Knowledge-Based Approach to Network Security: Applying Cyc in the Domain of Network Risk Assessment"]. In: Proceedings of the Seventeenth Innovative Applications of Artificial Intelligence Conference. Pittsburgh, Pennsylvania, July 2005.
• Nick Siegel et al. (2004). [https://web.archive.org/web/20060303134555/http://www.cyc.com/doc/white_papers/WS804SiegelN.pdf "Agent Architectures: Combining the Strengths of Software Engineering and Cognitive Systems"]. In: Papers from the AAAI Workshop on Intelligent Agent Architectures: Combining the Strengths of Software Engineering and Cognitive Systems. Technical Report WS-04-07, pp. 74–79. Menlo Park, California: AAAI Press, 2004.
• Nick Siegel et al. (2005). [https://web.archive.org/web/20060325020643/http://www.cyc.com/doc/white_papers/HypothesisGeneration-IA2005.pdf Hypothesis Generation and Evidence Assembly for Intelligence Analysis: Cycorp's Nooscape Application"]. In Proceedings of the 2005 International Conference on Intelligence Analysis, McLean, Virginia, May 2005.
• Michael Witbrock et al. (2002). [https://web.archive.org/web/20060325020212/http://www.cyc.com/doc/white_papers/IJCAI-paper-v5.pdf "An Interactive Dialogue System for Knowledge Acquisition in Cyc"]. In: Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence. Acapulco, Mexico, 2003.
• Michael Witbrock et al. (2004). [https://web.archive.org/web/20060325020304/http://www.cyc.com/doc/white_papers/SemAnnot2004-20041001.pdf "Automated OWL Annotation Assisted by a Large Knowledge Base"]. In: Workshop Notes of the 2004 Workshop on Knowledge Markup and Semantic Annotation at the 3rd International Semantic Web Conference ISWC2004. Hiroshima, Japan, November 2004, pp. 71–80.
• Michael Witbrock et al. (2005). [http://www.aaai.org/Papers/Symposia/Spring/2005/SS-05-03/SS05-03-015.pdf "Knowledge Begets Knowledge: Steps towards Assisted Knowledge Acquisition in Cyc"]. In: Papers from the 2005 AAAI Spring Symposium on Knowledge Collection from Volunteer Contributors (KCVC). pp. 99–105. Stanford, California, March 2005.
• William Jarrold (2001). [http://www.aaai.org/Library/Symposia/Spring/2001/ss01-04-009.php "Validation of Intelligence in Large Rule-Based Systems with Common Sense"]. "Model-Based Validation of Intelligence: Papers from the 2001 AAAI Symposium" (AAAI Technical Report SS-01-04).
• William Jarrold. (2003). [https://web.archive.org/web/20181112101459/https://pdfs.semanticscholar.org/9f62/34eb20b8f626fc0f33f54f10375aa6676b2a.pdf Using an Ontology to Evaluate a Large Rule Based Ontology: Theory and Practice]. {\em Performance Metrics for Intelligent Systems PerMIS '03} (NIST Special Publication 1014).

• [http://www.cyc.com/ Cycorp website]

Category:Common Lisp (programming language) software

Category:Ontology (information science)

Category:Knowledge bases

Category:Cognitive architecture