Dialogue system

{{Short description|Computer system to converse with a human}}

{{EngvarB|date=August 2022}}

{{More citations needed|date=June 2022}}

File:Automated online assistant.png on a website - an example where dialogue systems are major components]]

A dialogue system, or conversational agent (CA), is a computer system intended to converse with a human. Dialogue systems employed one or more of text, speech, graphics, haptics, gestures, and other modes for communication on both the input and output channel.

The elements of a dialogue system are not defined because this idea is under research,{{citation needed|date=January 2020}} however, they are different from chatbot.Klüwer, Tina. "From chatbots to dialog systems." Conversational agents and natural language interaction: Techniques and Effective Practices. IGI Global, 2011. 1-22. The typical GUI wizard engages in a sort of dialogue, but it includes very few of the common dialogue system components, and the dialogue state is trivial.

Background

After dialogue systems based only on written text processing starting from the early Sixties,McTear, Michael, Zoraida Callejas, and David Griol, [https://books.google.com/books?id=X_w0DAAAQBAJ&q=%22dialogue+system%22 The conversational interface: Talking to smart devices], Springer, 2016. the first speaking dialogue system was issued by the DARPA Project in the US in 1977.Giancarlo Pirani (ed), [https://books.google.com/books?id=BEWqCAAAQBAJ&q=%22dialogue+system%22 Advanced algorithms and architectures for speech understanding], Vol. 1. Springer Science & Business Media, 2013. After the end of this 5-year project, some European projects issued the first dialogue system able to speak many languages (also French, German and Italian).Alberto Ciaramella, A prototype performance evaluation report, Sundial work package 8000 (1993). Those first systems were used in the telecom industry to provide phone various services in specific domains, e.g. automated agenda and train tables service.

Components

What sets of components are included in a dialogue system, and how those components divide up responsibilities differs from system to system. Principal to any dialogue system is the dialogue manager, which is a component that manages the state of the dialogue, and dialogue strategy. A typical activity cycle in a dialogue system contains the following phases:Jurafsky & Martin (2009), Speech and language processing. Pearson International Edition, {{ISBN|978-0-13-504196-3}}, Chapter 24

  1. The user speaks, and the input is converted to plain text by the system's input recogniser/decoder, which may include:
  2. * automatic speech recogniser (ASR)
  3. * gesture recogniser
  4. * handwriting recogniser
  5. The text is analysed by a natural language understanding (NLU) unit, which may include:
  6. * Proper Name identification
  7. * part-of-speech tagging
  8. * Syntactic/semantic parser
  9. The semantic information is analysed by the dialogue manager, which keeps the history and state of the dialogue and manages the general flow of the conversation.
  10. Usually, the dialogue manager contacts one or more task managers, that have knowledge of the specific task domain.
  11. The dialogue manager produces output using an output generator, which may include:
  12. * natural language generator
  13. * gesture generator
  14. * layout manager
  15. Finally, the output is rendered using an output renderer, which may include:
  16. * text-to-speech engine (TTS)
  17. * talking head
  18. * robot or avatar

Dialogue systems that are based on a text-only interface (e.g. text-based chat) contain only stages 2–5.

Types of systems

Dialogue systems fall into the following categories, which are listed here along a few dimensions. Many of the categories overlap and the distinctions may not be well established.

Natural dialogue systems

{{Undue weight section|date=May 2017}}

"A Natural Dialogue System is a form of dialogue system that tries to improve usability and user satisfaction by imitating human behaviour" {{Citation

| last1 = Berg | first1 = Markus M.

| title = Modelling of Natural Dialogues in the Context of Speech-based Information and Control Systems

| isbn = 978-3-89838-508-4

| publisher = Akademische Verlagsgesellschaft AKA

| year = 2014

| url = http://nbn-resolving.de/urn:nbn:de:gbv:8-diss-167394}}

(Berg, 2014). It addresses the features of a human-to-human dialogue (e.g. sub dialogues and topic changes) and aims to integrate them into dialogue systems for human-machine interaction. Often, (spoken) dialogue systems require the user to adapt to the system because the system is only able to understand a very limited vocabulary, is not able to react to topic changes, and does not allow the user to influence the dialogue flow. Mixed-initiative is a way to enable the user to have an active part in the dialogue instead of only answering questions. However, the mere existence of mixed-initiative is not sufficient to be classified as a natural dialogue system. Other important aspects include:

  • Adaptivity of the system
  • Support of implicit confirmation
  • Usage of verification questions
  • Possibilities to correct information that has already been given
  • Over-informativeness (give more information than has been asked for)
  • Support negations
  • Understand references by analysing discourse and anaphora
  • Natural language generation to prevent monotonous and recurring prompts
  • Adaptive and situation-aware formulation
  • Social behaviour (greetings, the same level of formality as the user, politeness)
  • Quality of speech recognition and synthesis

Although most of these aspects are issues of many different research projects, there is a lack of tools that support the development of dialogue systems addressing these topics.{{Citation

| last1 = Berg | first1 = Markus M.

| title = Natural Language Processing and Information Systems

| volume = 9103

| pages = 144–150

| year = 2015

| doi = 10.1007/978-3-319-19581-0_12

| series = Lecture Notes in Computer Science

| isbn = 978-3-319-19580-3

| chapter = NADIA: A Simplified Approach Towards the Development of Natural Dialogue Systems

}}

Apart from VoiceXML that focuses on interactive voice response systems and is the basis for many spoken dialogue systems in industry (customer support applications) and AIML that is famous for the A.L.I.C.E. chatbot, none of these integrate linguistic features like dialogue acts or language generation. Therefore, NADIA (a research prototype) gives an idea of how to fill that gap and combines some of the aforementioned aspects like natural language generation, adaptive formulation, and sub dialogues.

Performance

Some authors measure the dialogue system's performance in terms of the percentage of sentences completely right, by comparing the model of sentences (this measure is called Concept Sentence AccuracyBangalore, Srinivas, and Michael Johnston. "Robust understanding in multimodal interfaces." Computational Linguistics 35.3 (2009): 345-397. or Sentence Understanding).

Applications

Dialogue systems can support a broad range of applications in business enterprises, education, government, healthcare, and entertainment.{{Citation

| last1 = Lester | first1 = J.

| last2 = Branting | first2 = K.

| last3 = Mott | first3 = B.

| contribution = Conversational Agents

| title = The Practical Handbook of Internet Computing

| publisher = Chapman & Hall

| year = 2004

| contribution-url = http://www.astutesolutions.com/downloads/conversational_agents_Lester_RealDialog.pdf}}

For example:

  • Responding to customers' questions about products and services via a company's website or intranet portal
  • Customer service agent knowledge base: Allows agents to type in a customer's question and guide them with a response
  • Guided selling: Facilitating transactions by providing answers and guidance in the sales process, particularly for complex products being sold to novice customers
  • Help desk: Responding to internal employee questions, e.g., responding to HR questions
  • Website navigation: Guiding customers to relevant portions of complex websites—a Website concierge
  • Technical support: Responding to technical problems, such as diagnosing a problem with a product or device
  • Personalized service: Conversational agents can leverage internal and external databases to personalise interactions, such as answering questions about account balances, providing portfolio information, delivering frequent flier or membership information, for example
  • Training or education: They can provide problem-solving advice while the user learns
  • Simple dialogue systems are widely used to decrease the human workload in call centers. In this and other industrial telephony applications, the functionality provided by dialogue systems is known as interactive voice response or IVR.
  • Support scientist in data manipulation and analysis tasks, for example in genomics.

{{Citation

| last1 = Crovari

| last2 = Pidò

| last3 = Pinoli

| last4 = Bernasconi

| last5 = Canakoglu

| last6 = Garzotto

| last7 = Ceri

| title = GeCoAgent: a conversational agent for empowering genomic data extraction and analysis

| journal = ACM Transactions on Computing for Healthcare

| publisher = ACM New York, NY

| year = 2021

| volume = 3

| pages = 1–29

| doi = 10.1145/3464383| hdl = 11311/1192262

| s2cid = 245855725

| hdl-access = free}}

In some cases, conversational agents can interact with users using artificial characters. These agents are then referred to as embodied agents.

Toolkits and architectures

A survey of current frameworks, languages and technologies for defining dialogue systems.

class="wikitable sortable"
Name & linksSystem typeDescriptionAffiliation[s]Environment[s]Comments
AIMLChatterbot languageXML dialect for creating natural language software agentsRichard Wallace, Pandorabots, Inc.
ChatScriptChatterbot languageLanguage/Engine for creating natural language software agentsBruce Wilcox
CSLU Toolkit
A state-based speech interface prototyping environmentOGI School of Science and Engineering
M. McTear
Ron Cole
[https://web.archive.org/web/20110416171931/http://cslu.cse.ogi.edu/toolkit/pubs/index.html publications] are from 1999.
{{usurped|1=[https://archive.today/20140523040735/http://www.linguasys.com/server-item/NLUI%20Server NLUI Server]}}Domain-independent toolkitComplete multilingual framework for building natural language user interface systemsLinguaSysout-of-box support of mixed-initiative dialogues
OlympusComplete framework for implementing spoken dialogue systemsCarnegie Mellon University[http://wiki.speech.cs.cmu.edu/olympus/index.php/Olympus]
[http://www.nextnova.com Nextnova]Multimodal PlatformPlatform for developing multimodal software applications. Based on State Chart XML (SCXML)Ponvia Technology, Inc.
VXML
Voice XML
Spoken dialogueMultimodal dialogue markup languageDeveloped initially by AT&T, then administered by an industry consortium and finally a W3C specificationExampleprimarily for telephony.
SALTmarkup languageMultimodal dialogue markup languageMicrosoft"has not reached the level of maturity of VoiceXML in the standards process".
Quack.com - QXMLDevelopment EnvironmentCompany bought by AOL
[http://opendial-toolkit.net OpenDial]Domain-independent toolkitHybrid symbolic/statistical framework for spoken dialogue systems, implemented in JavaUniversity of Oslo
[http://mmberg.net/nadia NADIA]dialogue engine and dialogue modellingCreating natural dialogues/dialogue systems. Supports dialogue acts, mixed initiative, NLG. Implemented in Java.Markus M. Bergcreate XML-based dialogue files, no need to specify grammars, publications are from 2014

See also

References

{{Reflist}}

Further reading

  • {{Cite book |last=Will |first=Thomas |title=Creating a Dynamic Speech Dialogue |publisher=VDM Verlag Dr. Müller |year=2007 |isbn=978-3-8364-4990-8}}

{{User interfaces}}

{{Authority control}}

Category:Multimodal interaction

Category:User interfaces

Category:Systems engineering