Technique to allow AI to learn words in the flow of dialogue developed

Many conversation robots, chatbots, and voice assistant apps have appeared in recent years; however, in these systems, computers basically answer questions based on what has been preprogrammed. There is another method in which a computer learns from humans by asking simple repetitive questions; however, if the computer asks only questions such as "What is xyz?" in order to acquire knowledge, users will lose interest in talking with the computer.

The group led by Professor Komatani developed an implicit confirmation method by which the computer acquires the category of an unknown word during conversation with humans. This method aims for the system to predict the category of an unknown word from user input during conversation, to make implicit confirmation requests to the user, and to have the user respond to these requests. In this way, the system acquires knowledge about words during dialogues.

In this method, the system decides whether the prediction is correct or not by using the user response following each request, its context, by using machine learning*2 techniques. In addition, this system's decision performance improved by taking the classification results gained from dialogues with other users into consideration.

Chatbots in the market speak to anyone in the same manner. However, as dialogue systems become popular in the future, computers will be required to speak by learning from a conversational partner according to the situation. This group's research results are a new approach towards the realization of dialogue systems in which a computer can become smarter through conversation with humans and will lead to the development of dialogue systems with the ability to customize responses to the user's situation.

This research project was conducted as a part of joint research with Honda Research Institute Japan Co., Ltd.

*1 Dialogue system

A dialogue system (or conversational system), a part of artificial intelligence, is a computer system intended to converse with a human in natural language. Many speech-enabled IVR (interactive voice response) applications, humanoid robots, and text-based chatbots have been developed in recent years.

*2 Machine learning (AI)

Machine Learning is a method using algorithms to analyze data, learn from it, and then make a determination or prediction. Machine learning includes supervised learning, unsupervised learning, and reinforcement learning. In supervised learning, the computer is trained with a set of examples (dataset) that contains the correct answer; through which it becomes able to make judgements in different situations.