| アイテムタイプ |
デフォルトアイテムタイプ（フル）(1) |
| 公開日 |
2022-06-14 |
| タイトル |
|
|
タイトル |
IMNTPU Dialogue System Evaluation at the NTCIR-16 DialEval-2 Dialogue Quality and Nugget Detection |
|
言語 |
en |
| 作成者 |
Ting-Yun Hsiao
Yung-Wei Teng
Pei-Tz Chiu
Mike Tian-Jian Jiang
Min-Yuh Day
|
| 内容記述 |
|
|
内容記述タイプ |
Abstract |
|
内容記述 |
In recent years, there has been a surge in interest in evaluating the quality of chatbot conversation. We participated in the Dialogue Quality (DQ) and Nugget Detection (ND) subtasks in both Chinese and English. However, the majority of existing conventional approaches are based on the long short-term memory (LSTM) model. The paper suggests a method for assisting customers in resolving problems. The goal of this subtask is to automatically determine the status of dialogue sentences in a dialogue system's logs. On conversation tasks, we developed fine-tuning methodologies for the Transformer model. To evaluate and show the concept, we created a wide framework for testing and displaying the XLM-RoBERTa model's performance on conversational texts. Finally, the experimental findings of the two subtasks demonstrate the efficacy of our strategy. The experimental findings for the DialEval-2 task show that the suggested method's performance is reasonably equal to that of an LSTM-based baseline model. The main contribution of our study is that we suggested two crucial elements for increasing conversation quality and nugget identification subtasks in dialogue assessment, namely tokenization methods and finetuning procedures. |
|
言語 |
en |
| 出版者 |
|
|
出版者 |
NII Institutional Repository |
|
言語 |
en |
| 日付 |
|
|
日付 |
2022-06-14 |
|
日付タイプ |
Issued |
| 言語 |
|
|
言語 |
eng |
| 資源タイプ |
|
|
資源タイプ識別子 |
http://purl.org/coar/resource_type/c_5794 |
|
資源タイプ |
conference paper |
| ID登録 |
|
|
ID登録 |
10.20736/0002002261 |
|
ID登録タイプ |
JaLC |
| 関連情報 |
|
|
関連タイプ |
isReferencedBy |
|
|
識別子タイプ |
URI |
|
|
関連識別子 |
https://research.nii.ac.jp/ntcir/ntcir-16/index.html |
|
|
言語 |
en |
|
|
関連名称 |
NTCIR-16 Conference |
| 開始ページ |
|
|
開始ページ |
none |
| 会議記述 |
|
|
|
会議名 |
NTCIR-16 Conference |
|
|
言語 |
en |
|
回次 |
16 |
|
|
主催機関 |
National Institute of Informatics |
|
|
言語 |
en |
|
|
開始年 |
2022 |
|
|
開始月 |
6 |
|
|
開始日 |
14 |
|
|
終了年 |
2022 |
|
|
終了月 |
6 |
|
|
終了日 |
17 |
|
|
開催期間 |
June 14-17, 2022 |
|
|
言語 |
en |
|
|
開催会場 |
National Institute of Informatics |
|
|
言語 |
en |
|
開催国 |
JPN |
04-NTCIR16-DIALEVAL-HsiaoT.pdf (729.5 KB)
