| アイテムタイプ |
デフォルトアイテムタイプ（フル）(1) |
| 公開日 |
2025-06-06 |
| タイトル |
|
|
タイトル |
NAISTym at the NTCIR-18 MedNLP-CHAT: Classifying Patient-Chatbot Conversations with Objective and Subjective Assessments Using Prompting Techniques |
|
言語 |
en |
| 作成者 |
Lenard Paulo V. Tamayo
Sa'Idah Zahrotul Jannah
Mohamad Alnajjar
Axalia Levenchaud
Shaowen Peng
Shoko Wakamiya
Eiji Aramaki
|
| 内容記述 |
|
|
内容記述タイプ |
Abstract |
|
内容記述 |
Chatbots are widely used in the healthcare sector, making their accuracy and reliability essential. Beyond providing factually correct information, chatbots must also consider the human aspect of their responses. Large language models (LLMs) can be utilized to evaluate chatbot responses, employing prompting strategies such as chain-of-thought and few-shot prompting to enhance reasoning and optimize output quality. This study evaluates a chatbot’s answers to medical questions using both objective and subjective assessments. Different prompting techniques were applied: objective evaluation used baseline, chain-of-thought (COT), and chain-of-thought with few-shot (COTF) prompting, while subjective evaluation used baseline and baseline with few-shot (Baseline-f) prompting. The results revealed that COTF prompting with both models improved the performance of objective evaluation, while few-shot prompting enhanced subjective evaluation. |
|
言語 |
en |
| 出版者 |
|
|
出版者 |
NII Institutional Repository |
|
言語 |
en |
| 日付 |
|
|
日付 |
2025-06-06 |
|
日付タイプ |
Issued |
| 言語 |
|
|
言語 |
eng |
| 資源タイプ |
|
|
資源タイプ識別子 |
http://purl.org/coar/resource_type/c_5794 |
|
資源タイプ |
conference paper |
| ID登録 |
|
|
ID登録 |
10.20736/0002002054 |
|
ID登録タイプ |
JaLC |
| 関連情報 |
|
|
関連タイプ |
isReferencedBy |
|
|
識別子タイプ |
URI |
|
|
関連識別子 |
https://research.nii.ac.jp/ntcir/ntcir-18/index.html |
|
|
言語 |
en |
|
|
関連名称 |
NTCIR-18 Conference |
| 開始ページ |
|
|
開始ページ |
none |
| 会議記述 |
|
|
|
会議名 |
NTCIR-18 Conference |
|
|
言語 |
en |
|
回次 |
18 |
|
|
主催機関 |
National Institute of Informatics |
|
|
言語 |
en |
|
|
開始年 |
2025 |
|
|
開始月 |
6 |
|
|
開始日 |
10 |
|
|
終了年 |
2025 |
|
|
終了月 |
6 |
|
|
終了日 |
13 |
|
|
開催期間 |
June 10-13, 2025 |
|
|
言語 |
en |
|
|
開催会場 |
National Institute of Informatics |
|
|
言語 |
en |
|
開催国 |
JPN |
04-NTCIR18-MEDNLP-TamayoL.pdf (511.9 KB)
