| アイテムタイプ |
デフォルトアイテムタイプ（フル）(1) |
| 公開日 |
2025-06-06 |
| タイトル |
|
|
タイトル |
UTY at the NTCIR-18 RadNLP 2024 Task: Possibilities and Limitations of a Hybrid Rule-Based and LLM Approach for Lung Cancer TNM Classification |
|
言語 |
en |
| 作成者 |
Yosuke Yamagishi
Ryosuke Tomiyama
Yui Ueda
|
| 内容記述 |
|
|
内容記述タイプ |
Abstract |
|
内容記述 |
Automated extraction of TNM staging information from radiology reports is a challenging task that requires understanding complex clinical language and applying detailed staging criteria. In this paper, we present our approach to the NTCIR-18 RadNLP 2024 shared task on automated lung cancer staging from Japanese radiology reports. We developed a hybrid system that combines large language models (LLMs) with rule-based processing in a two-stage pipeline: first extracting structured information from reports using GPT-4o models, then applying classification rules to determine the appropriate TNM stages. Our approach employed different strategies for each classification component: a rule-based method for the complex T classification and a more flexible LLM-based approach for N and M classifications. Evaluation results showed strong performance on the validation dataset (joint accuracy of 0.8148) but revealed a significant drop in T classification performance on the test dataset (from 0.8704 to 0.4769), while N and M classifications maintained high accuracy levels. This performance disparity highlights the trade-offs between rule-based precision and LLM flexibility in clinical NLP systems. Our findings suggest that balancing these approaches and leveraging larger development datasets could improve the robustness of automated cancer staging systems for real-world clinical applications. |
|
言語 |
en |
| 出版者 |
|
|
出版者 |
NII Institutional Repository |
|
言語 |
en |
| 日付 |
|
|
日付 |
2025-06-06 |
|
日付タイプ |
Issued |
| 言語 |
|
|
言語 |
eng |
| 資源タイプ |
|
|
資源タイプ識別子 |
http://purl.org/coar/resource_type/c_5794 |
|
資源タイプ |
conference paper |
| ID登録 |
|
|
ID登録 |
10.20736/0002002079 |
|
ID登録タイプ |
JaLC |
| 関連情報 |
|
|
関連タイプ |
isReferencedBy |
|
|
識別子タイプ |
URI |
|
|
関連識別子 |
https://research.nii.ac.jp/ntcir/ntcir-18/index.html |
|
|
言語 |
en |
|
|
関連名称 |
NTCIR-18 Conference |
| 開始ページ |
|
|
開始ページ |
none |
| 会議記述 |
|
|
|
会議名 |
NTCIR-18 Conference |
|
|
言語 |
en |
|
回次 |
18 |
|
|
主催機関 |
National Institute of Informatics |
|
|
言語 |
en |
|
|
開始年 |
2025 |
|
|
開始月 |
6 |
|
|
開始日 |
10 |
|
|
終了年 |
2025 |
|
|
終了月 |
6 |
|
|
終了日 |
13 |
|
|
開催期間 |
June 10-13, 2025 |
|
|
言語 |
en |
|
|
開催会場 |
National Institute of Informatics |
|
|
言語 |
en |
|
開催国 |
JPN |
19-NTCIR18-RADNLP-YamagishiY.pdf (653.9 KB)
