Soft-Prompt Tuning to Predict Lung Cancer Using Primary Care Free-Text Dutch Medical Notes

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

1 Citation (Scopus)

Abstract

We examine the use of large Transformer-based pretrained language models (PLMs) for the problem of early prediction of lung cancer using free-text patient medical notes of Dutch primary care physicians. Specifically, we investigate: 1) how soft prompt-tuning compares to standard model fine-tuning; 2) whether simpler static word embedding models (WEMs) can be more robust compared to PLMs in highly imbalanced settings; and 3) how models fare when trained on notes from a small number of patients. All our code is available open source in https://bitbucket.org/aumc-kik/prompt_tuning_cancer_prediction/.
Original languageEnglish
Title of host publicationArtificial Intelligence in Medicine - 21st International Conference on Artificial Intelligence in Medicine, AIME 2023, Proceedings
EditorsJose M. Juarez, Mar Marcos, Gregor Stiglic, Allan Tucker
PublisherSpringer Science and Business Media Deutschland GmbH
Pages193-198
Number of pages6
Volume13897 LNAI
ISBN (Print)9783031343438
DOIs
Publication statusPublished - 2023
Event21st International Conference on Artificial Intelligence in Medicine, AIME 2023 - Portoroz, El Salvador
Duration: 12 Jun 202315 Jun 2023

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13897 LNAI

Conference

Conference21st International Conference on Artificial Intelligence in Medicine, AIME 2023
Country/TerritoryEl Salvador
CityPortoroz
Period12/06/202315/06/2023

Keywords

  • Cancer
  • Natural Language Processing
  • Prediction models

Cite this