Questions are a fundamental tool for acquiring information, from children’s learning to complex tasks. Recent work has shown that the informativeness of questions by large language models (LLMs) can be enhanced through Direct Preference Optimization (DPO) and Expected Information Gain (EIG). In this study, we evaluate the effectiveness of a DPO-trained model in the context of medical interviews. Our findings indicate that DPO training improves success rates in medical interviews, thereby demonstrating the broader applicability and generalizability of this approach.

Boosting Questions' Effectiveness in Medical Interviews / Mazzaccara, Davide; Testoni, Alberto; Bernardi, Raffaella. - ELETTRONICO. - (2024). (Intervento presentato al convegno SEMDIAL tenutosi a Trento (Italia) nel 11th-12th September 2024).

Boosting Questions' Effectiveness in Medical Interviews

Mazzaccara, Davide;Testoni, Alberto;Bernardi, Raffaella
2024-01-01

Abstract

Questions are a fundamental tool for acquiring information, from children’s learning to complex tasks. Recent work has shown that the informativeness of questions by large language models (LLMs) can be enhanced through Direct Preference Optimization (DPO) and Expected Information Gain (EIG). In this study, we evaluate the effectiveness of a DPO-trained model in the context of medical interviews. Our findings indicate that DPO training improves success rates in medical interviews, thereby demonstrating the broader applicability and generalizability of this approach.
2024
Proceedings of the 28th Workshop on the Semantics and Pragmatics of Dialogue - Poster Abstracts
ACL Anthology
Boosting Questions' Effectiveness in Medical Interviews / Mazzaccara, Davide; Testoni, Alberto; Bernardi, Raffaella. - ELETTRONICO. - (2024). (Intervento presentato al convegno SEMDIAL tenutosi a Trento (Italia) nel 11th-12th September 2024).
Mazzaccara, Davide; Testoni, Alberto; Bernardi, Raffaella
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/431072
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact