Questions are a fundamental tool for acquiring information, from children’s learning to complex tasks. Recent work has shown that the informativeness of questions by large language models (LLMs) can be enhanced through Direct Preference Optimization (DPO) and Expected Information Gain (EIG). In this study, we evaluate the effectiveness of a DPO-trained model in the context of medical interviews. Our findings indicate that DPO training improves success rates in medical interviews, thereby demonstrating the broader applicability and generalizability of this approach.
Boosting Questions' Effectiveness in Medical Interviews / Mazzaccara, Davide; Testoni, Alberto; Bernardi, Raffaella. - ELETTRONICO. - (2024). (Intervento presentato al convegno SEMDIAL tenutosi a Trento (Italia) nel 11th-12th September 2024).
Boosting Questions' Effectiveness in Medical Interviews
Mazzaccara, Davide;Testoni, Alberto;Bernardi, Raffaella
2024-01-01
Abstract
Questions are a fundamental tool for acquiring information, from children’s learning to complex tasks. Recent work has shown that the informativeness of questions by large language models (LLMs) can be enhanced through Direct Preference Optimization (DPO) and Expected Information Gain (EIG). In this study, we evaluate the effectiveness of a DPO-trained model in the context of medical interviews. Our findings indicate that DPO training improves success rates in medical interviews, thereby demonstrating the broader applicability and generalizability of this approach.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione