In this paper we propose a multiobjective simulated annealing based technique for anaphora resolution. There is no generally accepted metric for measuring the performance of anaphora resolution systems, and the existing metrics-MUC, B 3 , CEAF, Blanc, among others-tend to reward significantly different behaviors. Systems optimized according to one metric tend to perform poorly with respect to other ones, making it very difficult to compare anaphora resolution systems, as clearly shown by the results of the SEMEVAL 2010 Task 1 on the Multilingual Coreference Resolution. One solution would be to find a single completely satisfactory metric, but its not clear whether this is possible and at any rate it is not going to happen any time soon. An alternative is to optimize models according to multiple metrics simultaneously. In this paper, we propose a multiobjective simulated annealing based technique to solve the feature selection problem of anaphora resolution by optimizing multiple objective functions. Experimental results show that the proposed approach performs superior in comparison to the previously developed multiobjective genetic algorithm based feature selection technique.

A Multiobjective Simulated Annealing based Approach for Feature Selection in Anaphora Resolution

Uryupina, Olga;Poesio, Massimo
2011-01-01

Abstract

In this paper we propose a multiobjective simulated annealing based technique for anaphora resolution. There is no generally accepted metric for measuring the performance of anaphora resolution systems, and the existing metrics-MUC, B 3 , CEAF, Blanc, among others-tend to reward significantly different behaviors. Systems optimized according to one metric tend to perform poorly with respect to other ones, making it very difficult to compare anaphora resolution systems, as clearly shown by the results of the SEMEVAL 2010 Task 1 on the Multilingual Coreference Resolution. One solution would be to find a single completely satisfactory metric, but its not clear whether this is possible and at any rate it is not going to happen any time soon. An alternative is to optimize models according to multiple metrics simultaneously. In this paper, we propose a multiobjective simulated annealing based technique to solve the feature selection problem of anaphora resolution by optimizing multiple objective functions. Experimental results show that the proposed approach performs superior in comparison to the previously developed multiobjective genetic algorithm based feature selection technique.
2011
Proceedings of the 8th Discourse Anaphora and Anaphor Resolution Colloquium
Lisbona, Portogallo
Berlin: Springer-Verlag
9783642259166
A., Ekbal; S., Saha; Uryupina, Olga; Poesio, Massimo
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/89869
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 6
  • ???jsp.display-item.citation.isi??? ND
social impact