In this paper we focus on the problem of question ranking in community question answering (cQA) forums in Arabic. We address the task with machine learning algorithms using advanced Arabic text representations. The latter are obtained by applying tree kernels to constituency parse trees combined with textual similarities, including word embeddings. Our two main contributions are: (i) an Arabic language processing pipeline based on UIMA—from segmentation to constituency parsing—built on top of Farasa, a state-of-the-art Arabic language processing toolkit; and (ii) the application of long short-term memory neural networks to identify the best text fragments in questions to be used in our tree-kernel-based ranker. Our thorough experimentation on a recently released cQA dataset shows that the Arabic linguistic processing provided by Farasa produces strong results and that neural networks combined with tree kernels further boost the performance in terms of both efficiency and accuracy. Our approach also enables an implicit comparison between different processing pipelines as our tests on Farasa and Stanford parsers demonstrate. © 2017 Elsevier Ltd. All rights reserved.

Language processing and learning models for community question answering in Arabic / Romeo, Salvatore; Da San Martino, Giovanni; Belinkov, Yonatan; Barrón-Cedeño, Alberto; Eldesouki, Mohamed; Darwish, Kareem; Mubarak, Hamdy; Glass, James; Moschitti, Alessandro. - In: INFORMATION PROCESSING & MANAGEMENT. - ISSN 0306-4573. - ELETTRONICO. - 56:2(2019), pp. 274-290. [10.1016/j.ipm.2017.07.003]

Language processing and learning models for community question answering in Arabic

Alessandro Moschitti
2019-01-01

Abstract

In this paper we focus on the problem of question ranking in community question answering (cQA) forums in Arabic. We address the task with machine learning algorithms using advanced Arabic text representations. The latter are obtained by applying tree kernels to constituency parse trees combined with textual similarities, including word embeddings. Our two main contributions are: (i) an Arabic language processing pipeline based on UIMA—from segmentation to constituency parsing—built on top of Farasa, a state-of-the-art Arabic language processing toolkit; and (ii) the application of long short-term memory neural networks to identify the best text fragments in questions to be used in our tree-kernel-based ranker. Our thorough experimentation on a recently released cQA dataset shows that the Arabic linguistic processing provided by Farasa produces strong results and that neural networks combined with tree kernels further boost the performance in terms of both efficiency and accuracy. Our approach also enables an implicit comparison between different processing pipelines as our tests on Farasa and Stanford parsers demonstrate. © 2017 Elsevier Ltd. All rights reserved.
2019
2
Romeo, Salvatore; Da San Martino, Giovanni; Belinkov, Yonatan; Barrón-Cedeño, Alberto; Eldesouki, Mohamed; Darwish, Kareem; Mubarak, Hamdy; Glass, James; Moschitti, Alessandro
Language processing and learning models for community question answering in Arabic / Romeo, Salvatore; Da San Martino, Giovanni; Belinkov, Yonatan; Barrón-Cedeño, Alberto; Eldesouki, Mohamed; Darwish, Kareem; Mubarak, Hamdy; Glass, James; Moschitti, Alessandro. - In: INFORMATION PROCESSING & MANAGEMENT. - ISSN 0306-4573. - ELETTRONICO. - 56:2(2019), pp. 274-290. [10.1016/j.ipm.2017.07.003]
File in questo prodotto:
File Dimensione Formato  
2017_Arabic.pdf

accesso aperto

Tipologia: Pre-print non referato (Non-refereed preprint)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 413.76 kB
Formato Adobe PDF
413.76 kB Adobe PDF Visualizza/Apri
1-s2.0-S0306457316306720-main.pdf

Solo gestori archivio

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 1.42 MB
Formato Adobe PDF
1.42 MB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/200205
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 22
  • ???jsp.display-item.citation.isi??? 16
social impact