Kernel methods provide a computational framework to integrate heterogeneous biological data from different sources for a wide range of learning algorithms by designing a kernel for each di®erent information source and combining them in a unique kernel through simple mathematical operations. We develop here a novel technique for weighting kernels based on their von Neumann entropy. This permits to assess the kernel quality without using label information, and to integrate kernels before the beginning of the learning process. Moreover, we carry out a comparison with the unweighted kernel summation and a popular technique based on semi-definite programming on kernel integration benchmark data sets. Finally, we empirically study the variation of the performance of a support vector machine classi¯er considering pairs of kernels combined in di®erent ratios, and we show how, surprisingly, the unweighted sum of kernels seems to lead to the same performance than a more complex weighting schema.
Kernel Integration Using von Neumann Entropy / Malossini, Andrea; Blanzieri, Enrico; Segata, Nicola. - ELETTRONICO. - (2009), pp. 1-19.
Kernel Integration Using von Neumann Entropy
Malossini, Andrea;Blanzieri, Enrico;Segata, Nicola
2009-01-01
Abstract
Kernel methods provide a computational framework to integrate heterogeneous biological data from different sources for a wide range of learning algorithms by designing a kernel for each di®erent information source and combining them in a unique kernel through simple mathematical operations. We develop here a novel technique for weighting kernels based on their von Neumann entropy. This permits to assess the kernel quality without using label information, and to integrate kernels before the beginning of the learning process. Moreover, we carry out a comparison with the unweighted kernel summation and a popular technique based on semi-definite programming on kernel integration benchmark data sets. Finally, we empirically study the variation of the performance of a support vector machine classi¯er considering pairs of kernels combined in di®erent ratios, and we show how, surprisingly, the unweighted sum of kernels seems to lead to the same performance than a more complex weighting schema.File | Dimensione | Formato | |
---|---|---|---|
050.pdf
accesso aperto
Tipologia:
Versione editoriale (Publisher’s layout)
Licenza:
Tutti i diritti riservati (All rights reserved)
Dimensione
294.87 kB
Formato
Adobe PDF
|
294.87 kB | Adobe PDF | Visualizza/Apri |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione