Distributed mixture-of-experts for Big Data using PETUUM framework

DSpace/Manakin Repository

Distributed mixture-of-experts for Big Data using PETUUM framework

Show full item record


Ficha descriptiva:


Title: Distributed mixture-of-experts for Big Data using PETUUM framework
Handle URI: http://repositoriodigital.uct.cl/handle/10925/1998
Autor: Peralta, B. - Parra, L. - Herrera, O. - Caro, L.
Abstract: Today, organizations are beginning to realize the importance of using as much data as possible for decision-making in their strategy. The finding of relevant patterns in enormous amount of data requires automatic machine learning algorithms, among them, a popular option is the mixture-of-experts that allows to model data using a set of local experts. The problem of using typical learning algorithms over Big Data is the handling of these large datasets in primary memory. In this paper, we propose a methodology to learn a mixture-of-experts in a distributed way using PETUUM platform. Particularly, we propose to learn the parameters of mixture-of-experts by adapting the standard stochastic gradient descent in a distributed way. This methodology is applied to people detection with standard real datasets considering accuracy and precision metrics among other. The results show a consistent performance of mixture-of-experts models where the best number of experts varies according to the particular dataset. We also evidence the advantages of the distributed approach by showing the almost linear decreasing of average training time according to the number of processors. In a future work, we expect to apply this methodology to mixture-of-experts with embedded variable selection.
Palabras Claves: Investigación conductual - Manejo de Datos - Algoritmos de Aprendizaje - Big Data
Datos de publicación: Proceedings - International Conference of the Chilean Computer Science Society, SCCC, 1-7, 2017

Files in this item

Archivos Size Format View
Peralta, Parra, Herrera_Distributed_2017.pdf 442.9Kb PDF Thumbnail

This item appears in the following Collection(s)

Show full item record

Browse

My Account