Machine learning with distributed data management and process architecture
Yükleniyor...
Dosyalar
Tarih
2019
Yazarlar
Dergi Başlığı
Dergi ISSN
Cilt Başlığı
Yayıncı
IEEE
Erişim Hakkı
info:eu-repo/semantics/closedAccess
Özet
With the development of technology that takes place more and more every day in our lives, it becomes almost impossible to manage and process the data produced and thus brought about the necessity of storage and analysis. Both the data size and the increase in the variety of data have necessitated the development of new methods in this context. In this study, distributed data management and analysis tools which are developed for data that cannot be processed in traditional regulations have been used. The machine learning application has been developed by using Logistic Regression classification algorithm. The application was implemented with the data set obtained from the sensors using pyspark libraries on the Spark cluster created using the Google Cloud service. And the working environment managed by YARN, has been observed during the implementation of the application.
Açıklama
4th International Conference on Computer Science and Engineering (UBMK) -- September 11-15, 2019 -- Samsun, Turkey
Anahtar Kelimeler
Big Data, Big Data Analytics, Machine Learning, Apache Spark, Pyspark, Logistic Regression, Yarn
Kaynak
4th International Conference on Computer Science and Engineering (UBMK)
WoS Q Değeri
N/A
Scopus Q Değeri
N/A
