Please use this identifier to cite or link to this item:
http://hdl.handle.net/11375/28377
Title: | Assessment of CNN+XGBoost Performance for Image Classification |
Authors: | Turchenko, Andrii |
Advisor: | McNicholas, Paul D. |
Department: | Mathematics and Statistics |
Keywords: | convolutional neural network;XGBoost;machine learning;image classification;CIFAR10 |
Publication Date: | 29-Jan-2021 |
Abstract: | In the last few years, convolutional neural network (CNN) models have provided state-of-the-art results in visual recognition tasks. Similarly to CNNs, tree-based methods, in particular, gradient tree boosting (XGBoost) provided superior results in many applications. Taking into account the superiority of both methods, the goalof this work is to implement the CNN+XGBoost combined model where learned representations extracted from the CNN part will be used as input features for the XGBoost part. It is of particular interest to investigate whether the XGBoost part improves classification accuracy of the CNN part. In this work, we use existing approaches — AlexNet, AllConvolutionalNet, WideResNet, DenseNet and CaffeNet (in transfer learning mode) — to extract features from the CNN part with different quality, which is defined by the classification accuracy of the appropriate CNN model. Then XGBoost is trained on the extracted features and the obtained final accuracy of AlexNet+XGBoost, AllConvolutionalNet+XGBoost,WideResNet+XGBoost, DenseNet+XGBoost and CaffeNet+XGBoost models are assessed. All experiments are fulfilled using the CIFAR10 image dataset. Our results show that features extracted by CNNs, which provided more than 85–88% classification accuracy, do not allow XGBoost to improve the final CNN+XGBoost classification performance. |
URI: | http://hdl.handle.net/11375/28377 |
Appears in Collections: | Open Access Dissertations and Theses |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Turchenko_Andrii_finalsubmission202101_MSc.pdf | 14.14 MB | Adobe PDF | View/Open |
Items in MacSphere are protected by copyright, with all rights reserved, unless otherwise indicated.