The Classification of Data: A Novel Artificial Neural Network (ANN) Approach through Exhaustive Validation and Weight Initialization
DOI:
https://doi.org/10.26438/ijcse/v6i5.241254Keywords:
Classification, Artificial Neural Network, Machine Learning, N-Fold Cross Validation, Transfer functionAbstract
The Artificial Neural Networks (ANNs) has proved their significance to perform well in the fields of data-mining and machine learning like classification, pattern recognition, forecasting and prediction to have a few of them. This paper explores a novel approach for classification of data on four benchmark datasets from the perspective of ANNs and its intricacies. The proposed approach is successful in overcoming the drawback of over-fitting of data exists in the classification domain. Further, the proposed methodology reflects very improved and consistent results in comparison to existing techniques available in the ANNs as well as non-ANN domain.
References
B.W. Silverman, M. C. Jones, E. Fix, J.L. Hodges, "An important contribution to nonparametric discriminant analysis and density estimation", Int. Stat. Rev, Vol.57, Issue. 3, pp. 233–247, 1989.
B. Widrow, M. E. Hoff, "Adaptive switching circuits", IRE1 WESCON Convention Record, pp. 96-104, 1960.
C. B. Bishop, "Neural Networks for pattern Recognition", Oxford University Press, Oxford, 1995.
C. Cortes, V. Vapnik, "Support-vector networks", Mach. Learn., Vol. 20, Issue. 3, pp. 273–297, 1995.
D. E. Rumelhart, G.E. Hinton, R.J. Williams, "Learning internal representation by error propagation", Parallel distributed processing: Explorations in the microstructure of cognition, Vol.1, Bradford books, Cambridge, MA, 1986.
D. S. Broomhead, Lowe, "Multivariate functional interpolation and adaptive networks", Complex Syst., Vol. 2, pp. 302–355, 1988.
F. Rosenblatt, "The perceptron: A probabilistic model for information storage and optimization in the brain", Psychological Review, Vol. 65, Issue. 6, pp. 386-408, 1958.
G. Shakhnarovich, T. Darell, P. Indyk, "Nearest-Neighbors Methods in Learning and Vision", MIT Press, 2006.
I. Guyon, A. Saffari, G. Dror, G. Cawley, "Model selection: beyond the Bayesian–frequentist divide", The Journal of Machine Learning Research, Vol. 11, pp. 61–87, 2010.
I. V. Tetko, D. J. Livingstone, A.I. Luik, "Neural network studies. 1. Comparison of over-fitting and overtraining", Journal of chemical information and computer sciences, Vol. 35,
Issue.5, pp. 826-833, 1995.
J. J. Hopfield, "Neural Networks and Physical Systems with Emergent Collective Computational abilities". Proc. Natl. Acad. Sci. USA, Vol. 79, pp. 2554-2558, 1982.
N. Barakat, A. P. Bradley, "Rule extraction from support vector machines: a review", Neurocomputing, Vol. 74, Issue. 1–3, pp.178–190, 2010.
N. Rezazadeh, "Initialization of weights in deep belief neural network based on standard deviation of feature values in training data vectors", International journal of scientific research in computer science and engineering, Vol.5, Issue.4, pp.1-8,2017.
O. Chapelle, V. Vapnik, O. Bousquet, S. Mukherjee, "Choosing multiple parameters for support vector machines", Machines Learning, Vol. 46, Issue.1-3, pp. 131–159, 2002.
O. D. Hebb, "Organisation of Behaviour: A Neuropsychological Theory", John Wiley and Sons, New York, 1949.
P. Cortez, A. Cerderia, F. Almeida, T. Matos, J. Reis, "Modelling wine preferences by data mining from physicochemical properties", Decision Support Systems, Elsevier, Vol.47, Issue.4, pp. 547-553, 2009.
P. Piro, R. Nock, F. Nielsen, M. Barlaud, "Leveraging k-NN for generic classification boosting", Neurocomputing, Vol. 80, pp. 3–9, 2012.
P. Jian, M.Kamber, "Data Mining: Concepts and Techniques", 3rd Ed, 2012.
S. N. Sivanandam, M. Paulraj, "Introduction to Artificial Neural Networks", Vikas Pub. Pvt. Ltd., India, 2009.
Satish Kumar, "Neural Networks A Classroom Approach", Tata McGraw Hill, 2013.
T. Jackie, C. Hung, "Neural Network Model: Loss Minimization control of a PMSM with core Resistance Assesment", International journal of scientific research in Network security and Communication,Vol.4, Issue.6, 2016.
T. Kohonen, "Self-organized formation of topologically correct feature maps", Biological Cybernetics, Vol. 43, Issue. 1, pp. 59–69, 1982.
V. N. Vapnik, "Statistical learning theory", Wiley-Interscience, 1998.
W. An, M. Liang (2013), "Fuzzy support vector machine based on within-class scatter for classification problems with outliers or noises", Neurocomputing, Vol. 110, June, pp. 101–110, 2013.
W. Pitts, & W. S. McCulloch, "A logical calculus of the ideas immanent in nervous activity", Bull. Math. Biophys., Vol. 5, pp.115–133, 1943.
Zhun-ga Liu, Quan Pan, Jean Dezertb, "Classification of uncertain and imprecise data based on evidence theory", Neurocomputing,Vol. 133, pp. 459–470, 2014.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors contributing to this journal agree to publish their articles under the Creative Commons Attribution 4.0 International License, allowing third parties to share their work (copy, distribute, transmit) and to adapt it, under the condition that the authors are given credit and that in the event of reuse or distribution, the terms of this license are made clear.
