Step down logistic regression for feature selection

Date

1997-08-01

Author

Baykal, Nazife

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

12
views

0
downloads

This paper proposes a methodology to the feature selection problem of pattern classification problems. For this purpose, pattern recognition or signal processing involves two major tasks: clustering transformation and then, feature selection. The concept of clustering reduces the dimensionality of the measurement space and generates a set of features. However, there is so far no covering theory how to select discriminative and biologically important features from the pool of generated features. This paper describes a hybrid approach in which an unsupervised learning method namely, a modified Self-Organizing Feature Map is used for feature extraction and then, a smaller linearly independent set of features are selected using Step-Down Logistic Regression. Experimental results using Doppler umbilical artery waveforms indicate that classification results using such features shows a very high correlation with the actual output. Also, Modified Self-Organizing Feature Map followed with the Step-Down Logistic Regression show to be a very powerful approach to discovering useful feature space in complex data.

Subject Keywords

Feature extraction, Pattern classifier, Self-organizing feature map, Likelihood ratio test, Step-down logistic regression

URI

https://hdl.handle.net/11511/52945

Conference Name

International Conference on Applied Statistical in Medical Sciences

Collections

Graduate School of Informatics, Conference / Seminar

Suggestions

OpenMETU
Core

A unified view of rank-based decision combination Saranlı, Afşar (2000-09-07) This study presents a theoretical investigation of the rank-based multiple classifier decision problem for closed-set pattern classification. The case with classifier raw outputs in the form of candidate class rankings is considered and formulated as a discrete optimization problem with the objective function being the total probability of correct decision. The problem has a global optimum solution but is of prohibitive dimensionality. We present a partitioning formalism under which this dimensionality can ...
An expert system for the differential diagnosis of erythemato-squamous diseases Guvenir, HA; Emeksiz, N (2000-01-01) This paper presents an expert system for differential diagnosis of erythemato-squamous diseases incorporating decisions made by three classification algorithms: nearest neighbor classifier, naive Bayesian classifier and voting feature intervals-5. This tool enables doctors to differentiate six types of erythemato-squamous diseases using clinical and histopathological parameters obtained from a patient. The program also gives explanations for the classifications of each classifier. The patient records are al...
Extended self organizing feature map: A tagged potential field approach Baykal, Nazife (KLUWER ACADEMIC PUBL, SPUIBOULEVARD 50, PO BOX 17, 3300 AA DORDRECHT, NETHERLANDS, 1999-8) This paper proposes an escape methodology to the local minima problem of self organizing feature maps generated in the overlapping regions which are equidistant to the corresponding winners. Two new versions of the Self Organizing Feature Map are derived equipped with such a methodology. The first approach introduces an excitation term, which increases the convergence speed and efficiency of the algorithm, while increasing the probability of escaping from local minima. In the second approach, we associate a...
Experimental design with short-tailed and long-tailed symmetric error distributions Yilmaz, Yıldız Elif; Akkaya, Ayşen; Department of Statistics (2004) One-way and two-way classification models in experimental design for both balanced and unbalanced cases are considered when the errors have Generalized Secant Hyperbolic distribution. Efficient and robust estimators for main and interaction effects are obtained by using the modified maximum likelihood estimation (MML) technique. The test statistics analogous to the normal-theory F statistics are defined to test main and interaction effects and a test statistic for testing linear contrasts is defined. It is ...
A statistical unified framework for rank-based multiple classifier decision combination Saranlı, Afşar (2001-04-01) This study presents a theoretical investigation of the rank-based multiple classifier decision combination problem, with the aim of providing a unified framework to understand a variety of such systems. The combination of the decisions of more than one classifiers with the aim of improving overall system performance is a concept of general interest in pattern recognition, as a viable alternative to designing a single sophisticated classifier. The problem of combining the classifier decisions in the raw form...

Citation Formats

N. Baykal, “Step down logistic regression for feature selection,” Ankara, Turkey, 1997, vol. 4, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/52945.