In this study, new classification models were developed which can be used in the solution to the problems of Discriminant Analysis having two groups. For the solution of these type of problems, Lam, Choo and Moy (1996) proposed a model regarding the minimization of deviations from the group means. The model examined by these authors loses its efficiency in respect of the hit ratio as the distributions of populations of samples considered go away from the normal distribution. For the samples drawn from non normal or skewed distributions, the median is a much more suitable descriptive statistic than the mean. The aim of the study is to consider the models of two-group classification problems by minimizing the deviations from the group medians. When these proposed approaches are applied to the data of real life or of simulation drawn from different distributions, it is observed that the attained performance of classification is better than both some important classification approaches in the literature and especially the classification performance minimizing the deviations from group means proposed by Lam, Choo and Moy.