A new loss function for robust classification


Zhao L., MƏMMƏDOV M., Yearwood J.

Intelligent Data Analysis, vol.18, no.4, pp.697-715, 2014 (SCI-Expanded, Scopus) identifier

  • Nəşrin Növü: Article / Article
  • Cild: 18 Say: 4
  • Nəşr tarixi: 2014
  • Doi nömrəsi: 10.3233/ida-140664
  • jurnalın adı: Intelligent Data Analysis
  • Jurnalın baxıldığı indekslər: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Səhifə sayı: pp.697-715
  • Açar sözlər: Classification, data mining, loss function, machine learning, optimization
  • Açıq Arxiv Kolleksiyası: Məqalə
  • Adres: Bəli

Qısa məlumat

Loss function plays an important role in data classification. Manyloss functions have been proposed and applied to differentclassification problems. This paper proposes a new so called thesmoothed 0-1 loss function, that could be considered as anapproximation of the classical 0-1 loss function. Due to thenon-convexity property of the proposed loss function, globaloptimization methods are required to solve the correspondingoptimization problems. Together with the proposed loss function, wecompare the performance of several existing loss functions in theclassification of noisy data sets. In this comparison, differentoptimization problems are considered in regards to the convexity andsmoothness of different loss functions. The experimental resultsshow that the proposed smoothed 0-1 loss function works better ondata sets with noisy labels, noisy features, and outliers.