A Local Discriminant Projection Method Based on Objective Space
-
摘要: 现有的局部判别分析方法依据样本在投影前的近邻关系(原空间的近邻关系)设定优化目标中的权值,没有考虑样本的近邻关系在投影前后的变化。为了更准确地描述分类优化目标,该文提出了一种基于目标空间的局部判别投影方法,依据样本投影后的近邻关系(目标空间的近邻关系)设定目标函数中的权值矩阵,并采用迭代过程求解。其基本思想是使目标空间中的同类近邻样本尽量紧凑,目标空间中的异类近邻样本尽量分开。实验结果表明,该方法有效克服了原空间局部判别分析中存在的固有问题,在人工数据集和手写数字标准数据集均取得较好效果。Abstract: In the existing local discriminant analysis methods, weight matrices in objective functions are determined by neighborhood relationship (in original space) of samples before they are projected, without consideration of changes of the neighborhood after the projection. In order to depict the optimization goal of classification more accurately, a local discriminant projection method based on objective space is proposed, in which weight matrices in objective function are determined by the neighborhood of projected samples, namely, neighborhood in objective space. The objective function is optimized by an iterative procedure. The underlying idea of the new method is that the desired projection should make neighbors, in objective space, of the same class close and neighbors of different class apart. Experiment results show that the method overcomes effectively the problems of local discriminant analysis in original space and achieves good performance on both synthetic data and standard data set of handwriting digital.
-
Roweis S T and Saul L K. Nonlinear dimensionality reduction by locally linear embedding[J].Science.2000, 290(5500):2323-2328[4]Zhang Chun-xia, Xiang Shi-ming, Nie Fei-ping, et al.. Nonlinear dimensionality reduction with relative distance comparison[J].Neurocomputing.2009, 72(7-9):1719-1731[11]Qiao Li-shan, Chen Song-can, and Tan Xiao-yang. Sparsity preserving projections with applications to face recognition[J].Pattern Recognition.2010, 43(1):331-341[13]Yan Shui-cheng, Xu Dong, Zhang Ben-yu, et al.. Graph embedding and extensions: a general framework for dimensionality reduction[J].IEEE Transactions on Pattern Analysis and Machine Intelligence.2007, 29(1):40-51
计量
- 文章访问数: 3088
- HTML全文浏览量: 90
- PDF下载量: 586
- 被引次数: 0