基于正则化的半监督等距映射数据降维方法

王宪保; 陈诗文; 姚明海

doi:10.11999/JEIT150694

基于正则化的半监督等距映射数据降维方法

doi: 10.11999/JEIT150694

基金项目:

浙江省自然科学基金(LZ14F030001, LY14F030009)

计量
- 文章访问数: 1401
- HTML全文浏览量: 141
- PDF下载量: 499
- 被引次数: 0
出版历程
- 收稿日期: 2015-06-08
- 修回日期: 2015-09-21
- 刊出日期: 2016-01-19

Data Dimensionality Reduction Method of Semi-supervised Isometric Mapping Based on Regularization

Funds:

Zhejiang Provincial Natural Science Foundation (LZ14F030001, LY14F030009)

摘要

摘要: 针对等距映射(ISOMAP)算法无监督，不能生成显式映射函数等局限性，该文提出一种正则化的半监督等距映射(Reg-SS-ISOMAP)算法。该算法首先利用训练样本的标签样本构建K联通图(K-CG)，得到近似样本间测地线距离，并作为矢量特征代替原始数据点；然后通过测地线距离计算核矩阵，用半监督正则化方法代替多维尺度分析(MDS)算法处理矢量特征；最后利用正则化回归模型构建目标函数，得到低维表示的显式映射。算法在多个数据集上进行了比较实验，结果表明，文中提出的算法降维效果稳定，识别率高，显示了算法的有效性。
- 数据降维 /
- 流形学习 /
- 半监督学习 /
- 正则化
Abstract: This paper proposes Regularized Semi-Supervised ISOmetric MAPping (Reg-SS-ISOMAP) algorithm to solve the problem that ISOmetric MAPping (ISOMAP) algorithm is unsupervised and can not generate explicit mapping function. At first, this algorithm creates K-Connectivity Graph (K-CG) by labeled samples in training samples to get geodesic distance between approximate samples and takes it as feature vector substituting for original data. Then, it takes the geodesic distance as kernel and processes feature vector through semi-supervised regularization not MultiDimensional Scaling (MDS) algorithm. At last, it constructs objective function by regularization regression model which is low dimension and explicit mapping. The algorithm is simulated on different data sets, results show that it is stable in dimension reduction and high recognition rate.
- Data dimensionality reduction /
- Manifold learning /
- Semi-supervised learning /
- Regularization

HTML全文

参考文献(16)

ROWEIS S and SAUL L. Nonlinear dimensionality reduction by locally linear embedding[J]. Science, 2000, 290(5500): 2323-2326.

BELKIN M and NIYOGI P. Laplacian eigenmaps for dimensionality reduction and data representation[J]. Neural Computation, 2003, 15(6): 1373-1396.

KIMA Kyoungok and LEE Daewon. Inductive manifold learning using structured support vector machine[J]. Pattern Recognition, 2014, 47(1): 470-479.

杜春, 邹焕新, 孙即祥, 等. 基于改进局部切空间排列的流形学习算法[J]. 电子与信息学报, 2014, 36(2): 277-284. doi: 10.3724/SP.J.1146.2013.00135.

DU Chun, ZOU Huanxin, SUN Jixiang, et al. Manifold learning algorithm based on modified local Tangent space alignment[J]. Journal of Electronics Information Technology, 2014, 36(2): 277-284. doi: 10.3724/SP.J.1146. 2013.00135.

YANG Xin, FU Haoying, ZHA Hongyuan, et al. Semi- supervised nonlinear dimensionality reduction[C]. Proceedings of 32rd International Conference on Machine Learning, New York, 2006: 1065-1072.

HANSEN T J, ABRAHAMSEN T J, and HANSEN L K. Denoising by semi-supervised kernel PCA preimaging[J]. Pattern Recognition Letters, 2014, 49: 114-120.

HE Xiaofei, CAI Deng, and HAN Jiawei. Learning a maximum margin subspace for image retrieval[J]. IEEE Transactions on Knowledge and Data Engineering, 2008, 20(2): 189-201.

CAI Deng, HE Xiaofei, and HAN Jiawei. Semi-supervised discriminant analysis[C]. Proceedings of the 11th IEEE International Conference on Computer Vision. Piscataway, 2007: 1-7.

CAI Deng, HE Xiaofei, and HAN Jiawe. Isometric projection [C]. Proceedings of 22nd Conference on Artificial Intelligence, New York, 2007: 528-533.

BELKIN M, NIYOGI P, and SANDHWANI V. Mainifold regularization: a geometric framework for learning from labeled and unlabeled examples[J]. Journal of Machine Learning Research, 2006, 7(11): 2399-2434.

方耀宁, 郭云飞, 丁雪涛, 等. 一种基于标签迁移学习的改进正则化奇异值分解推荐算法[J]. 电子与信息学报, 2013, 35(12): 3044-3050. doi: 10.3724/SP.J.1146.2013.00290.

FANG Yaoning, GUO Yunfei, DING Xuetao et al. An improved regularized singular value decomposition recommender algorithm based on tag transfer learning[J]. Journal of Electronics Information Technology, 2013, 35(12): 3044-3050. doi: 10.3724/SP.J.1146.2013.00290.

ZHOU Yong, LIU Beizuo, XIA Shixiong, et al. Semi- supervised extreme learning machine with manifold and pairwise constraints regularization[J]. Neurocomputing, 2015, 149: 180-186.

WANG Yunyun,?CHEN Songcan, XUE?Hui, et al. Semi- supervised classification learning by discrimination-aware manifold regularization[J]. Neurocomputing, 2015, 147: 299-306.

MAO Yu, ZHOU Yanquan, LI Ruifan, et al. Semi-supervised learning via manifold regularization[J]. The Journal of China Universities of Posts and Telecommunications, 2012, 19(6): 79-88.

施引文献

资源附件(0)

访问统计