| 引用本文: | 刘学艺,宋春跃,李平.基于Vapnik-Chervonenkis泛化界的极限学习机模型复杂性控制[J].控制理论与应用,2014,31(5):644~653.[点击复制] |
| LIU Xue-yi,SONG Chun-yue,LI Ping.Model complexity control of extreme learning machine using Vapnik-Chervonenkis generalization bounds[J].Control Theory and Technology,2014,31(5):644~653.[点击复制] |
|
| 基于Vapnik-Chervonenkis泛化界的极限学习机模型复杂性控制 |
| Model complexity control of extreme learning machine using Vapnik-Chervonenkis generalization bounds |
| 摘要点击 2545 全文点击 2474 投稿时间：2012-04-28 修订日期：2014-02-14 |
| 查看全文 查看/发表评论 下载PDF阅读器 |
| DOI编号 10.7641/CTA.2014.20428 |
| 2014,31(5):644-653 |
| 中文关键词 VC泛化界 模型复杂性 极限学习机 小样本 实际预测风险 |
| 英文关键词 VC generalization bounds model complexity extreme learning machine small sample real prediction risk |
| 基金项目 国家重点基础研究发展计划“973”资助项目(2009CB320603); 国家自然科学基金资助项目(61273085); 浙江省自然科学基金资助项目 (LY14F030020). |
|
| 中文摘要 |
| 模型复杂性是决定学习机器泛化性能的关键因素, 对其进行合理的控制是模型选择的重要原则. 极限学习 机(extreme learning machine, ELM)作为一种新的机器学习算法, 表现出了优越的学习性能. 但对于如何在ELM的模 型选择过程中合理地度量和控制其模型复杂性这一基本问题, 目前尚欠缺系统的研究. 本文讨论了基于 Vapnik-Chervonenkis(VC)泛化界的ELM模型复杂性控制方法(记作VM), 并与其他4种经典模型选择方法进行了系 统的比较研究. 在人工和实际数据集上的实验表明, 与其他4种经典方法相比, VM具有更优的模型选择性能: 能选 出同时具有最低模型复杂性和最低(或近似最低)实际预测风险的ELM模型. 此外, 本文也为VC维理论的实际应用 价值研究提供了一个新的例证. |
| 英文摘要 |
| Model complexity is the critical element in determining the generalization ability of a learning machine. Hence, any learning machine needs to have proper provisions for complexity control. Extreme learning machine (ELM) has recently become increasingly popular due to its high learning speed and good generalization performance. However, there is a lack of systematic study on how to accurately measure and control its complexity for the purpose of good generalization. In this paper, the Vapnik-Chervonenkis (VC) bound-based model selection method (VM) is discussed, and then is compared with other 4 classic statistical model selection criteria. Simulations on the artificial and real-world datasets show that VM can achieve the best model selection performance among all 5 model selection methods; it provides the optimal ELM model with both the lowest model complexity and the smallest or nearly smallest real prediction risk. In addition, this paper also provides a strong evidence for the practical applicability of VC generalization bound in terms of model selection. |