| 引用本文: | 李凡军,乔俊飞,韩红桂.网络结构增长的极端学习机算法[J].控制理论与应用,2014,31(5):638~643.[点击复制] |
| LI Fan-jun,QIAO Jun-fei,HAN Hong-gui.Incremental constructive extreme learning machine[J].Control Theory and Technology,2014,31(5):638~643.[点击复制] |
|
| 网络结构增长的极端学习机算法 |
| Incremental constructive extreme learning machine |
| 摘要点击 3402 全文点击 2113 投稿时间：2013-09-23 修订日期：2014-01-08 |
| 查看全文 查看/发表评论 下载PDF阅读器 |
| DOI编号 10.7641/CTA.2014.31001 |
| 2014,31(5):638-643 |
| 中文关键词 前向神经网络 极端学习机 导数 结构设计 |
| 英文关键词 feedforward neural networks extreme learning machine derivative architectural design |
| 基金项目 国家自然科学基金资助项目(61034008, 61203099, 61225016); 北京市自然科学基金资助项目(4122006); 教育部博士点新教师基金项 目(20121103120020). |
|
| 中文摘要 |
| 针对极端学习机(extreme learning machine, ELM)结构设计问题, 基于隐含层激活函数及其导函数提出一种 前向神经网络结构增长算法. 首先以Sigmoid函数为例给出了一类基函数的派生特性: 导函数可以由其原函数表示. 其次, 利用这种派生特性提出了ELM结构设计方法, 该方法自动生成双隐含层前向神经网络, 其第1隐含层的结点 随机逐一生成. 第2隐含层的输出由第1隐含层新添结点的激活函数及其导函数确定, 输出层权值由最小二乘法分 析获得. 最后给出了所提算法收敛性及稳定性的理论证明. 对非线性系统辨识及双螺旋分类问题的仿真结果证明 了所提算法的有效性. |
| 英文摘要 |
| Focusing on the problem of architectural design of extreme learning machine (ELM), we propose a novel constructive algorithm by the activation function and its derivatives. Firstly, taking the Sigmoid function as an example, we give in detail the derived characteristics for a class of base functions: derivative functions can be expressed by their primitive functions. By making use of these derived characteristics, we propose a method to design the structure of ELM, which automatically generate feedforward neural networks with double hidden layers. The new units in the first hidden layer are generated randomly one by one; then, the outputs of the second hidden layer (derivation) are calculated by the activation function of the new node in the first layer and its derivatives. The weights of the output layer are calculated analytically by the least squares method. Finally, the analysis of convergence and stability are presented. The effectiveness of the proposed method is demonstrated by simulation results on nonlinear system identification and two-spiral classification problem. |
|
|
|
|
|