当前位置:网站首页>How long does it take to train a neural network, neural network training takes too long
How long does it take to train a neural network, neural network training takes too long
2022-08-11 10:56:00 【Yangyang 2013 haha】
Why batch training neural networks
Does it require multiple trainings when reusing a neural network
Why does the accuracy of the rolling machine neural network decrease a lot after increasing the number of training sessions
How to understand "training" in multiple weight training in neural network
Neural network, 500 training samples, why is it better than 6000 training samples? After training, 500 predictions are better than 6000 samples!
It is not that the more training samples the better, it varies from subject to subject.1. The most important thing about the sample is the correctness and accuracy.The sample you choose must first correctly reflect the internal laws of the system process.
Many of the sample data we have taken from the production site may be bad samples, and such samples will interfere with your neural network training.Usually we think that bad samples are just individual phenomena, so we want to resist the negative effects caused by bad samples by making the sample size as large as possible.
2, followed by the balance of the sample data distribution.The samples you choose should preferably involve various situations that may occur in the system process, so that the regular characteristics of the system in various situations can be taken into account.
Usually we don't know much about the internal laws of the system, so we want to "carpet" all aspects of the object system with the largest possible sample size.3. Again, the size of the sample data, which is the question you have to ask.
In the case of ensuring the quality and distribution of the sample data, the size of the sample data determines the accuracy of your neural network training results.The larger the sample data volume, the higher the precision.
Because the sample size directly affects the computing time of the computer, if the accuracy meets the requirements, we do not need too much sample data, otherwise we will have to wait a long time for training.
Additionally, whether it is a radial basis (rbf) neural network or a classic bp neural network, it is only a specific training method. For enough iterations, the accuracy of the training results tends to be consistent. The methodIt only affects the convergence speed (operation time) of the calculation, and is not directly related to the sample size.
How to determine when the training set size is "large enough"?
The generalization ability of a neural network mainly depends on 3 factors: 1. The size of the training set 2. The architecture of the network 3. The complexity of the problem Once the architecture of the network is determined, the generalization ability depends on whether there is sufficientTraining set.
The appropriate number of training samples can be estimated using Widrow's rule of thumb.
The rule of thumb states that in order to obtain a good generalization ability, we need to meet the following conditions (Widrow and Stearns, 1985; Haykin, 2008): N=nw/e where N is the number of training samples, and nw is the number of training samples in the network.is the number of touch weights, and e is the network error allowed by the test.
So if we allow 10% error, we need about 10 times as many training samples as there are weights in the network.
Why support vector machines are better than neural networks?Can't neural networks be trained many times?
边栏推荐
- Convolutional Neural Network Gradient Vanishing, The Concept of Gradient in Neural Networks
- fetch请求设置请求头错误导致无法跨域
- 【每日一题】640. 求解方程
- 【中央任务调度系统—通信开发】
- 我用这个操作,代码可读性提升一个档次
- How to build programming ideas and improve programming ideas
- chrome设置为深色模式(包括整个网页)
- 【Ackerman Motion Control】
- LeetCode · Question of the Day · 1417. Reformatting String · Simulation
- 7 天找个 Go 工作,Gopher 要学的条件语句,循环语句 ,第3篇
猜你喜欢
随机推荐
为什么有些人不喜欢出身底层的人?
C# 调用高德地图API获取经纬度以及定位【万字详解附完整代码】
Ali Ermian: Do you know how to tune the JVM?
VC6.0 +WDK 开发驱动的环境配置
【Prometheus】Alertmanager告警全方位讲解
1.TCP/IP基础知识
【Ackerman Motion Control】
chrome设置为深色模式(包括整个网页)
爬虫封装成api
7 天找个 Go 工作,Gopher 要学的条件语句,循环语句 ,第3篇
Dreamweaver网页作业——紫罗兰永恒花园动漫价绍网页 7页,含有table表格,js表单验证还有首页视频。以及列表页。浮
解决 Pocess finished with exit code 1 Class not found 和 Command line is too long. Shorten the command
计算数组某个元素的和
和为s的连续正数序列
AcWing 273. 分级(线性DP+结论)
数据库的索引和其底层数据结构
PerfView project (first) : how to find hot spots function
宝塔一键部署WordPress(含宝塔添加站点、阿里云安全组配置、阿里云子域名解析)
a-upload上传图片
[Study Notes] Dual Theorem of Linear Programming