Tag：neural network
-
Time：2021-1-19
Abstract:Deep neural network is based on calculus and some statistics. Deep neural network (DNN) is essentially composed of multiple connected perceptrons, one of which is a single neuron. We can regard artificial neural network (ANN) as an input system with a group of inputs fed along a weighted path. These inputs are then processed and […]
-
Time：2021-1-15
catalog 1、 Neuron model 1 M-P neurons 1.2 excitation function 1.2.1 unit step function 1.2.2 logistic function (sigmoid) 1.2.3 tanh function (hyperbolic tangent function) 1.2.4 relu (modified linear unit) 1.2.5 comparison of excitation functions 1.3 Rosenblatt perceptron 1.4 Adaline (adaptive linear neuron) 2、 Neural network model 2.1 linear nonseparable problem 2.2 multilayer feedforward neural network […]
-
Time：2021-1-2
Introduction:How long has it been since you read an academic paper? Most of the high-level papers are in English. The author translated a deep reinforcement learning paper of Google’s deepmind in 2013, which is regarded asReinforcement learning + deep learningIts achievements were published in top academic journals in 2015NatureIt’s on. The content of this article […]
-
Time：2021-1-2
By ReNu KhandelwalCompile VKSource: medium What is neural network activation function? Activation functions help determine whether we need to activate neurons. If we need to fire a neuron, what is the strength of the signal. The activation function is the mechanism by which neurons process and transmit information through neural networks Why an activation function […]
-
Time：2020-12-25
Using tens of thousands of Tang poems as materials, the double-layer LSTM neural network is trained to write poems in the way of Tang poems. The code structure is divided into four parts One model.py The double layer LSTM model is defined Two data.py It defines the processing method of Tang poetry data from the […]
-
Time：2020-12-21
Recently, I saw a very good quality translation of “neural network course that Xiaobai can understand: from principle to optimization is so simple”, like a treasure. After close reading, I found that some translations were not in place. Then I turned to the original text and read it again. I felt that the original text […]
-
Time：2020-12-14
How to use neural network to make a program to recognize handwritten digits This program platform is colab (Google’s deep learning online platform). In order to prevent beginners from being eroded by the complicated tensflow environment configuration, we may as well use the online deep learning platform for learning and training You can click here, […]
-
Time：2020-12-11
Whenever we train our own neural network, we need to pay attention to what is called neural networkgeneralizationThe problem. In essence, this means how good our model is in learning from given data and applying the information to other areas. When training the neural network, there will be some data on the neural networkTraining,Some data […]
-
Time：2020-12-7
1 Introduction In previous blogs, I spent a lot of energy on the research of convolutional neural network, and witnessed the gradual development of convolutional neural network from the original lenet to RESNET. In the field of deep learning, convolution network occupies half of the country. For example, in image classification, target detection […]
-
Time：2020-12-6
1 multilayer perceptron Definition: multilayer perceptron is to introduce one or more hidden layers into single layer neural network, namely input layer, hidden layer and output layer 2. Activation function of multilayer perceptron If there is no activation function, the multi-layer perception opportunity degenerates into a single layer The formula of multilayer perceptron: hidden layer […]
-
Time：2020-12-6
Introduction: Senior f is one of the most important enlightening persons on the road of mathematical model competition and scientific research methods.He successfully entered Tsinghua University last year. Coincidentally, his research direction is also intensive learning.During the long rounds of discussion, he called me and said that he was deeply impressed“Reinforcement learning, to put it […]
-
Time：2020-12-6
It is very simple and clear to build neural network by python. Here we introduce two commonly used building modes import torch import torch.nn as nn first： class NN(nn.Module): def __init__(self): super(NN,self).__init__() self.model=nn.Sequential( nn.Linear(30,40), nn.ReLU(), nn.Linear(40,60), nn.Tanh(), nn.Linear(60,10), nn.Softmax() ) self.model[0].weight.data.uniform_(-3e-3, 3e-3) self.model[0].bias.data.uniform(-1,1) def forward(self,states): return self.model(states) In this method, the whole network is written […]
