Tag：neural network

Time：2021119
Abstract:Deep neural network is based on calculus and some statistics. Deep neural network (DNN) is essentially composed of multiple connected perceptrons, one of which is a single neuron. We can regard artificial neural network (ANN) as an input system with a group of inputs fed along a weighted path. These inputs are then processed and […]

Time：2021115
catalog 1、 Neuron model 1 MP neurons 1.2 excitation function 1.2.1 unit step function 1.2.2 logistic function (sigmoid) 1.2.3 tanh function (hyperbolic tangent function) 1.2.4 relu (modified linear unit) 1.2.5 comparison of excitation functions 1.3 Rosenblatt perceptron 1.4 Adaline (adaptive linear neuron) 2、 Neural network model 2.1 linear nonseparable problem 2.2 multilayer feedforward neural network […]

Time：202112
Introduction:How long has it been since you read an academic paper? Most of the highlevel papers are in English. The author translated a deep reinforcement learning paper of Google’s deepmind in 2013, which is regarded asReinforcement learning + deep learningIts achievements were published in top academic journals in 2015NatureIt’s on. The content of this article […]

Time：202112
By ReNu KhandelwalCompile VKSource: medium What is neural network activation function? Activation functions help determine whether we need to activate neurons. If we need to fire a neuron, what is the strength of the signal. The activation function is the mechanism by which neurons process and transmit information through neural networks Why an activation function […]

Time：20201225
Using tens of thousands of Tang poems as materials, the doublelayer LSTM neural network is trained to write poems in the way of Tang poems. The code structure is divided into four parts One model.py The double layer LSTM model is defined Two data.py It defines the processing method of Tang poetry data from the […]

Time：20201221
Recently, I saw a very good quality translation of “neural network course that Xiaobai can understand: from principle to optimization is so simple”, like a treasure. After close reading, I found that some translations were not in place. Then I turned to the original text and read it again. I felt that the original text […]

Time：20201214
How to use neural network to make a program to recognize handwritten digits This program platform is colab (Google’s deep learning online platform). In order to prevent beginners from being eroded by the complicated tensflow environment configuration, we may as well use the online deep learning platform for learning and training You can click here, […]

Time：20201211
Whenever we train our own neural network, we need to pay attention to what is called neural networkgeneralizationThe problem. In essence, this means how good our model is in learning from given data and applying the information to other areas. When training the neural network, there will be some data on the neural networkTraining,Some data […]

Time：2020127
1 Introduction In previous blogs, I spent a lot of energy on the research of convolutional neural network, and witnessed the gradual development of convolutional neural network from the original lenet to RESNET. In the field of deep learning, convolution network occupies half of the country. For example, in image classification, target detection […]

Time：2020126
1 multilayer perceptron Definition: multilayer perceptron is to introduce one or more hidden layers into single layer neural network, namely input layer, hidden layer and output layer 2. Activation function of multilayer perceptron If there is no activation function, the multilayer perception opportunity degenerates into a single layer The formula of multilayer perceptron: hidden layer […]

Time：2020126
Introduction: Senior f is one of the most important enlightening persons on the road of mathematical model competition and scientific research methods.He successfully entered Tsinghua University last year. Coincidentally, his research direction is also intensive learning.During the long rounds of discussion, he called me and said that he was deeply impressed“Reinforcement learning, to put it […]

Time：2020126
It is very simple and clear to build neural network by python. Here we introduce two commonly used building modes import torch import torch.nn as nn first： class NN(nn.Module): def __init__(self): super(NN,self).__init__() self.model=nn.Sequential( nn.Linear(30,40), nn.ReLU(), nn.Linear(40,60), nn.Tanh(), nn.Linear(60,10), nn.Softmax() ) self.model[0].weight.data.uniform_(3e3, 3e3) self.model[0].bias.data.uniform(1,1) def forward(self,states): return self.model(states) In this method, the whole network is written […]