Backpropagation for Neural Network - Python
I am writing a program to do neural network in python I am trying to set up the backpropagation algorithm. The basic idea is that I look through 5,000 training examples and collect the errors and find...
View ArticleANN bypassing hidden layer for an input
I have just been set an assignment to calculate some ANN outputs and write an ANN. Simple stuff, done it before, so I don't need any help with general ANN stuff. However, there is something that is...
View ArticleClik here to view.
How to decide activation function in neural network
I am using feedforward, backpropagation, multilayer neural network and I am using sigmoid function as a activation function which is having range of -1 to 1. But the minimum error is not going below...
View ArticleNeural network with 1 hidden layer cannot learn checkerboard function?
I'm just starting to learn neural networks, to see if they could be useful for me. I downloaded this simple python code of 3 layer feed forward neural network and I just modified the learning pattern...
View ArticleClik here to view.
Back-propagation algorithm converging too quickly to poor results
I'm trying to implement the back propagation algorithm for a multi layer feedforward neural network, but I'm having issues getting it to converge to good results. The reason being, the gradient...
View ArticleWhat is the syntax of the activate() function in pybrain package?
I have a code which builds a [2,3,1] neural network with some values with full connection. from pybrain.structure import FeedForwardNetwork, LinearLayer, SigmoidLayer, FullConnection from...
View ArticleTraining a FeedForward Neural Network
I have implemented a Back propagation Neural Network, now I would like to implement a Feed Forward Neural Network to compare their accuracy. My question is, what learning methods does Feed Forward has...
View ArticleFeedForward Neural Network: Using a single Network with multiple output...
I am currently working on the MNIST handwritten digits classification. I built a single FeedForward network with the following structure: Inputs: 28x28 = 784 inputs Hidden Layers: A single hidden...
View ArticleNeural Network implementation in java
I am attempting to implement a FFNN in Java with backpropagation and have no idea what I am doing wrong. It worked when I had only a single neuron in the network, but I wrote another class to handle...
View ArticleClik here to view.
Backpropagation error : conceptual or programing?
I wrote the following backpropagation algorithm to model the two input identity function clc % clear nh = 3; % neurons in hidden layer ni = 2; % neurons in input layer eta = .001; % the learning rate...
View ArticleMNIST - Training stuck
I'm reading Neural Networks and Deep Learning (first two chapters), and I'm trying to follow along and build my own ANN to classify digits from the MNIST data set. I've been scratching my head for...
View ArticleAdding momentum term in online back propagation weight update?
I have implemented the ANN for two-layer network, I need to modify my weight update code with momentum, but i need to know how can i update it. below is the code snap of only weight update. The below...
View ArticleBackpropagation neural network, too many neurons in layer causing output to...
Having neural network with alot of inputs causes my network problems like Neural network gets stuck and feed forward calculation always gives output as 1.0 because of the output sum being too big and...
View ArticleMy neural net learns sin x but not cos x
I have build my own neural net and I have a weird problem with it. The net is quite a simple feed-forward 1-N-1 net with back propagation learning. Sigmoid is used as activation function. My training...
View ArticleGetting NaN values in neural network weight matrices
**I am trying to develop a feedforward NN in MATLAB. I have a dataset of 12 inputs and 1 output with 46998 samples. I have some NaN values in last rows of Matrix, because some inputs are accelerations...
View ArticleWeights in feed-forward backpropogation ANN not changing
I am designing a Feed-Forward BackPropogation ANN with 22 inputs and 1 output (either a 1 or 0). The NN has 3 layers and is using 10 hidden neurons. When I run the NN it only changes the weights a...
View ArticleSetting up Back propagation net with 150k training samples
I am trying to build a backpropagation neural net to classify 150k thousand accounts of loans. Each account has data on age, average income, and date they were issued the loan. I also have to target...
View ArticleNeural Net converges to minima, but only works when all the training data is...
I am new to Neural Networks and I wrote the following code of Feed forward neural network as to perform 3 bit Binary Counter. What I found with the output of my code was when I tried predicting after...
View ArticleNeural Network Feed Forward Back Propagation based learning not working for...
My Neural network is able to learn if the sample is OR or XOR table. However, if i want it to learn AND table, it refuses. NN Config: 1 input layer with 2 input neurons 1 hidden layer with 3 neurons 1...
View ArticleWhy is spark library using outputs(i+1) in MultilayerPerceptron for previous...
Looking at this code for (i <- (L - 2) to (0, -1)) { layerModels(i + 1).computePrevDelta(deltas(i + 1), outputs(i + 1), deltas(i)) } I want to understand why are we passing outputs(i+1) instead of...
View Article