Clik here to view.
How to decide activation function in neural network
I am using feedforward, backpropagation, multilayer neural network and I am using sigmoid function as a activation function which is having range of -1 to 1. But the minimum error is not going below...
View ArticleNeural network with 1 hidden layer cannot learn checkerboard function?
I'm just starting to learn neural networks, to see if they could be useful for me. I downloaded this simple python code of 3 layer feed forward neural network and I just modified the learning pattern...
View ArticleClik here to view.
Back-propagation algorithm converging too quickly to poor results
I'm trying to implement the back propagation algorithm for a multi layer feedforward neural network, but I'm having issues getting it to converge to good results. The reason being, the gradient...
View ArticleWhat is the syntax of the activate() function in pybrain package?
I have a code which builds a [2,3,1] neural network with some values with full connection. from pybrain.structure import FeedForwardNetwork, LinearLayer, SigmoidLayer, FullConnection from...
View ArticleTraining a FeedForward Neural Network
I have implemented a Back propagation Neural Network, now I would like to implement a Feed Forward Neural Network to compare their accuracy. My question is, what learning methods does Feed Forward has...
View ArticleFeedForward Neural Network: Using a single Network with multiple output...
I am currently working on the MNIST handwritten digits classification. I built a single FeedForward network with the following structure: Inputs: 28x28 = 784 inputs Hidden Layers: A single hidden...
View ArticleNeural Network implementation in java
I am attempting to implement a FFNN in Java with backpropagation and have no idea what I am doing wrong. It worked when I had only a single neuron in the network, but I wrote another class to handle...
View ArticleClik here to view.
Backpropagation error : conceptual or programing?
I wrote the following backpropagation algorithm to model the two input identity function clc % clear nh = 3; % neurons in hidden layer ni = 2; % neurons in input layer eta = .001; % the learning rate...
View ArticleMNIST - Training stuck
I'm reading Neural Networks and Deep Learning (first two chapters), and I'm trying to follow along and build my own ANN to classify digits from the MNIST data set. I've been scratching my head for...
View ArticleAdding momentum term in online back propagation weight update?
I have implemented the ANN for two-layer network, I need to modify my weight update code with momentum, but i need to know how can i update it. below is the code snap of only weight update. The below...
View ArticleBackpropagation neural network, too many neurons in layer causing output to...
Having neural network with alot of inputs causes my network problems like Neural network gets stuck and feed forward calculation always gives output as 1.0 because of the output sum being too big and...
View ArticleMy neural net learns sin x but not cos x
I have build my own neural net and I have a weird problem with it. The net is quite a simple feed-forward 1-N-1 net with back propagation learning. Sigmoid is used as activation function. My training...
View ArticleGetting NaN values in neural network weight matrices
**I am trying to develop a feedforward NN in MATLAB. I have a dataset of 12 inputs and 1 output with 46998 samples. I have some NaN values in last rows of Matrix, because some inputs are accelerations...
View ArticleWeights in feed-forward backpropogation ANN not changing
I am designing a Feed-Forward BackPropogation ANN with 22 inputs and 1 output (either a 1 or 0). The NN has 3 layers and is using 10 hidden neurons. When I run the NN it only changes the weights a...
View ArticleSetting up Back propagation net with 150k training samples
I am trying to build a backpropagation neural net to classify 150k thousand accounts of loans. Each account has data on age, average income, and date they were issued the loan. I also have to target...
View ArticleNeural Net converges to minima, but only works when all the training data is...
I am new to Neural Networks and I wrote the following code of Feed forward neural network as to perform 3 bit Binary Counter. What I found with the output of my code was when I tried predicting after...
View ArticleNeural Network Feed Forward Back Propagation based learning not working for...
My Neural network is able to learn if the sample is OR or XOR table. However, if i want it to learn AND table, it refuses. NN Config: 1 input layer with 2 input neurons 1 hidden layer with 3 neurons 1...
View ArticleWhy is spark library using outputs(i+1) in MultilayerPerceptron for previous...
Looking at this code for (i <- (L - 2) to (0, -1)) { layerModels(i + 1).computePrevDelta(deltas(i + 1), outputs(i + 1), deltas(i)) } I want to understand why are we passing outputs(i+1) instead of...
View ArticleImplementing a Neural Network in Java: Training and Backpropagation issues
I'm trying to implement a feed-forward neural network in Java. I've created three classes NNeuron, NLayer and NNetwork. The "simple" calculations seem fine (I get correct sums/activations/outputs),...
View ArticleI Failed To Train Neural Network On JS
I am newbie in machine learning, but decided to make own js library for neural networks, everything went perfect until i tryed to train my NN. In My Mini Library i created some functions... 1) A...
View ArticleMy Neural Network Doesn't Work [XOR problem]
I'm trying to make a neural network for solving XOR problem.But I couldn't make it.Always giving false results.Maybe I'm making a mistake in your math.The network does not learn.Result always...
View ArticleTraining feedforward neural network for OCR [closed]
Currently I'm learning about neural networks and I'm trying to create an application that can be trained to recognize handwritten characters. For this problem I use a feed-forward neural network and...
View ArticleUsing the code to input data for backpropagation
I am learning to build neural nets and I came across this code on github, https://github.com/PavelJunek/back-propagation-java There is a training set and a validation set required to be used but I...
View ArticleWhy doesn't my Feed-Forward NN work with varying inputs?
I decided to create a feedforward Neural Network without using any libraries. I am fairly new to the subject and completely self-trained. My Neural Network uses backpropagation to set the weights and...
View ArticleWhy is my neural network stagnating around a certain cost?
I am making a neural network that's supposed to be capable of identifying handwritten numbers using the Mnist database downloadable here. The network works perfectly with one to 5 examples but after...
View ArticleClik here to view.
Doubtful predictions of Neural Network implemented in C++
I have created a Neural Network in C++ for approximating addition function y = x + y. I used a single hidden layer with 5 neurons. The values of x and y lie in the range 0 and 10. So before training, I...
View Articlewhy am I getting NaN in my neural network sometimes?
I recently wrote a neural network using a series of videos in youtube, the channel was coding train. It was written in js I wrote mine in java. It is working correct sometimes but other times I'm...
View ArticleHow do I encourage risk-taking in a feedfoward neural network?
I am doing my first real dive into Neural Networks, and I am trying to construct the classic "number-identification network" without any outside databases. After some initial testing, I have been...
View ArticleANN bypassing hidden layer for an input
I have just been set an assignment to calculate some ANN outputs and write an ANN. Simple stuff, done it before, so I don't need any help with general ANN stuff. However, there is something that is...
View ArticleNeural Networks: exact high level training algorithm
I am trying to make my very first Neural Network work. I designed it so that I can choose the number of layers and the number of nodes per layer freely. I had a hard time trying to implement back...
View Article