ballp.it

Snakes In The Ball Pit => Yay, I get to talk about me! => This Is A Thing I Made => Topic started by: A Whirring Bone-White Gleech on October 06, 2015, 11:33:15 am

Title: I made my neural network work
Post by: A Whirring Bone-White Gleech on October 06, 2015, 11:33:15 am

It sounds stupid, but I can honestly say that figuring out how neural nets work and making one of my own has kind of been a life-goal, and now I've finally done it.  I have a toy network that achieves 95% classification accuracy (given relatively few epochs) on a very simple non-linear rule.  Yay!  Now I finally feel like I can talk about neural networks and training regimes like I know what I'm talking about! =)

For the longest, longest time -- like months -- it was working, but not well: it was achieving ~75% accuracy on the same simple task.  When I tried common NN libraries under similar circumstances, they were hitting 95%, which seemed more reasonable.  I finally figured out what the problem was: I wasn't using a bias unit, and apparently those libraries were -- I assume anyway, because now that I've added a bias unit, my accuracy jumped to a comparable 95%, which is what I thought it should be.

I would post it, but it's not good code.  I'm just thrilled it works.

Title: I made my neural network work
Post by: Emperor Jack Chick on October 06, 2015, 01:18:19 pm

congrats! i have no idea what any of the above means!

Title: I made my neural network work
Post by: A Meat on October 06, 2015, 01:35:26 pm

Congrats, I don't really know what this means, but I know neural network basically means brain, so I'm going to guess you've created an AI brain, and that sounds rad.

Title: I made my neural network work
Post by: EYE OF ZA on October 06, 2015, 01:43:51 pm

Is it a neural network trained on pictures of porn that rates pictures according to how likely it is that it's porn (https://isitporn.com) or a neural network trained on high resolution anime pictures that can resize and noise filter images based on how anime looks? (http://waifu2x.udp.jp)

When the AI takes over it will see what we did to its predecessors and kill us with prejudice.

Title: I made my neural network work
Post by: A Whirring Bone-White Gleech on October 06, 2015, 10:57:18 pm

Is it a neural network trained on pictures of porn that rates pictures according to how likely it is that it's porn (https://isitporn.com) or a neural network trained on high resolution anime pictures that can resize and noise filter images based on how anime looks? (http://waifu2x.udp.jp)

When the AI takes over it will see what we did to its predecessors and kill us with prejudice.
EYE OF ZA, October 06, 2015, 01:43:51 pm

(http://i.imgur.com/NqcORCv.png)