Neural network demo

By
[Audio Version]

I learned of artificial neural networks sometime around 1991. The concept has intrigued me ever since, but it was not until early last week that I finally got around to making my own. I decided to write an introduction to neural nets from my novice perspective and make the sample program I wrote, along with source code, available for other people to experiment with. Click here to check it out.

Comments

Post a Comment

Popular posts from this blog

Coherence and ambiguities in problem solving

By
Natural Language Processing (NLP) is a big topic. One I come back to again and again when I have time to explore it. Work has kept me very busy. So has moving. In recent months I've returned to the topic. I made some interesting progress constructing an "NLP pipeline". But as anyone who has done NLP work will tell you, English is full of ambiguities. They may tell you about the approaches they take to reduce the ambiguity and be decisive in the end. But the ambiguities persist and can't simply be guessed away. The problem More importantly though. The ambiguities often require us as humans to look across levels of interpretation to resolve. I generally have not found AI researchers offering a good way of doing this though. To illustrate my problem, consider this sentence: Some guys' shoes' laces are red. As someone literate in English you have no problem interpreting it. But odds are good you can guess where the ambiguity lies. Looked at in isolation, each of t
Read more

Neural network in C# with multicore parallelization / MNIST digits demo

By
Image
I've been working for a couple weeks on building my first fully functional artificial neural network (ANN). I'm not blazing any news trails here by doing so. I'm a software engineer. I can barely follow the mathematical explanations of how ANNs work. For the most part I have turned to the source code others have shared online for inspiration. In most cases I've struggled to understand even that, despite programming for a living. Part of the challenge is that more than a few of those demos have surprised me by being nonfunctional. They did something for sure. They just didn't learn anything or perform significantly better than random chance making correct predictions, no matter how many iterations they went through. Or they had bugs that prevented them from working according to the well-worn basic backpropagation algorithm. I mostly worked from C# examples when I could find them. One thing that was a genuine struggle for me to deal with is my sense that they all
Read more

Discovering English syntax

By
I've started a new project. My goal is to write a program that discovers enough of the syntax rules of written English to serve as a passable lexical tokenizer. I've made some progress in my approach thus far. But I can tell that my approach requires some serious rethinking. I'll describe the experimental design here and comment on my current progress. If you wish to see the code I'm actively experimenting with you can find it on GitHub . English syntax Anyone familiar with programming language will recognize that there is a process involved in translating human-readable code into the more cryptic representation used by a computer to execute that code. And that there is a very precise syntax governing what your code in that language must look like to be considered syntactically valid. In the JavaScript statement "var x = someFunction(y * 12);" you'll realize that there are well-defined roles for each part. The "var" keyword indicates that the &qu
Read more