Skip to main content

Programs == Rules

 When crafting an algorithm for dealing with some kind of problem, we usually are involved with designing rules that transform the input data into output data. The programming language is a method convenient to humans for rules specification. But generally, the computer itself does not need anything more than low-level binary instructions to transform input data into some desired output.

Although high-level programming languages have proven to be of much aid to the human intellect when it comes to crafting rules that the computer can follow, it also comes with some bottlenecks and as we now realise when it comes to problems whose rules cannot be easily specified we use machine learning to discover models that map the input to output. 

Machine learning methods especially deeplearning have proven to be potent tools when we need to discover a model or a set of rules that map the input to output and will continually augment many algorithm development activities but they also come with their own bottlenecks. They are not very transparent in how the rules determine the output, and their performance is very bad requiring very large compute resources to perform simple operations. 

Machine learning, which is based on statistics might not be the only way to generate rules that map inputs to output, in the future it will be possible to generate rules automatically using some other methods, rules that are much simpler to execute and thus much more efficient than current machine learning systems. 

Comments

Popular posts from this blog

New Information interfaces, the true promise of chatGPT, Bing, Bard, etc.

LLMs like chatGPT are the latest coolest innovation in town. Many people are even speculating with high confidence that these new tools are already Generally intelligent. Well, as with every new hype from self-driving cars based on deeplearning to the current LLMs are AGI, we often tend to miss the importance of these new technologies because we are often engulfed in too much hype which gets investors hyper interested and then lose interest in the whole field of AI when the promises do not pan out. The most important thing about chatGPT and co is that they are showing us a new way to access information. Most of the time we are not interested in going too deep into typical list-based search engine results to get answers and with the abuse of search results using SEO optimizations and the general trend towards too many ads, finding answers online has become a laborious task.  Why people are gobbling up stuff like chatGPT is not really about AGI, but it is about a new and novel way to...

Next Steps Towards Strong Artificial Intelligence

What is Intelligence? Pathways to Synthetic Intelligence If you follow current AI Research then it will be apparent to you that AI research, the deep learning type has stalled! This does not mean that new areas of application for existing techniques are not appearing but that the fundamentals have been solved and things have become pretty standardized.

Human intelligence is more about knowledge utilization

There are two significant phases of intelligence, the first is the knowledge acquisition phase and the second is the knowledge utilisation phase. The knowledge acquisition stage is available by default in many animals but what makes humans unique is that our ability to utilize knowledge is far higher than most mammals.  But even humans individually and as a whole utilize only a very tiny fraction of the available knowledge. For an individual your acquired knowledge base, that is knowledge you have acquired both consciously through study or unconsciously through just existing, is far more than what you are able to utilize.  This is also similar for humanity as a whole, the knowledge we possess both in written form or in other forms far outweighs our ability to utilize it.  The core part of what we could call general intelligence is really more about knowledge utilization and less about acquisition. Because what is useful is only what we can utilize, the rest is just memory...