Quora Question: Which Subfields Of The Sciences Have Been Most Fruitful In Inspiring New Machine Learning Algorithms/Paradigms?

  • Perceptrons and Neural Networks were inspired by Models of Neuron of the brain. So Neuroscience is obviously a major inspiration.
  • Genetic Algorithms, Genetic Programming, Evolutionary Algorithms are inspired by Genetics and Evolutionary Theory.
  • Simulated annealing Algorithm was invented for solving problems in Statistical Physics and later used in Optimization problems in Artificial Intelligence and Machine Learning.
  • Reinforcement Learning was first studied in Psychology, more specifically in Behavioral Psychology. Now Reinforcement Learning is a branch of Machine Learning. 
  • Statistics is the field most closely tied with Machine Learning apart from Computer Science. Many Regression and Clustering techniques from Statistics act as inspiration to Machine Learning Algorithms. 
  • Bayesian Models, (Hidden) Markov Models were first studied as part of Probability Theory. 
  • The study of Logic acts as the basis for many Knowledge Based Machine Learning Paradigms:
    • Explanation Based Learning
    • Relevance Based Learning
    • Inductive Logic Programming

Quora Link:

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s