TAG

#neural-networks

7 events tagged with this keyword

1943Paper

McCulloch-Pitts Neuron Model

Warren McCulloch and Walter Pitts propose the first mathematical neuron model, laying the theoretical foundation for neural networks.

#neural-networks#foundation#neuron

1958Milestone

Perceptron: First Neural Computer

Frank Rosenblatt invents the Perceptron Mark I, the first hardware implementation based on neural network principles.

#neural-networks#perceptron#hardware

1969Book

Perceptrons and the AI Winter

Minsky and Papert publish "Perceptrons", highlighting the limitations of single-layer neural networks, leading to the first decline in neural network research.

#neural-networks#ai-winter#history

1986Paper

Backpropagation Algorithm Revival

Rumelbart, Hinton, and Williams popularize the backpropagation algorithm, reviving neural network research.

#neural-networks#backpropagation#hinton

1997Paper

LSTM Neural Network

Hochreiter and Schmidhuber propose LSTM, solving the long-term dependency problem of recurrent neural networks.

#neural-networks#lstm#sequence-modeling

2006Paper

Deep Belief Network: Deep Learning Revival

Geoffrey Hinton proposes Deep Belief Networks, pioneering effective methods for training deep learning.

#deep-learning#hinton#neural-networks

2014Paper

Dropout Regularization

Geoffrey Hinton and colleagues propose Dropout technique, effectively preventing neural network overfitting.

#deep-learning#regularization#hinton