Definitions
Linear Neural Networks
- Perceptron
- Adaline
- Stochastic Gradient Descent
Classifiers
- Logistic Regression
- Support Vector Machines
- Decision Trees
- K-Neighbors
Stochastic Gradient Descent
- Present the training data in a random order.
- Minimizing a cost function
- Eta: The learning rate is a hyperparameter that controls how much to
change the model in response to the estimated error each time the
model weights are updated... i.e. Controls the rate or speed at which a model learns