Which of the following are examples of hyperparameters? (Select 2 answers.)

Which of the following are examples of hyperparameters? (Select 2 answers.)
A . Number of hidden layers
B . Number of nodes in each hidden layer
C . Biases
D . Weights

Answer: AB

Explanation:

If model parameters are variables that get adjusted by training with existing data, your hyperparameters are the variables about the training process itself. For example, part of setting up a deep neural network is deciding how many "hidden" layers of nodes to use between the input layer and the output layer, as well as how many nodes each layer should use. These variables are not directly related to the training data at all. They are configuration variables. Another difference is that parameters change during a training job, while the hyperparameters are usually constant during a job.

Weights and biases are variables that get adjusted during the training process, so they are not hyperparameters.

Reference: https://cloud.google.com/ml-engine/docs/hyperparameter-tuning-overview

Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments