28 lines
745 B
Plaintext
28 lines
745 B
Plaintext
|
<frame title="Autoencoder">
|
||
|
|
<list>
|
||
|
|
<e>Lets look at some of its Hyperparameters</e>
|
||
|
|
<e>Autoencoder Specific</e>
|
||
|
|
<l2st>
|
||
|
|
<e>Compression factor (Latent space size)</e>
|
||
|
|
<e>Loss function (mse?)</e>
|
||
|
|
</l2st>
|
||
|
|
<e>Neural Network architecture</e>
|
||
|
|
<l2st>
|
||
|
|
<e>Number of layers</e>
|
||
|
|
<e>Number of neurons in each layer (Shape of the matrices $A_n$)</e>
|
||
|
|
</l2st>
|
||
|
|
<e>Optimisation parameters</e>
|
||
|
|
<l2st>
|
||
|
|
<e>Learning Rate</e>
|
||
|
|
<l3st>
|
||
|
|
<e>Controls how fast the parameters are found</e>
|
||
|
|
<e>To high value makes the training unstable</e>
|
||
|
|
</l3st>
|
||
|
|
<e>Batch size</e>
|
||
|
|
<l3st>
|
||
|
|
<e>Controls how many samples are averaged together.</e>
|
||
|
|
<e>Lower values make the training more stable, but also the result less optimal</e>
|
||
|
|
</l3st>
|
||
|
|
</l2st>
|
||
|
|
</list>
|
||
|
|
</frame>
|