Mr Ko

AI is my favorite domain as a professional Researcher. What I am doing is Reinforcement Learning,Autonomous Driving,Deep Learning,Time series Analysis, SLAM and robotics. Also Economic Analysis including AI,AI business decision

Tensorflow Initializer

less than 1 minute read

Tensorflow Initializer

Tensor He, Xavier Init

The three arguments used in this function are:

  • The factor argument, which is a multiplicative factor that is applied to the scaling. This is 1.0 for Xavier weight initialization, and 2.0 for He weight initialization
  • The mode argument: this defines which is on the denominator of the variance calculation. If ‘FAN_IN’, the variance scaling is based solely on the number of inputs to the node. If ‘FAN_OUT’ it is based solely on the number of outputs. If it is ‘FAN_AVG’, it is based on an averaging calculation, i.e. Xavier initialization. For He initialization, use ‘FAN_IN’
  • The uniform argument: this defines whether to use a uniform distribution or a normal distribution to sample the weights from during initialization. For both Xavier and He weight initialization, you can use a normal distribution, so set this argument to False

You May Also Enjoy

Keras Image Generator

1 minute read

```python from keras.datasets import mnist from keras.utils import to_categorical from keras.models import Sequential from keras.layers import Conv2D from ke...

Nvidia Self Driving Car Model

4 minute read

```python import socketio import eventlet import numpy as np from flask import Flask from keras.models import load_model import base64 from io import BytesIO...