Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

VAE should have one layer less #60

Open
alexrakowski opened this issue Jun 2, 2021 · 0 comments
Open

VAE should have one layer less #60

alexrakowski opened this issue Jun 2, 2021 · 0 comments

Comments

@alexrakowski
Copy link

The Dense layers Dec_VAE_VDraw_Mean and Dec_VAE_VDraw_Var should just be Identity layers taking the first and last 128 outputs of Dec_VAE_VD_Dense, as per section 3.3 of the paper:

"Starting from the encoder endpoint output, we first reduce the input to a low
dimensional space of 256 (128 to represent mean, and 128 to represent std).
Then, a sample is drawn from the Gaussian distribution with the given mean
and std (...)"
.

Right now there is an additional linear 256x128 mapping between the low-dim. space and both mu and sigma.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant