Skip to content

Simple evaluation script #41

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

Simple evaluation script #41

wants to merge 4 commits into from

Conversation

pcuenca
Copy link

@pcuenca pcuenca commented Nov 2, 2022

We wrote this for fastai but might be useful here too :)

Note: it requires fastcore.

We could extend it, if desired, to download models from Hugging Face Hub or W&B artifacts.

I tested it on
https://huggingface.co/jph00/noscale-noise-mse-fashion-sd/blob/main/mse_00050000.pth
with the following configuration:

- has_variance: false
- augment_wrapper: true
- layers.py: ones,-ones,ones

Which results in:
FID: 19.2372, KID: 0.00223875
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant