Skip to content

MAINT, DOC: Modify Hyperband docs for first-time users #671

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Draft
wants to merge 8 commits into
base: main
Choose a base branch
from

Conversation

stsievert
Copy link
Member

@stsievert stsievert commented May 23, 2020

What does this PR implement?
@ToddMorrill has a good example of Hyperband in dask/dask-examples#149. He's a first time user and has hit some road bumps.

This PR does the following:

  • More clearly showed errors while scoring models (as in BUG: clearly show error message while initing models #670).
  • Better names variables in HyperbandSearchCV.metadata (I'm open to suggestions!)
  • Adds some notes to Hyperband's documentation.
  • Warns the user about unbalanced chunks.
  • Adds a comparison with RandomizedSearchCV to HyperbandSearchCV.metadata.

Reference issues/PRs

TODO:

  • change n_models to n_params, and add note in documentation about it being approximate
  • (blog posts) change rule of thumb to evenly chunk dask array.

@stsievert stsievert marked this pull request as draft May 24, 2020 03:38
@stsievert stsievert changed the title MAINT: show errors while scoring models in model selection MAINT, DOC: Modify Hyperband docs for first-time users May 24, 2020
@stsievert
Copy link
Member Author

  • make clear that each partial_fit call sees one chunk of the data

Base automatically changed from master to main February 2, 2021 03:43
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant