Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Reasonable Metrics for Test Latency #2133

Closed
egucciar opened this issue Jul 12, 2018 · 2 comments
Closed

Reasonable Metrics for Test Latency #2133

egucciar opened this issue Jul 12, 2018 · 2 comments

Comments

@egucciar
Copy link
Contributor

Please see if you can add the following to docs

I was looking into what would be a reasonable metric for cypress test latency so we could sanity check ourselves. We have 43 tests that take 12 minutes. I know this is slow, however I do not have a point of reference. What kind of speed should I be aiming for with a tests? What's good? What's average?

Thanks!

@jennifer-shehane
Copy link
Member

Hey @egucciar, have you had an opportunity to use our Dashboard Service? There are metrics in there regarding your test timings and we are working on improving the insight into the timing of tests in there.

Dashboard docs: https://on.cypress.io/dashboard-service#Spec-amp-Test-Durations

Tests for our docs and their timings
screen shot 2018-07-12 at 11 36 19 am

I created a new issue in our docs to document writing some more recommendations here: cypress-io/cypress-documentation#773.

Writing this doc was already on our roadmap and will be even more important when we release parallelization, which is landing soon.

@egucciar
Copy link
Contributor Author

egucciar commented Jul 12, 2018

@jennifer-shehane

EDIT: My apologies if you see my previous comment as I did not see below the screenshot on my mobile device right away. Thanks I will check out the docs issue!! So excited for parallelization thanks so much for an amazing product that we love ❤️

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants