Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Add option to report scores to an endpoint #317

Open
hotsphink opened this issue Sep 28, 2023 · 3 comments
Open

Add option to report scores to an endpoint #317

hotsphink opened this issue Sep 28, 2023 · 3 comments
Labels
trivial change A change that doesn't affect benchmark results

Comments

@hotsphink
Copy link

The situation is that I work on a laptop but want timings from my build workstation, without it getting slowed down by sending the display back to my laptop (via X11 forwarding, vnc, or whatever).

The straightforward solution would be to add a report parameter POSTs the timing data back to the server. Then I can run the browser either headless or using its local display. I'm running this locally, and am wondering if there would be interest in adding it (the report parameter as well as a simple server that appends the timing data to a file) to the repository here? I can make a PR.

@rniwa
Copy link
Member

rniwa commented Sep 28, 2023

I don't think we want to add the support for such an exotic testing setup.

@bgrins
Copy link
Contributor

bgrins commented Sep 28, 2023

Having an opt-in report parameter with a URL endpoint could be a convenient and lightweight way to collect submitted scores - both in a local setup as described, or for coordinating manual testing / collection across a variety of devices. When manual testing on a phone, for example, I've resorted to pastebin-ing scores which is time consuming and error prone.

I'm not sure about the "simple server that appends the timing data to a file" piece though - that seems like something that could be run independently based on specific needs.

@bgrins bgrins changed the title Support headless operation or remote displays Add option to report scores to an endpoint Oct 11, 2023
@bgrins bgrins added the trivial change A change that doesn't affect benchmark results label Oct 24, 2023
@camillobruni
Copy link
Contributor

I can only advocate my crossbench script which automates this for a big part across many devices and browsers.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
trivial change A change that doesn't affect benchmark results
Projects
None yet
Development

No branches or pull requests

4 participants