Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Test improvements #15609

Open
wants to merge 15 commits into
base: master
Choose a base branch
from
Open

Test improvements #15609

wants to merge 15 commits into from

Conversation

damencho
Copy link
Member

Will be working on some PR-testing changes.

@damencho damencho force-pushed the pr-test-update branch 13 times, most recently from 53cb01e to 20aca07 Compare February 17, 2025 15:52
@damencho damencho changed the title Do not merge. Test improvements Feb 17, 2025
@damencho
Copy link
Member Author

These tests were executed using the PR testing grid.
There are still 2 consistent failures - one failure in Mute test which fails on Chrome & Firefox (was disabled in torture). And one in Avatar tests only with Firefox, there is a missing remote audio track.
@jallamsetty1 I will need some help with these :)

const gridUrl = new URL(process.env.GRID_HOST_URL as string);
const protocol = gridUrl.protocol.replace(':', '');

export const config = merge(defaultConfig, {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need a loadash merge? Couldn't we get away with something like:

{
... defaultConfig,
protocol,
...
}

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't know. The example of inheriting configurations is using a new dependency deepmerge-ts and by Saul's proposal (if I remember correctly), I changed it to use loadash and to avoid introducing a new dependency.

https://webdriver.io/docs/organizingsuites#inherit-from-main-config-file

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is how and the existing firefox config is implemented.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

But do we use the deeply nested override?

I mean what do we want to happen when we override protocol for example? Do we want the results to have the new protocol value or we want a merged object and have the old props of protocol and also the new props?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, you are right. I guess, we can get rid of those merges in the grid file. In the firefox one, we need it as we need it to merge the props and overwrite some of value but not all of them.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would also ve fine to leave it as it is since on the other place is like that.

Whatever you decide.

Copy link
Member

@hristoterezov hristoterezov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Other than the small comment all LGTM!

@damencho
Copy link
Member Author

Done, I force-pushed changing only the 'Adds target for grid ff tests' commit. I changed the newly added conf and the existing grid conf to get rid of the merge function.

Tests that take time (desktopSharing) before they use one of the browsers (the 4th one), by the time we use it backend may have timed out  the websocket (60 seconds). Add every 20 second and execute a print to keep it alive.
We require digit input and do not have a custom validation.
@damencho damencho force-pushed the pr-test-update branch 9 times, most recently from 6e23ce2 to 6d824a5 Compare February 20, 2025 21:09
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants