Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

SharePoint and OneDrive Functional Testing #1251

Closed
4 tasks done
schrolla opened this issue Aug 1, 2024 · 7 comments
Closed
4 tasks done

SharePoint and OneDrive Functional Testing #1251

schrolla opened this issue Aug 1, 2024 · 7 comments
Assignees
Labels
Testing This issue or task involves testing the automation tool function
Milestone

Comments

@schrolla
Copy link
Collaborator

schrolla commented Aug 1, 2024

💡 Summary

As part of Iceberg release, to ensure that the tool's update is accurate, detailed functional testing has been planned. Each policy will be functionally tested to check that all pass/fail scenarios have been correctly processed by the tool using existing automated functional test plans.

This issue functionally tests each policy of SharePoint/OneDrive product of ScubaGear tool. The main objective is to test SharePoint and OneDrive policies and ensure that ScubaGear tool is providing the correct result for each possible configuration option.

Motivation and context

This functional testing ensures that ScubaGear results of pass/fail are accurate based on the latest version of the code.

Implementation notes

For each SharePoint and/or OneDrive policy do the following:

  • Configure the automated testing and run against each tenant type for which a variant testplan is present. Run the automated test plans (e.g. regular, g5, etc.) and note the results.
  • For each test failure, investigate and note the cause of the failure and log any new issues needed to resolve

For details on how to use and execute the functional tests, please see the Testing documentation in Testing/Readme.md or reach out to the dev team via other channels.

Acceptance criteria

  • All existing test plan variants for the product have been successfully run
  • Test plan results have been reviewed and any issues resolved or reported as new issues (Link created issues below)
@schrolla schrolla added the Testing This issue or task involves testing the automation tool function label Aug 1, 2024
@schrolla schrolla added this to the Iceberg milestone Aug 1, 2024
@Sloane4 Sloane4 assigned tkol2022 and unassigned Sloane4 Aug 7, 2024
@tkol2022
Copy link
Collaborator

tkol2022 commented Aug 7, 2024

G3 PnP Test
Ran with service principal and got three failed test cases which are expected for policy 1.4 due to a recently discovered settings that is being deprecated by Microsoft. See #1267 for details.

image

@tkol2022
Copy link
Collaborator

tkol2022 commented Aug 7, 2024

G5 Pnp Test
Same results as G3 Pnp test. No new issues.
image

@tkol2022
Copy link
Collaborator

tkol2022 commented Aug 7, 2024

E5 Pnp test
Same results as G3 Pnp test. No new issues.
image

@tkol2022
Copy link
Collaborator

tkol2022 commented Aug 7, 2024

GCC High Pnp test
Same results as G3 Pnp test. No new issues.

image

@tkol2022
Copy link
Collaborator

tkol2022 commented Aug 7, 2024

E5 SPO test
Same results as G3 Pnp test. No new issues.
image

@tkol2022
Copy link
Collaborator

tkol2022 commented Aug 7, 2024

G5 SPO test
Same results as G3 Pnp test. No new issues.
image

@tkol2022
Copy link
Collaborator

I think this should be closed.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
Testing This issue or task involves testing the automation tool function
Projects
None yet
Development

No branches or pull requests

3 participants