Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

display build URL for changepoint #15

Merged
merged 7 commits into from
May 9, 2024

Conversation

shashank-boyapally
Copy link
Contributor

Type of change

  • Refactor
  • New feature
  • Bug fix
  • Optimization
  • Documentation Update

Description

Since it will be easier to check buildUrl from the console, this would be an addition to orion. I'm unable to add the hyperlinked text in this preview, but the terminal does show hyperlinked text. The reason moving to hyperlinked text is to keep the terminal readable and clean. If having the URL makes more sense, it can be updated

(venv) sboyapal orion (display-builds) >> orion --hunter-analyze
2024-02-12 22:46:11,108 - Orion - INFO - The test aws-small-scale-cluster-density-v2 has started
2024-02-12 22:46:11,109 - Matcher - INFO - Executing query against index=perf_scale_ci
2024-02-12 22:46:11,656 - Matcher - INFO - Executing query against index=ripsaw-kube-burner*
2024-02-12 22:46:13,538 - Orion - INFO - Collecting podReadyLatency
2024-02-12 22:46:13,538 - Matcher - INFO - Executing query against index=ripsaw-kube-burner
2024-02-12 22:46:15,809 - Orion - INFO - Collecting apiserverCPU
2024-02-12 22:46:15,809 - Matcher - INFO - Executing query against index=ripsaw-kube-burner
2024-02-12 22:46:18,905 - Orion - INFO - Collecting ovnCPU
2024-02-12 22:46:18,905 - Matcher - INFO - Executing query against index=ripsaw-kube-burner
2024-02-12 22:46:23,264 - Orion - INFO - Collecting etcdCPU
2024-02-12 22:46:23,264 - Matcher - INFO - Executing query against index=ripsaw-kube-burner
2024-02-12 22:46:26,399 - Orion - INFO - Collecting etcdDisck
2024-02-12 22:46:26,399 - Matcher - INFO - Executing query against index=ripsaw-kube-burner
time                       uuid                                    P99    apiserverCPU_cpu_avg    ovnCPU_cpu_avg    etcdCPU_cpu_avg    etcdDisck_duration_avg
-------------------------  ------------------------------------  -----  ----------------------  ----------------  -----------------  ------------------------
2023-10-16 19:25:28 +0000  e624b10f-148b-4871-acb5-e8a71cf1b605  13000                 10.175            2.42737            7.63694                 0.0115776
2023-10-18 15:11:43 +0000  325dd073-b680-4e44-951f-26506f401be0  13000                 10.4876           2.49018            8.12781                 0.0107434
2023-10-24 10:52:22 +0000  8cfc4fcf-46c7-4b9f-a464-cd100bfb84bf  13000                 10.3932           2.44498            7.60968                 0.0116801
                                                                                                ················                                               
                                                                                                          +13.8%                                               
                                                                                                ················                                               
2023-10-31 10:30:02 +0000  3c9e2789-59d4-4d6f-9f07-5c400cf25c93  13000                 11.0129           2.73347            8.83458                 0.0112971
2023-11-03 04:08:14 +0000  649228fb-9ff4-458a-8a8b-b9ecb521ca1b  13000                 10.8605           2.82005            8.34146                 0.0101805
2023-11-07 10:26:08 +0000  d8e0c965-4548-48d4-8a7a-c065b93ee766  15000                 10.5964           2.6356             7.48679                 0.0124896
2023-11-15 12:36:38 +0000  a990f7f9-1faf-41f7-b9fb-3b83f91b6e52  13000                 10.8222           2.81836            8.56302                 0.0112316
2023-11-22 12:53:45 +0000  e6c219dc-a9aa-4cf9-854a-fbd846c8ad22  13000                 10.8555           2.84967            8.20129                 0.0111251
2023-11-29 12:32:04 +0000  adc95590-791d-423b-9d09-8190178edbf6  13000                 11.4115           2.8615             8.67125                 0.0127318
                                                                                                                                     ························  
                                                                                                                                                       +42.9%  
                                                                                                                                     ························  
2023-12-06 12:34:57 +0000  5b06c830-be55-4c84-b4da-92720b55c304  13000                 11.05             2.85996            8.69638                 0.0134358
2023-12-20 12:37:17 +0000  c5f95336-27d4-4615-94c1-d618e975a36b  13000                 10.9253           2.77954            8.20148                 0.0137848
2023-12-27 12:36:59 +0000  bd5e6cad-6bc2-472d-948a-b1fbb350e80a  13000                 11.1967           2.77645            8.63235                 0.0154012
2024-01-03 12:33:09 +0000  b91c7156-0b86-4c79-81eb-60dfb7288070  13000                 10.7863           2.80557            8.54677                 0.0138396
                                                                                                ················                                               
                                                                                                          +23.3%                                               
                                                                                                ················                                               
2024-01-10 12:38:16 +0000  12a1750e-a7eb-48ed-bc00-35078d2bbad8  13000                 10.9379           3.10667            8.86329                 0.0154639
                                                                                                                  ·················                            
                                                                                                                             +14.3%                            
                                                                                                                  ·················                            
2024-01-10 22:59:25 +0000  c6b4aaa3-cd2c-4f04-af20-3d10c52449a2  13000                 11.4162           3.1338             9.29143                 0.0128269
                                                                        ······················                                                                 
                                                                                        +22.9%                                                                 
                                                                        ······················                                                                 
2024-01-11 17:30:26 +0000  c2963cec-e800-423f-92b1-3e6f692a55cb  13000                 16.1465           3.80976           10.1149                  0.0149901
2024-01-15 13:01:36 +0000  4f73a079-0088-4027-af0d-7c1b5b429fdd  13000                 15.0479           3.93557           10.0966                  0.0193588
2024-01-15 20:30:57 +0000  90189fbf-7181-4129-8ca5-3cc8d656b595  13000                 10.8181           3.05989            8.48998                 0.015606
2024-01-17 12:35:28 +0000  bff92096-3a8e-4cb4-805b-55638be4aa23  14000                 11.3023           3.03366            9.04686                 0.0124663
2024-01-22 12:57:43 +0000  f8778f71-08b3-42af-8e71-6ce1b8335c8d  13000                 16.0607           3.93435           10.5545                  0.0231879
2024-01-24 12:48:41 +0000  d70a8864-b251-417a-b43b-d85a54604c0f  13000                 10.7205           3.05               8.23406                 0.015117
2024-01-29 16:41:22 +0000  28175f25-7f08-4b86-b754-cca0a59f35ea  13000                 15.3787           3.9335            10.4592                  0.0213644
2024-01-31 12:41:55 +0000  33feb742-30be-45c4-9849-52072e52aaee  13000                 11.1809           3.0081             9.01858                 0.0164261
2024-02-05 12:57:47 +0000  ab482da1-a857-4d08-948a-897d9c670b64  13000                 16.3836           4.08402           10.4616                  0.0217523
2024-02-07 12:48:05 +0000  724504bf-637b-407b-b379-d46614df9da5  13000                 10.8264           3.09103            8.57438                 0.0149923
2024-02-07 13:26:27 +0000  69475c18-ad94-4a34-b6c1-f7d4d5b2043a  13000                 10.9693           3.11466            8.77954                 0.0147759
2024-02-12 12:58:13 +0000  f728b48b-96a6-49b8-8bdf-06f71b0b0108  13000                 15.3591           3.95375           10.3827                  0.0196659
2024-02-12 22:46:27,995 - Matcher - INFO - Executing query against index perf_scale_ci
INFO:Matcher:Executing query against index perf_scale_ci
2024-02-12 22:46:28,037 - Matcher - INFO - Executing query against index perf_scale_ci
INFO:Matcher:Executing query against index perf_scale_ci
2024-02-12 22:46:28,085 - Matcher - INFO - Executing query against index perf_scale_ci
INFO:Matcher:Executing query against index perf_scale_ci
2024-02-12 22:46:28,130 - Matcher - INFO - Executing query against index perf_scale_ci
INFO:Matcher:Executing query against index perf_scale_ci
2024-02-12 22:46:28,174 - Matcher - INFO - Executing query against index perf_scale_ci
INFO:Matcher:Executing query against index perf_scale_ci
2024-02-12 22:46:28,221 - Matcher - INFO - Executing query against index perf_scale_ci
INFO:Matcher:Executing query against index perf_scale_ci
2024-02-12 22:46:28,269 - Matcher - INFO - Executing query against index perf_scale_ci
INFO:Matcher:Executing query against index perf_scale_ci
2024-02-12 22:46:28,326 - Matcher - INFO - Executing query against index perf_scale_ci
INFO:Matcher:Executing query against index perf_scale_ci


8cfc4fcf-46c7-4b9f-a464-cd100bfb84bf=======>click here for build URL

3c9e2789-59d4-4d6f-9f07-5c400cf25c93=======>click here for build URL

adc95590-791d-423b-9d09-8190178edbf6=======>click here for build URL

5b06c830-be55-4c84-b4da-92720b55c304=======>click here for build URL

b91c7156-0b86-4c79-81eb-60dfb7288070=======>click here for build URL

12a1750e-a7eb-48ed-bc00-35078d2bbad8=======>click here for build URL

c6b4aaa3-cd2c-4f04-af20-3d10c52449a2=======>click here for build URL

c2963cec-e800-423f-92b1-3e6f692a55cb=======>click here for build URL

Related Tickets & Documents

Checklist before requesting a review

  • I have performed a self-review of my code.
  • If it is a core feature, I have added thorough tests.

Testing

  • Please describe the System Under Test.
  • Please provide detailed steps to perform tests related to this code change.
  • How were the fix/results from this change verified? Please provide relevant screenshots or results.

Copy link
Collaborator

@paigerube14 paigerube14 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

orion.py Outdated Show resolved Hide resolved
@jtaleric
Copy link
Member

@shashank-boyapally we need a rebase of this PR

Signed-off-by: Shashank Reddy Boyapally <sboyapal@redhat.com>
Signed-off-by: Shashank Reddy Boyapally <sboyapal@redhat.com>
Signed-off-by: Shashank Reddy Boyapally <sboyapal@redhat.com>
Signed-off-by: Shashank Reddy Boyapally <sboyapal@redhat.com>
@shashank-boyapally
Copy link
Contributor Author

rebased this, with changes to use our new internal instance.

orion.py Outdated
if len(uuids) == 0:
logging.info("No UUID present for given metadata")
sys.exit()
else:
uuids = [uuid for uuid in re.split(' |,',baseline) if uuid]
uuids.append(uuid)
if metadata["benchmark.keyword"] == "k8s-netperf" :
if metadata["benchmark.keyword"] == "ospst-k8s-netperf" :
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we are going to need both ospst-k8s-netperf and k8s-netperf to work depending on which ES_SERVER we are looking at. Can we change the if statement to if "k8s-netperf" in metadata["benchmark.keyword"]

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@shashank-boyapally is work for allowing multiple ES_SERVERs part of a different PR?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The discussion in the slack channel for allowing multiple ES_SERVERs in the same run is not yet developed, this just take cares for the internal instance changes we had.. will be developing that once I understand the further requirements more clearly.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I still think the if "k8s-netperf" in metadata["benchmark.keyword"] would be better because this update breaks the usage of the QE elastic search index completely. This change would allow both to still work

Copy link
Contributor Author

@shashank-boyapally shashank-boyapally Apr 16, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, I'll keep it as the previous, but what index would we like to search is to be decided, as I believe in QE instance the index is k8s-netperf and in the internal instance it is ospst-k8s-netperf, should we include this index in the config file itself for better flexibility?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes I understand the index is different between QE instance and the internal instance. The code block I put in previous comments will help cover both instances. I think setting in the config will make it less flexible as we will have to have multiple files to pull the same type of data from each of the instances. That might need to be something addressed with the pr for setting multiple ES_SERVERS

Signed-off-by: Shashank Reddy Boyapally <sboyapal@redhat.com>
orion.py Outdated
ids = uuids
else:
index = "ripsaw-kube-burner"
index = "ospst-ripsaw-kube-burner*"
Copy link
Collaborator

@paigerube14 paigerube14 Apr 17, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should add the same starting * as k8s-netperf and ingress-perf here

*ripsaw-kube-burner*

Signed-off-by: Shashank Reddy Boyapally <sboyapal@redhat.com>
Signed-off-by: Shashank Reddy Boyapally <sboyapal@redhat.com>
Copy link
Collaborator

@vishnuchalla vishnuchalla left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@jtaleric
Copy link
Member

jtaleric commented May 9, 2024

lgtm! Thanks!

@jtaleric jtaleric merged commit d3513fe into cloud-bulldozer:main May 9, 2024
2 checks passed
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants