Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Massive PR on many parts #54

Merged
merged 31 commits into from
Oct 21, 2023
Merged

Massive PR on many parts #54

merged 31 commits into from
Oct 21, 2023

Conversation

shuyanzhou
Copy link
Contributor

  • Further fix inaccurate or wrong locators and required_contents in the test data
  • Update evaluation code to deal with corner cases
  • Add support to huggingface models and support generation retry when facing invalid actions
  • Fix bounding box errors for more accurate in-viewport display

@shuyanzhou
Merge remote-tracking branch 'origin/bug-in-current-viewport-gitlab' …
7630e04 
…into new_eval
@shuyanzhou
add huggingface model support
1fef526
@shuyanzhou
better rendering of typing action
507659a
@shuyanzhou
multi threading auto login; auto login per example
2b15f20
@shuyanzhou
better error message for env config
e84910d
@shuyanzhou
fix statictext bounding box bug
493294b
@shuyanzhou
add support to evaluate by trace
57d2067
@shuyanzhou
support generation retry when the parsing of the action failed
16f2592
@shuyanzhou
ignore cache
9f3e4ac
@shuyanzhou
add prompts
0e7bcda
@shuyanzhou
fix force_prefix missing bug
741292e
@shuyanzhou
fix typo
1ee1ea4
@shuyanzhou
add script to check inference failures
c1ae73c
@shuyanzhou
add parallel running script
6fdbd92
@shuyanzhou
fix annotation errors based on human trajectories
cd7d593
@shuyanzhou
change reddit vote related posts to absolute urls
b6e0b22
@shuyanzhou
update URL matching, fix typos
f8d636a
@shuyanzhou
update must_include tokenization condition; upate url match
b4c917d
@shuyanzhou
remove unused evaluators
a7c475b
@shuyanzhou
remove exact from evalutor names
50e2c43
@shuyanzhou
update test example due to html escape
db063c7
@shuyanzhou
update fuzzy match prompt
6ab7fd2
@shuyanzhou
reduce coordinate precision; fix template 67 annotations
58061ee
@shuyanzhou
fix locator for product; add prep action; fix url for promo rules
4b86d43
@shuyanzhou
add options to renew cookie for selected sites
df87757
@shuyanzhou
print unfinished examples
3d3d837
@shuyanzhou
reduce openai max retry
7730a85
@shuyanzhou
minor
f91eb5b
@shuyanzhou
minor
4cec5ac
@shuyanzhou
Merge remote-tracking branch 'origin/main' into new_eval
7a1f8d6
@shuyanzhou shuyanzhou changed the title Massive PR on many aspects Massive PR on many parts Oct 21, 2023
@shuyanzhou shuyanzhou merged commit a68aa1a into main Oct 21, 2023
@shuyanzhou shuyanzhou deleted the new_eval branch October 21, 2023 04:28
This was referenced Oct 21, 2023
Closed
Closed
# for free to join this conversation on GitHub. Already have an account? # to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@shuyanzhou