Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Creative use of SikuliX's support for transparent .png images #457

Closed
kensoh opened this issue Jun 20, 2019 · 1 comment
Closed

Creative use of SikuliX's support for transparent .png images #457

kensoh opened this issue Jun 20, 2019 · 1 comment
Labels
feature

Comments

@kensoh
Copy link
Member

kensoh commented Jun 20, 2019

In TagUI v5.0, its SikuliX integration and engine is upgraded to v1.1.4.

This version supports transparent (0% opacity) .png images. That allows for interesting use cases - eg UI elements with changing backgrounds, application containers (PDF viewer, MS word, frame, textbox) with varying centre contents.

Raising an issue to update visual automation section of readme and tutorial on this feature. No code change needed for this, another issue will be raised for specifying (x,y) boundaries for areas of interest for read, show, save, snap steps.
@kensoh kensoh added the feature label Jun 20, 2019
kensoh added a commit to tebelorg/TagUI that referenced this issue Jun 20, 2019
@kensoh
aisingapore#457 - visual automation images with transparency
0ad8cb8
kensoh added a commit that referenced this issue Jun 20, 2019
@kensoh
#457 - visual automation images with transparency (#458)
d80ac1a 
In TagUI v5.0, its SikuliX integration and engine is upgraded to v1.1.4.

This version supports transparent (0% opacity) .png images. That allows for interesting use cases - eg UI elements with changing backgrounds, application containers (PDF viewer, MS word, frame, textbox) with varying centre contents.

Raising an PR to update visual automation section of readme and tutorial on this feature. No code change needed for this, another issue will be raised for specifying (x,y) boundaries for areas of interest for read, show, save, snap steps.
@kensoh
Copy link
Member Author

kensoh commented Jun 20, 2019

Added following paragraphs in readme and committed PR.

Transparency (0% opacity) is supported in .png images, for eg using an image of an UI element with transparent background to enable clicking on an UI element that appears on different backgrounds on different occasions.

Another example is an image of the window or frame (PDF viewer, MS Word, textbox etc) with the center content of the image set as transparent. This allows using read, show, save, snap steps to perform OCR and save snapshots for application windows, containers, frames, textboxes with varying content.

For this feature, it's ready to use right away as there is no code change.

No updating from cutting edge version or future packaged installation needed.

@kensoh kensoh closed this as completed Jun 20, 2019
@kensoh kensoh mentioned this issue Jun 21, 2019
Closed
kensoh added a commit that referenced this issue Jun 21, 2019
@kensoh
#457 - tutorial visual automation images with transparency
821d488
@kensoh kensoh mentioned this issue Jun 21, 2019
Merged
kensoh added a commit that referenced this issue Jun 21, 2019
@kensoh
#461 - support defining regions for OCR and snapshot (#463)
7eae738 
Following up on #457, where transparency (0% opacity) in images is supported in visual automation for advance use cases, raising a PR that allows defining regions for steps read, show, save, snap. This allows users to define a square/rectangular region on the screen to perform OCR for text extraction, and saving screenshot of that region.
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
feature
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@kensoh