![]() Optimize UI elements indicate experience to favor fully loaded targets Scope-less activities (activities that can be used outside an Use Application/Browser UIA scope) can now also benefit from CV being enabled by default (when also enabled in Project Settings). Given the targeting and fallback mechanism in Unified Target, having fully loaded (both selectors and CV descriptors) targets is the happy path for all users, so auto-enabling CV is needed when indicating. Auto-enable CV when indicating in scope-less activities Also, the enabled/disabled state of the CV toggle in the Helper will persist throughout all the indicate sessions inside a scope. The CV screenshot no longer needs an initial delay, so now the start of the indicate experience is faster. Image033 1243×403 96.8 KB Streamlined indicate experience when CV is enabled This feature is enabled via a setting in Project Settings > UI Automation Modern, which is True by default: This setting allows the primary targeting methods to consume their full timeout until any fallback targeting method can be used, aiming to bring more predictability and visibility into selector related issues so that the RPA developers will have better control over their UI elements targeting, while also having the solid fallback CV provides.įailing strict selectors at run-time are highlighted in logsįailing strict selectors will show in the logs as warnings, accompanied by suggestions of the top 10 closest matches that can be used to replace the faulty selectors. There is now a new setting in Project Settings > UI Automation Modern, which is set to True by default for new projects: Selectors are now considered the primary targeting method, Computer Vision is a secondary targeting method, while Image is a tertiary targeting method (and is also now disabled by default). Ranking now decides which targeting method will be used at run-time, accounting for each targeting method’s relevancy in terms of targeting power and resilience to UI changes. We improved overall targeting accuracy and automation resilience, while also providing the user with better transparency in terms of selector health. Run-time targeting methods are now optimized You can now easily extract tables spanning across multiple pages in pure CV scenarios as well by indicating the Next button in the wizard.Įxtracting scrollable tables is also possible, using the same logic as in the CV Extract Table activity. ![]() No need to switch to a CV Screen Scope & use a CV Extract Table you can use the existing UIA Table Extraction wizard to extract pure CV tables as well for scenarios where selectors are not available at all, such as remote desktops without the remote run-time installed. ![]() While also allowing pure CV table extraction Note: in case the selectors have any issues extracting the table at run-time, we don’t have a CV fallback mechanism in place yet. Since CV “sees” entire tables, it is used at design-time to correct the sometimes-faulty selector-based extraction when indicating a full table. You can now just indicate full tables, no need to indicate a relevant table cell first. Table extraction is now CV-boosted for selector-based extraction In short, we have continued to pursue our north-star vision of a unified UIA UX where both pure CV and combined CV & driver powered automations can seamlessly be created without the need for the user to be aware of the intricacies of each targeting method while also providing flexibility in targeting customization for power users. We also optimized core issues related to Unified Target itself by accounting for each targeting method’s relevancy in terms of targeting power and resilience to UI changes. In 23.10, we continued our story around seamlessly integrating Computer Vision in Unified Target by addressing the main limitations in 23.4: Our 23.10 release focused on improving core components in Unified Target and Windows attended automations by supporting use-cases involving Microsoft UI Automation / Embedded browsers applications and by providing new tools for helping our clients identify the events triggered by certain UI elements actions. To read about other products, please navigate to the main topic here. This topic goes in-depth about the improvements in UIAutomation, Computer Vision & SAP Automation. UIAutomation, Computer Vision & SAP Automation
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |