UI Analysis App

To facilitate the editing of RPA processes, the application DumpElement has been added to the desktop. This application is mainly used to extract information about elements in the interface.

User Guide

This tool mainly analyzes the clickable elements in the current interface, extracts various types of information about the elements, and fills in the corresponding information in RPA to locate and operate on the element.

After running this application, the main interface is as shown in the following figure.

The button in the upper right corner is the minimize button. Clicking it will reduce the application to a floating ball, and clicking it again will restore it to the original interface.

The three buttons on the main interface are "Analysis Interface", "Clear Interface", and "Close Application". The analysis results are as follows:

Clicking on the elements within the green box will display detailed information about that element.

Clicking on the value of the selected information will copy it to the clipboard.

Practical Application

For better understanding, let's take an actual scenario as an example. As mentioned earlier, the detailed information of the element is the Settings icon. In RPA, there are several ways to click on this icon.

1. Package Name

After opening the settings page and using this tool to analyze the interface, you can see the package name of the application. Clicking on it will automatically copy the package name.

Then in RPA, use "Open Application". Enter the package name, and the application can be run.

2. Element Selection

In RPA, for all operations related to element acquisition, the corresponding elements can be found through several attributes such as fullid, class, text, and desc.

In some special interfaces, if the above several attributes cannot be used to locate a single element and multiple results are matched, the element order can be used to specify which element is needed.