Does anyone use Sikuli as a testing tool?

Question

Hi, I have a Swing app for testing, and I found Sikuli a good tool for this, but I'm a little concerned about the size of the community and if it is constantly being developed and used by other companies.

Do you use it?

For what?

Is it stable?

Is this the best tool for the job you need?

Answer 1

I use it in my company. It can be used quite easily for not too complicated gui tests. Sikuli has not been developed over the past year, but development is now increasing again. The questions in the Sikuli-FAQ section of the launchpad answer quickly, although the community is not that big. At my company, Sikuli is used to test gui, which was previously performed by human testers. This saves some time, but not everything is automated with Sikuli, for example. OCR functionality is not reliable (but will be updated from tesseract 2.04 to 3 in the near future).

For my work, it was the best tool because it is the only open source (= free) tool I have found that provides screenshot-based automation that can be integrated with other systems, such as CI systems, and programmed using Java and Python, which makes unit testing easy with JUnit or PyUnit.

Hope I can help.

Answer 2

Yes, we use it for testing. It is actively supported. I reported bugs in Sikuli and received suggestions and workarounds proposed within a few days, with bugs fixed in the next version.

It is pretty stable. The problems that I encountered usually arise due to incorrect images, and the program selects the wrong area of ​​the screen.

One of our unique uses was to create a set of automated test cases for an outdated embedded system. The system was written in assembly and did not have the ability to test modules. He talked to an outdated user PC application. Instead of trying to find the source code for the PC, redesign the design, and then write some meaningful bench tests, we created several Sikuli scripts to interact with the PC application. It saved weeks of development.

Answer 3

Yes, we use it to automate graphical tests. It was mainly used for older systems that were designed without the back of the test. (i.e.: no api testing)

We test very sophisticated tools, including a debugger using Sikuli.

We tend not to use the Sikuli IDE.