VHDL test results in jUnit (or another Jenkins format)

Question

I am setting up automatic regression testing for the FPGA project, almost exactly as described here:

• Continuous integration of complex reconfigurable systems

Now I want to get test results (from VHDL REPORT in ModelSim modeling) to appear in Jenkins test reports. I understand that Jenkins only natively supports the jUnit format, and I searched for plugins that support non-XML formats, but did not see it.

Creating valid XML from VHDL REPORT reports would be very difficult, since the simulation may stop immediately depending on the severity. This means that closing tags should be duplicated in every single possible exit path for each individual test - not the most convenient approach.

So, do you know any easy way to convert plain text to jUnit (or another format if supported by Jenkins)? If something else doesn’t exist, is there an advantage to writing a Jenkins plugin versus simply iterating over a perl script? Any other suggestions?

Answer 1

You should take a look at XUnit Plugin . The plugin reads test results from a number of tools and seems to adapt to custom formats. From the documentation, the plugin is able to read not only xml, but also csv and txt. For custom format, you need to specify some stylesheet for conversion, I'm not quite sure that this will be completely for you. But even if this is not the case, I suggest that the plugin should be easily extensible for your own format.

Answer 2

An old post, but today there is a single VHDL testing module that we have developed. He solves the problem by creating a report in JUnit format. It also handles the case when the simulation is terminated due to a serious error. The tool is free and open source and can be found at https://github.com/LarsAsplund/vunit