Test Automation Deployment

Question

We are developing some testing infrastructure, and I fell into the block of encoders (lack of sleep?) ... it looks like this will be a problem, but I did not find what I was looking for using google.

I would like to automatically output assemblies from our CI server (TeamCity) to several machines (growing, but currently 30). These are several WinForms applications and several DLLs. After deployment, I would like to start the tests (NUnit, for unit and integration tests) and report all the results (back to CI? Or somewhere else? Not sure).

The target machines are multiple platforms (Win7, Vista, XP, Server 2k8, Server 2k3, Ubuntu, Fedora, Suse, x64, x86, possibly macs over the line)

This helps me in part (actual push). But I can’t find existing solutions for push start tests and reporting. So far, I'm going to combine a link (or similar) with custom code running on each client computer that monitors the deployment directory, runs tests, and reports the results.

• Does anyone know about existing solutions?
• Links?
• Did something similar and share with us?

Edit
If possible, we prefer .net-based solutions, but this is not strictly necessary. I would mark the question as such, but finish the tags :)

Answer 1

So far, I have used a separate build step in TeamCity, which executes a bat script, which in turn launches tasks to the list of machines using PsExec . So far, my test run is working fine, although I now need to parallelize the copy of the assembly ...

Thanks for the contribution to those who provided it.

Answer 2

You can use KwateeSDCM to start and run on all the platforms you mentioned, including mac. However, you will need to do some encoding in order to receive reports. I am not familiar with TeamCity, but maybe you can click the script along with your application, which then transfers the test results via ftp to the server accessible by TeamCity.

Answer 3

Take a look at: STAF (Software Automation Framework)

Software Testing Automation System (STAF) is an open-source, multi-platform, multi-language infrastructure developed around the idea of ​​reusable components called services (such as process call, resource management, logging, and monitoring).

What does STAX include:

STAX is a runtime engine that can help you fully automate the analysis of the distribution, execution, and results of your test boxes.

And there is an article here: http://agiletesting.blogspot.com/2004/12/stafstax-tutorial.html

Answer 4

Assuming that you have already done the push part and you do not mind using the TeamCity license, you can create a TeamCity Command Line command line build configuration or NUnit test configuration that runs tests for a properly configured agent. The build trigger for this test configuration will successfully complete the build of the application.