NUnit for Team Build

Updated Release: Version 1.2 (Nov 28, 2009)

rbanks54 — Wed, 20 Feb 2013 04:51:01 GMT

Bug fix release. Fixes the following issues:

I've been using this release at work and it seems fine. However it is still a beta so if you find any issues please report them with the Issue Tracker.

Released: Version 1.2 (Nov 28, 2009)

Wed, 20 Feb 2013 04:51:01 GMT

Bug fix release. Fixes the following issues:

I've been using this release at work and it seems fine. However it is still a beta so if you find any issues please report them with the Issue Tracker.

Updated Wiki: Home

rbanks54 — Wed, 20 Feb 2013 04:46:31 GMT

Project Description
Add support for NUnit to TFS 2008 & 2010 Team Build so that your NUnit test results are visible in the build log and incorporated into the data warehouse for reporting.

Great for teams with an existing investment in NUnit tests, or those who prefer NUnit over other testing frameworks.

Update

In case it's not obvious, with the inclusion of the unit test adapters in Visual Studio 2012 and the ability to run those test adapters in the TFS2012 build engine this project is now considered as "done".

There won't be any updates for future versions of TFS and the code is considered stable for prior versions of TFS. Of course, pull requests will still be accepted if you find any problems in the code, but don't expect any new features or functionality.

Thnks for all the support this project has recieved over the years!

Quick Start Guide

To add support for NUnit to your build you need to follow a few simple steps:

Make sure NUnit is installed on your build server.
Unzip the files from the download and add them to source control in the same folder as your TFSBuild.proj
Update the NUnitTFS.exe.config file to point to your TFS server
Change your build script to run NUnit and then call the NUnitTFS utility (see the sample script for an idea of how this is done)
Run your build!

If it's all set up correctly the next time you build you should see your build logs looking something like this:

If you follow the sample script you'll also need to make sure you have the The MSBuild Community Tasks installed on your build server.

Version 1.0 required MSTest to be installed for publishing test results, but this is no longer a requirement as of version 1.1.

This release has been tested with NUnit 2.4.7, 2.4.8 and 2.5.2.

Support for TFS 2010 has been added with version 2.0.

For information on TFS2008 integration see the developer notes and http://www.mrkwatkins.co.uk/Blog/2009/07/25/Making-NUnit-Play-Nicely-With-Team-Foundation-Server.

For integration with TFS2010 Team Build have a look at this great post at heikura.info

UPDATE 25-Apr-2012: Source code converted to git to enable better collaboration. Feel free to submit your pull requests :-)

Created Issue: Support HTTPS for publishing .trx to TFS [8880]

jimsz — Wed, 23 Jan 2013 05:14:52 GMT

Publishing results to TFS should support HTTPS.

Here's an error we're receiving:
Loading NUnit Output from C:\Builds\2\MyApp\Test.MyApp\Sources\tools\nunit-2.4.4\myperf-test.xml...
Transforming NUnit output to .trx file...
Adding build information to .trx file...
Publishing .trx file...
System.ArgumentException: The provided URI scheme 'https' is invalid; expected 'http'.Parameter name: via at System.ServiceModel.Channels.TransportChannelFactory`1.ValidateScheme(Uri via)

Commented Feature: Add TFS 2010 Activity [6712]

jimsz — Wed, 23 Jan 2013 05:10:52 GMT

TFS 2010 uses Windows Workflow by default when you setup a new build. Write an activity that we can use with TFS 2010 instead of running the command line tool.
Comments: The link is no longer valid. Can the information be provided?

Commented Issue: Cant find team project (tfs2010) [8570]

MattC7 — Thu, 25 Oct 2012 17:24:23 GMT

Commented Issue: Cant find team project (tfs2010) [8570]

MattC7 — Thu, 25 Oct 2012 17:19:55 GMT

When running NUnitTfs it can't find my team project. I have checked the spelling an the name is MyProject. Does I need to specify the team collection name somewhere? Any suggestions?

Version: 2.0 Alpha.

C:\Users\myuser>C:\Builds\2\MyProject\ContinuousIntegration\Sources\MyProject\devel\main\Dependencies\nunit4teambuild\NUnitTfs.exe -n C:\Builds\2\MyProject\ContinuousIntegration\TestResults\nunit-tests.xml -t MyProject -b "ContinuousIntegration_20110804.7" -v 2010 -p "Any CPU" -f Debug

Loading NUnit Output from C:\Builds\2\MyProject\ContinuousIntegration\TestResults\nunit-tests.xml...
Transforming NUnit output to .trx file...
Adding build information to .trx file...
Publishing .trx file...
System.ServiceModel.FaultException: TF200016: The following project does not exist: MyProject. Verify that the name of the project is correct and that the project exists on the specified Team Foundation Server.

Server stack trace:
at System.ServiceModel.Channels.ServiceChannel.HandleReply(ProxyOperationRuntime operation, ProxyRpc& rpc)
at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)

Exception rethrown at [0]:
at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
at KWatkins.NUnitTfs.Tfs2010.BuildServiceV3.BuildWebServiceSoap.QueryBuilds(BuildDetailSpec[] specs)
at KWatkins.NUnitTfs.Tfs2010.Publisher2010.GetBuildDetails() in C:\Users\Kevin Watkins\Documents\Visual Studio 10\Projects\NUnitTFS\NUnitTFS\Tfs2010\Publisher2010.cs:line 333
at KWatkins.NUnitTfs.Tfs2010.Publisher2010.PublishToTfs(XDocument trx) in C:\Users\Kevin Watkins\Documents\Visual Studio 10\Projects\NUnitTFS\NUnitTFS\Tfs2010\Publisher2010.cs:line 26
at KWatkins.NUnitTfs.Program.Main(String[] args) in C:\Users\Kevin Watkins\Documents\Visual Studio 10\Projects\NUnitTFS\NUnitTFS\Program.cs:line 29
Comments: I get this error but haven't added the teamcollection name to the endpoints: C:\Program Files (x86)\NUnit\publishing\NUnitTfs.exe -n "\\server5\builds\NUnit Trunk Middleware\NUnit Trunk Middleware_20121025.9\logs\RiskTests.dll.ResultXml.xml" -t "Distributed System" -p "Any CPU" -f "Release" -b "NUnit Trunk Middleware_20121025.9" -v 2010 System.ServiceModel.FaultException: TF200016: The following project does not exist: Distributed StarTrade. Verify that the name of the project is correct and that the project exists on the specified Team Foundation Server. My endpoints are:  <endpoint address="http://server5:8080/tfs/TestManagement/v1.0/TestResults.asmx" binding="basicHttpBinding" bindingConfiguration="TestResultsServiceSoap" contract="Tfs2010.TestResultsServiceV1.TestResultsServiceSoap" name="TestResultsServiceSoap" /> <endpoint address="http://server5:8080/tfs/Services/v3.0/IdentityManagementService.asmx" binding="basicHttpBinding" bindingConfiguration="IdentityManagementWebServiceSoap" contract="Tfs2010.IdentityManagementServiceV3.IdentityManagementWebServiceSoap" name="IdentityManagementWebServiceSoap" /> <endpoint address="http://server5:8080/tfs/Build/v3.0/BuildService.asmx" binding="basicHttpBinding" bindingConfiguration="BuildWebServiceSoap" contract="Tfs2010.BuildServiceV3.BuildWebServiceSoap" name="BuildWebServiceSoap" />

Reviewed: Version 2.0 Alpha 1 (Oct 09, 2012)

EIrestone — Tue, 09 Oct 2012 18:57:14 GMT

Rated 4 Stars (out of 5) - Worked great the first time when integrating with msbuild. The product version and file version do not match the alpha versioning of 2.0

New Post: NUnittfs.exe.config

AbrahamAlcaina — Thu, 06 Sep 2012 15:58:37 GMT

I have a problem when I try to connecto to TFS2010.

I read this post:

http://stackoverflow.com/questions/9260175/getting-no-test-results-after-customising-the-build-template-for-nunit-tests-in

And this:

http://geek.ianbattersby.com/2012/01/04/tfsbuild-2010-nunit-integration

My actual config is like these:

<?xml version="1.0" encoding="utf-8" ?><configuration> <system.serviceModel> <bindings> <basicHttpBinding> <binding name="BuildServiceSoap" closeTimeout="00:01:00" openTimeout="00:01:00" receiveTimeout="00:10:00" sendTimeout="00:01:00" allowCookies="false" bypassProxyOnLocal="false" hostNameComparisonMode="StrongWildcard" maxBufferSize="65536" maxBufferPoolSize="524288" maxReceivedMessageSize="65536" messageEncoding="Text" textEncoding="utf-8" transferMode="Buffered" useDefaultWebProxy="true"> <readerQuotas maxDepth="32" maxStringContentLength="8192" maxArrayLength="16384" maxBytesPerRead="4096" maxNameTableCharCount="16384" /> <security mode="TransportCredentialOnly"> <transport clientCredentialType="Ntlm" proxyCredentialType="None" realm="" /> <message clientCredentialType="UserName" algorithmSuite="Default" /> </security> </binding>
<binding name="LinkingService" closeTimeout="00:01:00" openTimeout="00:01:00" receiveTimeout="00:10:00" sendTimeout="00:01:00" allowCookies="false" bypassProxyOnLocal="false" hostNameComparisonMode="StrongWildcard" maxBufferSize="65536" maxBufferPoolSize="524288" maxReceivedMessageSize="65536" messageEncoding="Text" textEncoding="utf-8" transferMode="Buffered" useDefaultWebProxy="true"> <readerQuotas maxDepth="32" maxStringContentLength="8192" maxArrayLength="16384" maxBytesPerRead="4096" maxNameTableCharCount="16384" /> <security mode="TransportCredentialOnly"> <transport clientCredentialType="Ntlm" proxyCredentialType="None" realm="" /> <message clientCredentialType="UserName" algorithmSuite="Default" /> </security> </binding>
<binding name="Service2Soap" closeTimeout="00:01:00" openTimeout="00:01:00" receiveTimeout="00:10:00" sendTimeout="00:01:00" allowCookies="false" bypassProxyOnLocal="false" hostNameComparisonMode="StrongWildcard" maxBufferSize="65536" maxBufferPoolSize="524288" maxReceivedMessageSize="65536" messageEncoding="Text" textEncoding="utf-8" transferMode="Buffered" useDefaultWebProxy="true"> <readerQuotas maxDepth="32" maxStringContentLength="8192" maxArrayLength="16384" maxBytesPerRead="4096" maxNameTableCharCount="16384" /> <security mode="TransportCredentialOnly"> <transport clientCredentialType="Ntlm" proxyCredentialType="None" realm="" /> <message clientCredentialType="UserName" algorithmSuite="Default" /> </security> </binding> </basicHttpBinding> </bindings>
<client> 
<endpoint address="http://tfs:8080/tfs/MyProject/TestManagement/v1.0/TestResults.asmx" binding="basicHttpBinding" bindingConfiguration="TestResultsServiceSoap" contract="Tfs2010.TestResultsServiceV1.TestResultsServiceSoap" name="Service2Soap" /> <endpoint address="http://tfs:8080/tfs/MyProject/Services/v3.0/IdentityManagementService.asmx" binding="basicHttpBinding" bindingConfiguration="IdentityManagementWebServiceSoap" contract="Tfs2010.IdentityManagementServiceV3.IdentityManagementWebServiceSoap" name="LinkingService" /> <endpoint address="http://tfs:8080/tfs/MyProject/Build/v3.0/BuildService.asmx" binding="basicHttpBinding" bindingConfiguration="BuildWebServiceSoap" contract="Tfs2010.BuildServiceV3.BuildWebServiceSoap" name="BuildServiceSoap" /> </client> </system.serviceModel></configuration>

Somebody can help me to configure or give me a sample of the complete file for TFS2010

Edited Feature: Add TFS 2010 Activity [6712]

rbanks54 — Tue, 24 Jul 2012 04:46:49 GMT

TFS 2010 uses Windows Workflow by default when you setup a new build. Write an activity that we can use with TFS 2010 instead of running the command line tool.

Commented Issue: Add TFS 2010 Activity [6712]

rbanks54 — Tue, 24 Jul 2012 04:45:08 GMT

TFS 2010 uses Windows Workflow by default when you setup a new build. Write an activity that we can use with TFS 2010 instead of running the command line tool.
Comments: I don't think we really need a custom activity for this. The Invoke Process activity is enough to meet the needs of the TFS 2010 workflow based builds. The information at http://www.heikura.info/publish-nunit-test-results-as-part-of-team-build-in-team-foundation-server-2010 provides information on how this can be done and also makes a build template available for download with the changes already made to it. That said, if you still think you need a custom activity please add a comment explaining why. Thanks!

New Post: New url for the TFS2010 team build integration article

rbanks54 — Tue, 24 Jul 2012 04:36:32 GMT

Fixed. Thanks

Updated Wiki: Home

rbanks54 — Tue, 24 Jul 2012 04:36:15 GMT

Make sure NUnit is installed on your build server.
Unzip the files from the download and add them to source control in the same folder as your TFSBuild.proj
Update the NUnitTFS.exe.config file to point to your TFS server
Change your build script to run NUnit and then call the NUnitTFS utility (see the sample script for an idea of how this is done)
Run your build!

New Post: Only converting NUnit XML logs to TRX

rbanks54 — Tue, 24 Jul 2012 04:35:11 GMT

Thanks Henry. I didn't think about needing to quote anything with a space in it. My bad.

New Post: Only converting NUnit XML logs to TRX

jeeejay — Sat, 21 Jul 2012 00:47:54 GMT

Hey Henry,

Thanks a lot for the response. I kept this task aside since I didn't hear from anyone. Now that you have replied with some solution, I'll try it out and let you know. Thanks again.

- GJ

On Thu, Jul 19, 2012 at 4:35 PM, HenryCC <notifications@codeplex.com> wrote:

From: HenryCC

I had this problem too and ended up needing to make sure I had quotes pretty much everywhere.

NUnitTfs.exe -n \\<build_server>\TFSBuilds\CI\CI_20120719.1\logs\Project.Tests.dll.ResultXml.xml -t "My Project" -p "Any CPU" -f Debug -b "CI_20120719.1" -v 2010

Originally I didn't have quotes around the -t parameter for My Project. I updated the InvokeProcess arguments to this:

String.Format("-n {0} -t ""{1}"" -p ""{2}"" -f {3} -b ""{4}"" -v 2010", testResultXmlPath, BuildDetail.TeamProject, BuildSettings.PlatformConfigurations(0).Platform, BuildSettings.PlatformConfigurations(0).Configuration, BuildDetail.BuildNumber)

Now I'm down to the "System.ServiceModel.EndpointNotFoundException: There was no endpoint listening at http://my_server:8080/tfs/Build/v3.0/BuildService.asmx that could accept the message".

Hope that helps,

Henry

Read the full discussion online.

To add a post to this discussion, reply to this email (nunit4teambuild@discussions.codeplex.com)

To start a new discussion for this project, email nunit4teambuild@discussions.codeplex.com

You are receiving this email because you subscribed to this discussion on CodePlex. You can unsubscribe on CodePlex.com.

Please note: Images and attachments will be removed from emails. Any posts to this discussion will also be available online at CodePlex.com

New Post: Only converting NUnit XML logs to TRX

HenryCC — Thu, 19 Jul 2012 23:35:38 GMT

I had this problem too and ended up needing to make sure I had quotes pretty much everywhere.

NUnitTfs.exe -n \\<build_server>\TFSBuilds\CI\CI_20120719.1\logs\Project.Tests.dll.ResultXml.xml -t "My Project" -p "Any CPU" -f Debug -b "CI_20120719.1" -v 2010

Originally I didn't have quotes around the -t parameter for My Project. I updated the InvokeProcess arguments to this:

String.Format("-n {0} -t ""{1}"" -p ""{2}"" -f {3} -b ""{4}"" -v 2010", testResultXmlPath, BuildDetail.TeamProject, BuildSettings.PlatformConfigurations(0).Platform, BuildSettings.PlatformConfigurations(0).Configuration, BuildDetail.BuildNumber)

Now I'm down to the "System.ServiceModel.EndpointNotFoundException: There was no endpoint listening at http://my_server:8080/tfs/Build/v3.0/BuildService.asmx that could accept the message".

Hope that helps,

Henry

Closed Issue: Could not find file 'UNNAMED' [8571]

rbanks54 — Wed, 25 Apr 2012 11:48:51 GMT

Don't know what is going on. Could you help?

C:\Users\myuser>C:\Builds\1\MyProject\ContinuousIntegration\Sources\MyProject\devel\main\Dependencies\nunit4teambuild\NUnitTfs.exe -n C:\Builds\1\MyProject\ContinuousIntegration\Binaries\nunit-tests.xml -t MyProject -b "ContinuousIntegration_20110804.10" -v 2010

Loading NUnit Output from C:\Builds\1\MyProject\ContinuousIntegration\Binaries\nunit-tests.xml...
Transforming NUnit output to .trx file...
Adding build information to .trx file...
Publishing .trx file...
Checking test run does not exist...
Reading users identity...
Creating test run...
Creating test results...
Updating test run with details...
System.IO.FileNotFoundException: Could not find file 'UNNAMED'.
File name: 'UNNAMED'
at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
at System.IO.FileInfo.get_Length()
at KWatkins.NUnitTfs.Tfs2010.Publisher2010.<>c__DisplayClassc.<UpdateTestRunWithTmiRunAndAssemblies>b__9(FileInfo file) in C:\Users\Kevin Watkins\Documents\Visual Studio 10\Projects\NUnitTFS\NUnitTFS\Tfs2010\Publisher2010.cs:line 150
at System.Linq.Enumerable.WhereSelectArrayIterator`2.MoveNext()
at System.Linq.Buffer`1..ctor(IEnumerable`1 source)
at System.Linq.Enumerable.ToArray[TSource](IEnumerable`1 source)
at KWatkins.NUnitTfs.Tfs2010.Publisher2010.UpdateTestRunWithTmiRunAndAssemblies(TestRun testRun, XDocument trx) in C:\Users\Kevin Watkins\Documents\Visual Studio 10\Projects\NUnitTFS\NUnitTFS\Tfs2010\Publisher2010.cs:line 149
at KWatkins.NUnitTfs.Tfs2010.Publisher2010.PublishToTfs(XDocument trx) in C:\Users\Kevin Watkins\Documents\Visual Studio 10\Projects\NUnitTFS\NUnitTFS\Tfs2010\Publisher2010.cs:line 44
at KWatkins.NUnitTfs.Program.Main(String[] args) in C:\Users\Kevin Watkins\Documents\Visual Studio 10\Projects\NUnitTFS\NUnitTFS\Program.cs:line 29

The nunit result is generated in this way:
C:\Builds\1\MyProject\ContinuousIntegration\Sources\MyProject\devel\main\Dependencies\nunit\bin\nunit-console.exe C:\Builds\1\MyProject\ContinuousIntegration\Binaries\MyProject.DataAccess.Tests.dll C:\Builds\1\MyProject\ContinuousIntegration\Binaries\MyProject.Domain.Tests.dll C:\Builds\1\MyProject\ContinuousIntegration\Binaries\MyProject.UI.Tests.dll C:\Builds\1\MyProject\ContinuousIntegration\Binaries\MyProject.Utility.Tests.dll /xml:C:\Builds\1\MyProject\ContinuousIntegration\Binaries\nunit-tests.xml /framework:net-2.0

Closed Task: Add Support For TFS 2010 [6390]

rbanks54 — Wed, 25 Apr 2012 11:48:38 GMT

I can't get the thing working with TFS 2010... Work out what needs to change (hopefully just configuration files!) and create a new version if necessary.

Updated Wiki: Home

rbanks54 — Wed, 25 Apr 2012 11:45:57 GMT

Project Description
Add support for NUnit to TFS 2008's Team Build so that your NUnit test results are visible in the build log and incorporated into the data warehouse for reporting.

Great for teams with an existing investment in NUnit tests, or those who prefer NUnit over other testing frameworks.

To add support for NUnit to your build you need to follow a few simple steps:

Make sure NUnit is installed on your build server.
Unzip the files from the download and add them to source control in the same folder as your TFSBuild.proj
Update the NUnitTFS.exe.config file to point to your TFS server
Change your build script to run NUnit and then call the NUnitTFS utility (see the sample script for an idea of how this is done)
Run your build!

Source code checked in, #66952

jstangroome — Mon, 23 Apr 2012 08:52:10 GMT

Support TFS server or collection uri to be specified at the command line which will override the values in the app.config