NCrunch 3.15.0.6 for Visual Studio 2008-2017
NCrunch 3.15.0.6 for Visual Studio 2008-2017
It intelligently runs automated tests so that you don't have to, and gives you a huge amount of useful information about your tested code, such as code coverage and performance metrics, inline in your IDE while you type.
Automatic Concurrent Testing
A normal cycle of test driven development makes you stop to run your tests so often that it's just plain painful. Think about the steps you usually go through:
Write the test
Stop and run the test
Write the code under test
Stop and run tests
Refactor the code under test
Stop and run tests
Drink some coffee and repeat
NCrunch takes away all the pain and leaves a warm happy feeling behind. So you end up with:
Write the test
Write the code under test
Refactor the code under test
Be happy, drink some coffee and repeat!
Code Coverage
NCrunch collects test coverage for your code while it runs your tests.
This is shown next to your code in coloured markers showing which lines the tests touched, with marker colours indicating pass or fail status.
You can also navigate to any covering tests from any line of code, making it easy to see which tests you might impact with a change.
Full code coverage metrics are also available for your entire solution, allowing you to see where your code coverage is heavy and where it's light.
Performance Metrics
NCrunch profiles your tests during their execution to pick up the execution time of every line of code under test.
Metrics are shown inline conveniently with a tooltip, and 'hot spots' are shown with special colouring on the code coverage markers.
Inline Exception Details
The stack traces of exceptions thrown from your tests are processed by NCrunch and projected over the code coverage markers.
This makes it really easy to spot where your tests went wrong, without the information getting in your way.
No matter where you are in your source code, you'll be able to analyse problems quickly and without fuss.
Intelligent Test Execution
NCrunch tracks all sorts of interesting statistics about your tests, and it uses this information in the most intelligent way possible.
Tests that you have recently impacted with your code changes are highly prioritised for execution.
NCrunch uses a powerful weighting system designed to give you the most important feedback as fast as possible.
Distributed Processing
NCrunch can offload build and test work to other computers for processing.
Tasks are cleanly farmed out to any number of connected machines, forming grids to execute tests.
Grid servers can be shared between developers allowing teams to pool their resources.
Grids can even be scaled into the cloud to maximise testing throughput.
Distributed processing with NCrunch is highly effective, allowing concurrent execution of dozens or possibly even hundreds of tests at any one time.
Changes in v3.15
*****
This version of NCrunch is compatible with grid node servers from v3.14 and v3.13. Older grid nodes
must be updated before they can be used with this version.
*****
------------------------------------
NEW FEATURES
------------------------------------
Introduced a new configuration setting, 'Pipeline Optimisation Priority'. This setting controls the behaviour
of NCrunch when placing tests in the pipeline. When set to 'Responsiveness' (the default value), NCrunch will
prioritise tests to try and get the fastest and most relevant results as quickly as possible. When set to
'Throughput', NCrunch will arrange tests in the pipeline to try and minimise the overall execution time of the
pipeline. This should allow NCrunch to be configured to reduce the end-to-end running time of the test suite
when placed into a CI system with the console tool.
Adjusted the NCrunch Console Tool so that when using this tool, the new 'Pipeline Optimisation Priority' setting
will default to 'Throughput'. This should reduce the length of end-to-end runs when using this tool.
Updated the layout of the Test List Coverage popup window for better visual alignment and clarity.
Updated the layout of the Exception Coverage popup window. Instead of meshing the tests and their exceptions
together in a tree view, the tests are now shown above the exceptions in a master-detail form. The overall
popup has been adjusted for better alignment/sizing and improved clarity.
Updated the selection bars throughout the NCrunch UI for a cleaner and more modern look.
Added a raw dump of settings with their values to the beginning of the trace log for the NCrunch Console Tool.
This should make it easier to establish which settings are being used by the tool when it runs.
Introduces several internal optimisations to improve the speed at which the processing queue can add and find tasks.
This should significantly reduce engine core load on solutions with many projects and tests.
Added ignored tests to the TeamCity output
Added reporting of ignored tests in Team City that were ignored manually or excluded via the engine settings.
------------------------------------
FIXES AND COMPATIBILITY IMPROVEMENTS
------------------------------------
Made significant internal modifications to the behaviour of NCrunch's test pipeline and processing queue to
resolve a broad range of problems related to tasks being updated inside the queue. This should resolve many
small and infrequent but annoying problems with the following symptoms:
- Tests sometimes not being run when they should be
- Tests not being run with the correct priority/sequence
- Tests not being grouped optimally
- Test atomicity not being respected
- Suboptimal performance
Added an error message when running the console tool without the NCrunchCacheStoragePath configuration set. This
option always should be set when using the console tool under a CI system for the console tool to function
properly between different runs.
Fixed an issue where multi-targeted netstandard projects could be resolved incorrectly when referenced by projects
targeting other platforms.
Improved TeamCity test name reporting for tests that use DistributeByCapabilities, TestCases, Multi Framework
Targeting and Shared Projects.
Fixed the current window losing focus when hovering over a coverage marker in an undocked window that doesn't
have focus
Fixed broken rendering on the far right side of the tree grid control column headers.
Adjusted the rendering of test names in the UI so they don't show the empty (in ) when the test has no namespace.
Adjusted the colours used for the status values in the Distributed Processing Window to improve visibility in
certain scenarios.
Fixed an issue that could cause exceptions to be thrown in NCrunch's coverage tracking.
Fixed incorrect icons showing on some of the configuration model dialogs.
Updated the error message given for a failed MSBuild restore of Nuget packages required for normal operation of
NCrunch. The previous error message did not mention that this might not be a critical error. The new message
gives a better explanation of the problem.
Fixed an issue where the exception tooltips weren't rendering correctly in some multi-monitor scenarios.
Fixed coverage markers for projects that have PathMap set.
Fixed a performance problem that could cause the engine to lock up for long periods of time when working with
solutions containing many interdependent projects.
Fixed current undocked editor window losing focus when hovering over a coverage marker.
Fixed an issue where tests targeted by churn mode could have their coverage results overridden by concurrently
executed passing test runs after they failed during the churn.
Fixed an issue where MSTest DataRow tests using a null value as the second parameter would cause an NCrunch
exception when using static analysis.
Fixed an issue where churn mode target failure results could be accidentally overwritten by the engine with passing
results in scenarios with high concurrency.
*****
This version of NCrunch is compatible with grid node servers from v3.14 and v3.13. Older grid nodes
must be updated before they can be used with this version.
*****
------------------------------------
NEW FEATURES
------------------------------------
Introduced a new configuration setting, 'Pipeline Optimisation Priority'. This setting controls the behaviour
of NCrunch when placing tests in the pipeline. When set to 'Responsiveness' (the default value), NCrunch will
prioritise tests to try and get the fastest and most relevant results as quickly as possible. When set to
'Throughput', NCrunch will arrange tests in the pipeline to try and minimise the overall execution time of the
pipeline. This should allow NCrunch to be configured to reduce the end-to-end running time of the test suite
when placed into a CI system with the console tool.
Adjusted the NCrunch Console Tool so that when using this tool, the new 'Pipeline Optimisation Priority' setting
will default to 'Throughput'. This should reduce the length of end-to-end runs when using this tool.
Updated the layout of the Test List Coverage popup window for better visual alignment and clarity.
Updated the layout of the Exception Coverage popup window. Instead of meshing the tests and their exceptions
together in a tree view, the tests are now shown above the exceptions in a master-detail form. The overall
popup has been adjusted for better alignment/sizing and improved clarity.
Updated the selection bars throughout the NCrunch UI for a cleaner and more modern look.
Added a raw dump of settings with their values to the beginning of the trace log for the NCrunch Console Tool.
This should make it easier to establish which settings are being used by the tool when it runs.
Introduces several internal optimisations to improve the speed at which the processing queue can add and find tasks.
This should significantly reduce engine core load on solutions with many projects and tests.
Added ignored tests to the TeamCity output
Added reporting of ignored tests in Team City that were ignored manually or excluded via the engine settings.
------------------------------------
FIXES AND COMPATIBILITY IMPROVEMENTS
------------------------------------
Made significant internal modifications to the behaviour of NCrunch's test pipeline and processing queue to
resolve a broad range of problems related to tasks being updated inside the queue. This should resolve many
small and infrequent but annoying problems with the following symptoms:
- Tests sometimes not being run when they should be
- Tests not being run with the correct priority/sequence
- Tests not being grouped optimally
- Test atomicity not being respected
- Suboptimal performance
Added an error message when running the console tool without the NCrunchCacheStoragePath configuration set. This
option always should be set when using the console tool under a CI system for the console tool to function
properly between different runs.
Fixed an issue where multi-targeted netstandard projects could be resolved incorrectly when referenced by projects
targeting other platforms.
Improved TeamCity test name reporting for tests that use DistributeByCapabilities, TestCases, Multi Framework
Targeting and Shared Projects.
Fixed the current window losing focus when hovering over a coverage marker in an undocked window that doesn't
have focus
Fixed broken rendering on the far right side of the tree grid control column headers.
Adjusted the rendering of test names in the UI so they don't show the empty (in ) when the test has no namespace.
Adjusted the colours used for the status values in the Distributed Processing Window to improve visibility in
certain scenarios.
Fixed an issue that could cause exceptions to be thrown in NCrunch's coverage tracking.
Fixed incorrect icons showing on some of the configuration model dialogs.
Updated the error message given for a failed MSBuild restore of Nuget packages required for normal operation of
NCrunch. The previous error message did not mention that this might not be a critical error. The new message
gives a better explanation of the problem.
Fixed an issue where the exception tooltips weren't rendering correctly in some multi-monitor scenarios.
Fixed coverage markers for projects that have PathMap set.
Fixed a performance problem that could cause the engine to lock up for long periods of time when working with
solutions containing many interdependent projects.
Fixed current undocked editor window losing focus when hovering over a coverage marker.
Fixed an issue where tests targeted by churn mode could have their coverage results overridden by concurrently
executed passing test runs after they failed during the churn.
Fixed an issue where MSTest DataRow tests using a null value as the second parameter would cause an NCrunch
exception when using static analysis.
Fixed an issue where churn mode target failure results could be accidentally overwritten by the engine with passing
results in scenarios with high concurrency.
Only for V.I.P Warning! You are not allowed to view this text.