dcpanda80 / ci-factory

Automatically exported from code.google.com/p/ci-factory
0 stars 0 forks source link

Using Heavy and Release builds messes up Analytics package metrics #62

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
What steps will reproduce the problem?

1. Create separate Heavy and Release builds for a project (using the 
Labeller trick described by Jay in another post 
to align the build labels; not sure if this is related to the issue or 
not).
2. Include the Analytics package in 2 or more types of builds.
3. Run all types of builds.
4. Although the "Recent Builds" section of the build report (for each 
build) correctly shows only the builds of the same type, notice that the 
trend charts and build table on the Analytics report (of a specific build) 
include the data/metrics from multiple types of builds, and not just the 
data for builds of the same type.

I was planning to run the analytics in multiple builds, 
because different builds are going to have different numbers of unit 
tests, test coverage, etc. So I thought it would be nice to be able to 
see unit test count and coverage trends for each build. 

Plus, for the release builds, I thought it would be nice that the 
analytics would shows only the "release" builds as data points, so 
that I could easily see release by release how the different analytics 
changed (i.e. so that each release has the same "weight" in the trend 
regardless of the number of intermediate builds in that release 
cycle). 

However, this issue prevents that kind of usage.

Also see this thread for details:
http://groups.google.com/group/CI-
Factory/browse_thread/thread/5ae7bd5f1e2096d6

Original issue reported on code.google.com by justin.w...@gmail.com on 16 Mar 2009 at 9:01