[ros-dev] Fwd: buildbot failure in ReactOS on Windows_AMD64_1 VBox-Test

It seems that any crash in APITESTS on vbox testbot is causing
rosautotest to redo from start. We can see this in stdio log:
http://build.reactos.org/builders/Windows_AMD64_1%20VBox-Test/builds/6323/s…
(just search for "restarting" word). APITESTS are repated and such log
as a whole is messing up testman, which is treating it like two
submissions for the same revision. It accepts the first one (incomplete
due to crash) and rejects the second one, reporting a duplicate: "ERROR!
submit(13111, 518, ...) - We already have a result for this test suite
in this test run! "Windows_AMD64_1 VBox-Test""

As we all know, we should expect tests to fail and even crash (this is
what they are designed for), hence the error is in rosautotest and
testman.

Rosautotest, strangely, is affected only on vbox, on kvm the apitest
crash is not causing a restart of test run. Winetests, if i recall
correctly, were never affected in such way.

Testman should not reject a submission after its saved up and revision -
blocked.

I am aware that some will be tempted to comment out the test in
question, but this is not a proper solution to this situation. Other
apitest will crash in the future, bringing the whole thing back. Same as
with regressions, lack of tests due to such issue, will bite us back in
the future, when least expected and most needed. This is why I humbly
request this issue to be solved properly, once and for all.

With best regards

----- Original message -----
From: buildbot(a)reactos.org
To: caemyr(a)myopera.com
Subject: buildbot failure in ReactOS on Windows_AMD64_1 VBox-Test
Date: Tue, 14 Aug 2012 00:23:24 +0000

The Buildbot has finished a build on builder Windows_AMD64_1 VBox-Test
while building ReactOS.
Full details are available at:
 http://build.reactos.org/builders/Windows_AMD64_1%20VBox-Test/builds/6324

Buildbot URL: http://build.reactos.org/

Buildslave for this Build: Windows_AMD64_2

Build Reason: Triggerable(Windows_AMD64_1 VBox-Test Trigger)
Build Source Stamp: 57075
Blamelist: akhaldi

BUILD FAILED: failed Cleanup

sincerely,
 -The Buildbot



-- 
With best regards
Caemyr