Release testing apps list issues

[Olaf Siejka]

I feel that some things really need to be clearly explained, regarding apps
being use to test releases with.
At the moment, despite numerous attempts, i failed to find who (if anyone)
is responsible for compiling and maintaining the list of apps used for
release version testing. Especially, the non-downloader stuff section is
basically changing completely with every release, making those tests
virtually pointless, if we cant keep any consistency. On the other hand,
looks like no one is responsible for maintaining Downloader app list.
Without such responsibilites set, we are slipping into disorganisation,
which is both confusing and uproductive. Clear policies should be set and
observed in this matter, taking care of such basic thing as
adding/linking/opening a bug report for an app that failed in release Test.
I feel that testers have more productive things to do, than cleaning
up/sorting test entries, incorrectly made up by first timers.
Sorry if anyone feels this post to sound harsh, but its still really gentle
and kind, compared to obscenities, curses and swears others have to put up,
when i vent out after seeing the current state of Release testing wiki.

[Ged]

Why don't you take control of this area then?

 

From: ros-dev-bounces(a)reactos.org [mailto:[e-mail]] On
Behalf Of Olaf Siejka
Sent: 25 April 2009 12:36
To: Ros-dev(a)reactos.org
Subject: [ros-dev] Release testing apps list issues

 

I feel that some things really need to be clearly explained, regarding apps
being use to test releases with.

At the moment, despite numerous attempts, i failed to find who (if anyone)
is responsible for compiling and maintaining the list of apps used for
release version testing. Especially, the non-downloader stuff section is
basically changing completely with every release, making those tests
virtually pointless, if we cant keep any consistency. On the other hand,
looks like no one is responsible for maintaining Downloader app list.
Without such responsibilites set, we are slipping into disorganisation,
which is both confusing and uproductive. Clear policies should be set and
observed in this matter, taking care of such basic thing as
adding/linking/opening a bug report for an app that failed in release Test.
I feel that testers have more productive things to do, than cleaning
up/sorting test entries, incorrectly made up by first timers.

Sorry if anyone feels this post to sound harsh, but its still really gentle
and kind, compared to obscenities, curses and swears others have to put up,
when i vent out after seeing the current state of Release testing wiki.

[Aleksey Bragin]

I agree with Olaf, if everyone adds their own bits to the list, we  
are never going to release even 0.3.9, not to say 1.0. Things must be  
prioritized. And if e.g. Lmarbles doesn't work, it may be considered  
of a very low priority, and just excluded from the downloader list.

In my opinion, we should maintain a "Golden apps" list, which are  
known to work in ReactOS, and mandatory test them during every  
release cycle. If anyone of them is regressed - release won't go. If  
any other app out of the list regressed - it's not a blocker and we  
move on.

Now, to the question who maintains the golden apps list. I think  
developers, and certainly listening to testers. But not everyone at  
once adding their favorites apps as it happened now with 0.3.9  
testing wikipage, and what made Olaf (and me) furious.

This is especially important if we are going to shrink release cycle  
further, and make release process smooth and fast, like it is  
supposed to be for our development status.


WBR,
Aleksey Bragin.


On Apr 25, 2009, at 3:35 PM, Olaf Siejka wrote:

>   I feel that some things really need to be clearly
> explained,  
>  regarding apps being use to test releases with.
>  At the moment, despite numerous attempts, i failed to find who (if  
>  anyone) is responsible for compiling and maintaining the list of  
>  apps used for release version testing. Especially, the non- 
>  downloader stuff section is basically changing completely with  
>  every release, making those tests virtually pointless, if we cant  
>  keep any consistency. On the other hand, looks like no one is  
>  responsible for maintaining Downloader app list. Without such  
>  responsibilites set, we are slipping into disorganisation, which is  
>  both confusing and uproductive. Clear policies should be set and  
>  observed in this matter, taking care of such basic thing as adding/ 
>  linking/opening a bug report for an app that failed in release  
>  Test. I feel that testers have more productive things to do, than  
>  cleaning up/sorting test entries, incorrectly made up by first timers.
>  Sorry if anyone feels this post to sound harsh, but its still  
>  really gentle and kind, compared to obscenities, curses and swears  
>  others have to put up, when i vent out after seeing the current  
>  state of Release testing wiki.