I feel that some things really need to be clearly explained, regarding apps being use to test releases with. At the moment, despite numerous attempts, i failed to find who (if anyone) is responsible for compiling and maintaining the list of apps used for release version testing. Especially, the non-downloader stuff section is basically changing completely with every release, making those tests virtually pointless, if we cant keep any consistency. On the other hand, looks like no one is responsible for maintaining Downloader app list. Without such responsibilites set, we are slipping into disorganisation, which is both confusing and uproductive. Clear policies should be set and observed in this matter, taking care of such basic thing as adding/linking/opening a bug report for an app that failed in release Test. I feel that testers have more productive things to do, than cleaning up/sorting test entries, incorrectly made up by first timers. Sorry if anyone feels this post to sound harsh, but its still really gentle and kind, compared to obscenities, curses and swears others have to put up, when i vent out after seeing the current state of Release testing wiki.
Why don't you take control of this area then?
From: ros-dev-bounces@reactos.org [mailto:ros-dev-bounces@reactos.org] On Behalf Of Olaf Siejka Sent: 25 April 2009 12:36 To: Ros-dev@reactos.org Subject: [ros-dev] Release testing apps list issues
I feel that some things really need to be clearly explained, regarding apps being use to test releases with.
At the moment, despite numerous attempts, i failed to find who (if anyone) is responsible for compiling and maintaining the list of apps used for release version testing. Especially, the non-downloader stuff section is basically changing completely with every release, making those tests virtually pointless, if we cant keep any consistency. On the other hand, looks like no one is responsible for maintaining Downloader app list. Without such responsibilites set, we are slipping into disorganisation, which is both confusing and uproductive. Clear policies should be set and observed in this matter, taking care of such basic thing as adding/linking/opening a bug report for an app that failed in release Test. I feel that testers have more productive things to do, than cleaning up/sorting test entries, incorrectly made up by first timers.
Sorry if anyone feels this post to sound harsh, but its still really gentle and kind, compared to obscenities, curses and swears others have to put up, when i vent out after seeing the current state of Release testing wiki.
I agree with Olaf, if everyone adds their own bits to the list, we are never going to release even 0.3.9, not to say 1.0. Things must be prioritized. And if e.g. Lmarbles doesn't work, it may be considered of a very low priority, and just excluded from the downloader list.
In my opinion, we should maintain a "Golden apps" list, which are known to work in ReactOS, and mandatory test them during every release cycle. If anyone of them is regressed - release won't go. If any other app out of the list regressed - it's not a blocker and we move on.
Now, to the question who maintains the golden apps list. I think developers, and certainly listening to testers. But not everyone at once adding their favorites apps as it happened now with 0.3.9 testing wikipage, and what made Olaf (and me) furious.
This is especially important if we are going to shrink release cycle further, and make release process smooth and fast, like it is supposed to be for our development status.
WBR, Aleksey Bragin.
On Apr 25, 2009, at 3:35 PM, Olaf Siejka wrote:
I feel that some things really need to be clearly explained, regarding apps being use to test releases with. At the moment, despite numerous attempts, i failed to find who (if anyone) is responsible for compiling and maintaining the list of apps used for release version testing. Especially, the non- downloader stuff section is basically changing completely with every release, making those tests virtually pointless, if we cant keep any consistency. On the other hand, looks like no one is responsible for maintaining Downloader app list. Without such responsibilites set, we are slipping into disorganisation, which is both confusing and uproductive. Clear policies should be set and observed in this matter, taking care of such basic thing as adding/ linking/opening a bug report for an app that failed in release Test. I feel that testers have more productive things to do, than cleaning up/sorting test entries, incorrectly made up by first timers. Sorry if anyone feels this post to sound harsh, but its still really gentle and kind, compared to obscenities, curses and swears others have to put up, when i vent out after seeing the current state of Release testing wiki.
-
Aleksey Bragin -
Ged -
Olaf Siejka