Blacklisted Tests in Testman

[victor martinez]

Hi guyz!
I've been reviewing our current Blacklisted suites at Testman. A lot of those unstable
testsuites now are reliable, maybe because ReactOS stability has increased or better
Winetests.

The following blacklisted suites in the past should go into whitelist:
Gdi32:SetMapMode. Now scores: 51-0
Gdi32:SetSysColors. Now scores: 44-0
Gdiplus:graphicspath. Now scores: 434-32
Gdiplus:region. Now scores: 803-6
Kernel32:pipe. Now scores: 33895-124
user32:trackmouseevent. Now scores: 177-12
wininet:urlcache. Now scores: 186-16

The following suites look reliable but from time to time they score different.So they
should be kept as Blacklisted:
user32:msg 
user32:win 

In the other hand two new candidates should go into Blacklisted:
msxml3:domdoc
ntdll:info

Not bad, 7 to whitelist, 2 almost reliable and just 2 into Blacklist.
My proposal is to update the lists and check during the following days that these new
changes are reliable.
If testsuites are a sign of stability, I should say..ReactOS is really stable. Bugged as
always.But stable. :)

[Pierre Schweitzer]

Hi,

if people agree on this choice, I can update testman blacklist.

Just ask.

With my best regards,

On 03/14/2013 05:15 PM, victor martinez wrote:
>   Hi guyz!
>  I've been reviewing our current Blacklisted suites at Testman. A lot 
>  of those unstable testsuites now are reliable, maybe because ReactOS 
>  stability has increased or better Winetests.
>
>  The following blacklisted suites in the past should go into whitelist:
>  Gdi32:SetMapMode. Now scores: 51-0
>  Gdi32:SetSysColors. Now scores: 44-0
>  Gdiplus:graphicspath. Now scores: 434-32
>  Gdiplus:region. Now scores: 803-6
>  Kernel32:pipe. Now scores: 33895-124
>  user32:trackmouseevent. Now scores: 177-12
>  wininet:urlcache. Now scores: 186-16
>
>  The following suites look reliable but from time to time they score 
>  different.So they should be kept as Blacklisted:
>  user32:msg
>  user32:win
>
>  In the other hand two new candidates should go into Blacklisted:
>  msxml3:domdoc
>  ntdll:info
>
>  Not bad, 7 to whitelist, 2 almost reliable and just 2 into Blacklist.
>  My proposal is to update the lists and check during the following days 
>  that these new changes are reliable.
>  If testsuites are a sign of stability, I should say..ReactOS is really 
>  stable. Bugged as always.But stable. :)
>
>
>
>
>  _______________________________________________
>  Ros-dev mailing list
>  Ros-dev(a)reactos.org
>  http://www.reactos.org/mailman/listinfo/ros-dev 

-- 
Pierre Schweitzer<pierre(a)reactos.org>
System Administrator
ReactOS Foundation

[Giannis Adamopoulos]

I also agree that the blacklist should be updatedd

ReactOS Development List <ros-dev(a)reactos.org> wrote on Fri, March 15th, 2013, 8:35
AM:
>   Hi,
>  
>  if people agree on this choice, I can update testman blacklist.
>  
>  Just ask.
>  
>  With my best regards,
>  
>  On 03/14/2013 05:15 PM, victor martinez wrote:
>  > Hi guyz!
>  > I've been reviewing our current Blacklisted suites at Testman. A lot 
>  > of those unstable testsuites now are reliable, maybe because ReactOS 
>  > stability has increased or better Winetests.
>  >
>  > The following blacklisted suites in the past should go into whitelist:
>  > Gdi32:SetMapMode. Now scores: 51-0
>  > Gdi32:SetSysColors. Now scores: 44-0
>  > Gdiplus:graphicspath. Now scores: 434-32
>  > Gdiplus:region. Now scores: 803-6
>  > Kernel32:pipe. Now scores: 33895-124
>  > user32:trackmouseevent. Now scores: 177-12
>  > wininet:urlcache. Now scores: 186-16
>  >
>  > The following suites look reliable but from time to time they score 
>  > different.So they should be kept as Blacklisted:
>  > user32:msg
>  > user32:win
>  >
>  > In the other hand two new candidates should go into Blacklisted:
>  > msxml3:domdoc
>  > ntdll:info
>  >
>  > Not bad, 7 to whitelist, 2 almost reliable and just 2 into Blacklist.
>  > My proposal is to update the lists and check during the following days 
>  > that these new changes are reliable.
>  > If testsuites are a sign of stability, I should say..ReactOS is really 
>  > stable. Bugged as always.But stable. :)
>  >
>  >
>  >
>  >
>  > _______________________________________________
>  > Ros-dev mailing list
>  > Ros-dev(a)reactos.org
>  > http://www.reactos.org/mailman/listinfo/ros-dev

[Pierre Schweitzer]

Hi,

the blacklist has been updated regarding your input Giannis.

Three tests that were in blacklist (urlmon:url, gdiplus:graphics and 
ws2_32:sock) have been left in blacklist.

With my best regards,

On 03/16/2013 10:51 AM, Giannis Adamopoulos wrote:
>   I also agree that the blacklist should be updatedd
>
>  ReactOS Development List<ros-dev(a)reactos.org>  wrote on Fri, March 15th, 2013, 8:35
> AM:
> >   Hi,
> >
> >  if people agree on this choice, I can update testman blacklist.
> >
> >  Just ask.
> >
> >  With my best regards,
> >
> >  On 03/14/2013 05:15 PM, victor martinez wrote:
> > > Hi guyz!
> > > I've been reviewing our current Blacklisted suites at Testman. A lot
> > > of those unstable testsuites now are reliable, maybe because ReactOS
> > > stability has increased or better Winetests.
> > >
> > > The following blacklisted suites in the past should go into whitelist:
> > > Gdi32:SetMapMode. Now scores: 51-0
> > > Gdi32:SetSysColors. Now scores: 44-0
> > > Gdiplus:graphicspath. Now scores: 434-32
> > > Gdiplus:region. Now scores: 803-6
> > > Kernel32:pipe. Now scores: 33895-124
> > > user32:trackmouseevent. Now scores: 177-12
> > > wininet:urlcache. Now scores: 186-16
> > >
> > > The following suites look reliable but from time to time they score
> > > different.So they should be kept as Blacklisted:
> > > user32:msg
> > > user32:win
> > >
> > > In the other hand two new candidates should go into Blacklisted:
> > > msxml3:domdoc
> > > ntdll:info
> > >
> > > Not bad, 7 to whitelist, 2 almost reliable and just 2 into Blacklist.
> > > My proposal is to update the lists and check during the following days
> > > that these new changes are reliable.
> > > If testsuites are a sign of stability, I should say..ReactOS is really
> > > stable. Bugged as always.But stable. :)
> > >
> > >
> > >
> > >
> > > _______________________________________________
> > > Ros-dev mailing list
> > > Ros-dev(a)reactos.org
> > > http://www.reactos.org/mailman/listinfo/ros-dev 
> _______________________________________________
>  Ros-dev mailing list
>  Ros-dev(a)reactos.org
>  http://www.reactos.org/mailman/listinfo/ros-dev 

-- 
Pierre Schweitzer<pierre(a)reactos.org>
System Administrator
ReactOS Foundation