Recent horrid slowdown

[Phillip Susi]

About a week or two ago usetup took about 20 seconds on my system under
qemu to copy over the installation files.  I thought even that seemed a
bit slow, so I started rewriting the code to use memory mapped files to
see if I could speed it up.  Now that I finished with it, I noticed that
the current code in the repository now takes just over 90 seconds to
install the files, which my changes reduce back down to 20 seconds.
Does anyone have any idea about what revision this huge slowdown was
introduced in?  I'll try and figure out the problem tonight but it would
help if someone could point me towards the vicinity of it now so I don't
have to spend time looking when I get home.
I'd like to get the normal code back to it's former 20 second install
area so I can get a good comparison with my new code.  I'd be thrilled
if it then could get the install times down to 10 seconds.

[WaxDragon]

Phillip, I went all the way back to 13989, and it acts the same for
me.  (QEMU w/64M)
On 5/18/05, Phillip Susi <psusi(a)cfl.rr.com> wrote:
>   About a week or two ago usetup took about 20 seconds
> on my system under
>  qemu to copy over the installation files.  I thought even that seemed a
>  bit slow, so I started rewriting the code to use memory mapped files to
>  see if I could speed it up.  Now that I finished with it, I noticed that
>  the current code in the repository now takes just over 90 seconds to
>  install the files, which my changes reduce back down to 20 seconds.
>  Does anyone have any idea about what revision this huge slowdown was
>  introduced in?  I'll try and figure out the problem tonight but it would
>  help if someone could point me towards the vicinity of it now so I don't
>  have to spend time looking when I get home.
>  I'd like to get the normal code back to it's former 20 second install
>  area so I can get a good comparison with my new code.  I'd be thrilled
>  if it then could get the install times down to 10 seconds.
>  _______________________________________________
>  Ros-dev mailing list
>  Ros-dev(a)reactos.com
>  http://reactos.com:8080/mailman/listinfo/ros-dev
>   
--
"<arty> the tree was touched a lot recently"

[Phillip Susi]

Really?  That is really strange.  I'm 98% sure that up until maybe a
week or two ago, it took me around 20 seconds for the file copy portion
of setup to complete under qemu with 32 megs of ram and now it takes
around 90 seconds.
Has anyone else noticed this or am I just crazy?
WaxDragon wrote:
>  Phillip, I went all the way back to 13989, and it acts
> the same for
> me.  (QEMU w/64M)
> On 5/18/05, Phillip Susi <psusi(a)cfl.rr.com> wrote:
> >  About a week or two ago usetup took about 20
> > seconds on my system under
> > qemu to copy over the installation files.  I thought even that seemed a
> > bit slow, so I started rewriting the code to use memory mapped files to
> > see if I could speed it up.  Now that I finished with it, I noticed that
> > the current code in the repository now takes just over 90 seconds to
> > install the files, which my changes reduce back down to 20 seconds.
> > Does anyone have any idea about what revision this huge slowdown was
> > introduced in?  I'll try and figure out the problem tonight but it would
> > help if someone could point me towards the vicinity of it now so I don't
> > have to spend time looking when I get home.
> > I'd like to get the normal code back to it's former 20 second install
> > area so I can get a good comparison with my new code.  I'd be thrilled
> > if it then could get the install times down to 10 seconds.
> > _______________________________________________
> > Ros-dev mailing list
> > Ros-dev(a)reactos.com
> > http://reactos.com:8080/mailman/listinfo/ros-dev
> >  
>

[WaxDragon]

I tested around 8 bootcds today all the way back to 13989.  They all
ran about 90 seconds, give or take.
Are you using kqemu or anything?
On 5/18/05, Phillip Susi <psusi(a)cfl.rr.com> wrote:
>   Really?  That is really strange.  I'm 98% sure
> that up until maybe a
>  week or two ago, it took me around 20 seconds for the file copy portion
>  of setup to complete under qemu with 32 megs of ram and now it takes
>  around 90 seconds.
>  Has anyone else noticed this or am I just crazy?
>  WaxDragon wrote:
> >  Phillip, I went all the way back to 13989, and it
> > acts the same for
> > me.  (QEMU w/64M)
> > On 5/18/05, Phillip Susi <psusi(a)cfl.rr.com> wrote:
> > >  About a week or two ago usetup took about 20
> > > seconds on my system under
> > > qemu to copy over the installation files.  I thought even that seemed a
> > > bit slow, so I started rewriting the code to use memory mapped files to
> > > see if I could speed it up.  Now that I finished with it, I noticed that
> > > the current code in the repository now takes just over 90 seconds to
> > > install the files, which my changes reduce back down to 20 seconds.
> > > Does anyone have any idea about what revision this huge slowdown was
> > > introduced in?  I'll try and figure out the problem tonight but it would
> > > help if someone could point me towards the vicinity of it now so I don't
> > > have to spend time looking when I get home.
> > > I'd like to get the normal code back to it's former 20 second install
> > > area so I can get a good comparison with my new code.  I'd be thrilled
> > > if it then could get the install times down to 10 seconds.
> > > _______________________________________________
> > > Ros-dev mailing list
> > > Ros-dev(a)reactos.com
> > > http://reactos.com:8080/mailman/listinfo/ros-dev
> > >  
> >  
>  _______________________________________________
>  Ros-dev mailing list
>  Ros-dev(a)reactos.com
>  http://reactos.com:8080/mailman/listinfo/ros-dev
>   
--
"<arty> the tree was touched a lot recently"

[Hartmut Birr]

Hi,
since some days, we have a memory leakage. Make clean on a clean source
tree results in 175000 non paged pool blocks with the tag None and a
size of 30MB.
- Hartmut
Phillip Susi wrote:
>   Really?  That is really strange.  I'm 98% sure
> that up until maybe a
>  week or two ago, it took me around 20 seconds for the file copy
>  portion of setup to complete under qemu with 32 megs of ram and now it
>  takes around 90 seconds.
>  Has anyone else noticed this or am I just crazy?
>  WaxDragon wrote:
> >   Phillip, I went all the way back to 13989, and it
> > acts the same for
> >  me.  (QEMU w/64M)
> >  On 5/18/05, Phillip Susi <psusi(a)cfl.rr.com> wrote:
> > >   About a week or two ago usetup took about 20
> > > seconds on my system under
> > >  qemu to copy over the installation files.  I thought even that seemed a
> > >  bit slow, so I started rewriting the code to use memory mapped files to
> > >  see if I could speed it up.  Now that I finished with it, I noticed
> > >  that
> > >  the current code in the repository now takes just over 90 seconds to
> > >  install the files, which my changes reduce back down to 20 seconds.
> > >  Does anyone have any idea about what revision this huge slowdown was
> > >  introduced in?  I'll try and figure out the problem tonight but it
> > >  would
> > >  help if someone could point me towards the vicinity of it now so I
> > >  don't
> > >  have to spend time looking when I get home.
> > >  I'd like to get the normal code back to it's former 20 second install
> > >  area so I can get a good comparison with my new code.  I'd be thrilled
> > >  if it then could get the install times down to 10 seconds.
> > >  _______________________________________________
> > >  Ros-dev mailing list
> > >  Ros-dev(a)reactos.com
> > >  http://reactos.com:8080/mailman/listinfo/ros-dev
> > >     
> >  
>  _______________________________________________
>  Ros-dev mailing list
>  Ros-dev(a)reactos.com
>  http://reactos.com:8080/mailman/listinfo/ros-dev
>

[WaxDragon]

(Alex's mail is down)
Phillip Susi wrote:
>   About a week or two ago usetup took about 20 seconds
> on my system under qemu to copy over the installation files.  I thought even that seemed a
> bit slow, so I started rewriting the code to use memory mapped files to see if I could
> speed it up.  Now that I finished with it, I noticed that the current code in the
> repository now takes just over 90 seconds to install the files, which my changes reduce
> back down to 20 seconds.
>  Does anyone have any idea about what revision this huge slowdown was introduced in?
> I'll try and figure out the problem tonight but it would help if someone could point
> me towards the vicinity of it now so I don't have to spend time looking when I get
> home.
>  I'd like to get the normal code back to it's former 20 second install area so I
> can get a good comparison with my new code.  I'd be thrilled if it then could get the
> install times down to 10 seconds.
>  
What happened is that you either:
1) Enabled debugging in usetup (you didn't, didn't you? I remember on
the IRC...)
and/or
2) Reduced qemu's memory to 64MB.
At least both WD and I thought there was a slowdown as well.... like I
reported to you. But I noticed that it was because I had reduced the
memory. Upgrading it back to 128MB made usetup take like 10 seconds.
If anything, it means your patch greatly reduces memory usage and is
much more efficient. Try it with debugging off and 128MB.
Best regards,
Alex Ionescu