[Fwd: [Fwd: [ros-svn] [hbirr] 13963: Lock the kernel address space - Bug 512 updated]

[Gge]

WARNING: This e-mail has been altered by MIMEDefang.  Following this
paragraph are indications of the actual changes made.  For more
information about your site's MIMEDefang policy, contact
MIMEDefang Administrator <mimedefang(a)deos.tudelft.nl>nl>.  For more information about
MIMEDefang, see:

            http://www.roaringpenguin.com/mimedefang/enduser.php3

An attachment of type message/rfc822, named [ros-svn] [hbirr] 13963: Lock the kernel
address space instead the	process'one, if the pages are located in kernel space. was
removed from this document as it
constituted a security hazard.  If you require this document, please contact
the sender and arrange an alternate means of receiving it.

[Hartmut Birr]

Hi,

I seems that the non paged pool is out. Can you enable some debug
messages for the non paged pool?

- Hartmut





M:\Sandbox\ros_clean\reactos>set SVN_EDITOR=notepad 

M:\Sandbox\ros_clean\reactos>d:\programme\subversion\bin\svn.exe diff ntoskrnl        
Index: ntoskrnl/include/config.h
===================================================================
--- ntoskrnl/include/config.h	(revision 14004)
+++ ntoskrnl/include/config.h	(working copy)
@@ -19,7 +19,7 @@
 #undef ENABLE_VALIDATE_POOL
 
 /* Enable tracking of statistics about the tagged blocks in the pool */
-#undef TAG_STATISTICS_TRACKING
+#define TAG_STATISTICS_TRACKING
 
 /*
  * Put each block in its own range of pages and position the block at the
Index: ntoskrnl/mm/npool.c
===================================================================
--- ntoskrnl/mm/npool.c	(revision 14004)
+++ ntoskrnl/mm/npool.c	(working copy)
@@ -1579,7 +1579,7 @@
 
    VALIDATE_POOL;
 
-#if 0
+#if 1
    /* after some allocations print the npaged pool stats */
 #ifdef TAG_STATISTICS_TRACKING
 
Index: ntoskrnl/mm/pool.c
===================================================================
--- ntoskrnl/mm/pool.c	(revision 14004)
+++ ntoskrnl/mm/pool.c	(working copy)
@@ -101,7 +101,7 @@
 
    Block = EiAllocatePool(PoolType,
                           NumberOfBytes,
-                          TAG_NONE,
+                          /*TAG_NONE*/__builtin_return_address(0),
                           (PVOID)__builtin_return_address(0));
 #elif defined(_MSC_VER)

[Gge]

Hartmut Birr wrote:

>   Hi,
>  
>  I seems that the non paged pool is out. Can you enable some debug
>  messages for the non paged pool?
>  
>  - Hartmut
>   
>   ------------------------------------------------------------------------
>  
>  M:\Sandbox\ros_clean\reactos>d:\programme\subversion\bin\svn.exe diff ntoskrnl       
>
>  Index: ntoskrnl/include/config.h
>  ===================================================================
>  --- ntoskrnl/include/config.h	(revision 14004)
>  +++ ntoskrnl/include/config.h	(working copy)
>  @@ -19,7 +19,7 @@
>   #undef ENABLE_VALIDATE_POOL
>   
>   /* Enable tracking of statistics about the tagged blocks in the pool */
>  -#undef TAG_STATISTICS_TRACKING
>  +#define TAG_STATISTICS_TRACKING
>   
>   /*
>    * Put each block in its own range of pages and position the block at the
>  Index: ntoskrnl/mm/npool.c
>  ===================================================================
>  --- ntoskrnl/mm/npool.c	(revision 14004)
>  +++ ntoskrnl/mm/npool.c	(working copy)
>  @@ -1579,7 +1579,7 @@
>   
>      VALIDATE_POOL;
>   
>  -#if 0
>  +#if 1
>      /* after some allocations print the npaged pool stats */
>   #ifdef TAG_STATISTICS_TRACKING
>   
>  Index: ntoskrnl/mm/pool.c
>  ===================================================================
>  --- ntoskrnl/mm/pool.c	(revision 14004)
>  +++ ntoskrnl/mm/pool.c	(working copy)
>  @@ -101,7 +101,7 @@
>   
>      Block = EiAllocatePool(PoolType,
>                             NumberOfBytes,
>  -                          TAG_NONE,
>  +                          /*TAG_NONE*/__builtin_return_address(0),
>                             (PVOID)__builtin_return_address(0));
>   #elif defined(_MSC_VER)
>   
>  ------------------------------------------------------------------------ 

Harmut,

I enabled the debug messages you proposed and compiled ntoskrnl.

1) There is a building failure

......
ntoskrnl: [CC]      mm/npool.c
ntoskrnl: [CC]      mm/pagfault.c
ntoskrnl: [CC]      mm/pagefile.c
ntoskrnl: [CC]      mm/pageop.c
ntoskrnl: [CC]      mm/pager.c
ntoskrnl: [CC]      mm/paging.c
ntoskrnl: [CC]      mm/pe.c
ntoskrnl: [CC]      mm/pool.c
mm/pool.c: In function `ExAllocatePool':
mm/pool.c:105: warning: passing arg 3 of `EiAllocatePool' makes integer 
from pointer without a cast
mingw32-make: *** [mm/pool.o] Error 1


2) Here is the modification done in pool.c file

#if defined(__GNUC__)

    Block = EiAllocatePool(PoolType,
                           NumberOfBytes,
                           /*TAG_NONE*/__builtin_return_address(0),
                           (PVOID)__builtin_return_address(0));
#elif defined(_MSC_VER)

3) So I let the line TAG_NONE and compiling was ok

4) Debug messages with the debug messages enabled partly.

(mm/mdl.c:898) UserMode mapping - returning 0x441000
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 65536 bytes from nonpaged pool - 
nothing suitable found, returning NULL
KeBugCheckWithTf at ke/catch.c:224
(int10.c:158) IntInt10CallBios
(int10.c:163) - Inp(NTDLL:ldr/utils.c:2092) Relocating (77ed0000 -> 
770000) C:\reactos\system32\gdi32.dll
ut register Eax: 4f02
(int10.c:165) - Input register Ebx: 3
(int10.c:167) - Input register Ecx: 0
(int10.c:169) - Input(NTDLL:ldr/utils.c:2092) Relocating (77ed0000 -> 
760000) C:\reactos\system32\gdi32.dll
(mm/npool.c:1626) Trying to allocate 25008 register Edx: 0
(int10.c:171) - Input register Esi: 0
(int10.c:173) - Input register Edi: 0
(int10.c:175) - Input register Ebp: 0
(int10.c:177) - Input register SegDs: 0
(int10.c:179) - Input register SegEs: 0
(KERNEL32:misc/console.c:595) GetCurrentConsoleFont(0xb, 0x0, 0x65fed 
bytes from nonpaged pool - nothing suitable found, returning NULL
(mm/pe.c:609) AllocateSegments failed
(NTDLL:ldr/utils.c:2034) Failed to create or open dll section of 
'wpcap.dll' (Status c000009a)
(NTDLL:ldr/utils.c:1364) fai(int10.c:158) IntInt10CallBios
(int10.c:163) - Input register Eax: 1112
(int10.c:165) - Input register Ebx: 0
(int10.c:167) - Input register Ecx: 0
(int10.c:169) - Input register Edx: 0
(int108) UNIMPLEMENTED!
(KERNEL32:misc/console.c:523) GetConsoleFontSize(0xb, 0x65fef8) 
UNIMPLEMENTED!
(KERNEL32:misc/console.c:2832) SetCled to load wpcap.dll
(NTDLL:ldr/utils.c:1826) failed to load wpcap.dll
(NTDLL:ldr/utils.c:1948) LdrFixupImports() failed for 
colinux-bridged-net-daemon.exe
(NTDLL:ldr/startup.c:459) Failed to initialize image
.c:171) - Input register Esi: 0
(int10.c:173) - Input register Edi: 0
(int10.c:175) - Input register Ebp: 0
(int10.c:177) - InpuonsoleWindowInfo(0xb, 0x1, 0x79189c) UNIMPLEMENTED!
(KERNEL32:misc/console.c:2693) SetConsoleScreenBufferSize(0x13, 
0x190050) UNIMPLEMENTED!
t register SegDs: 0
(int10.c:179) - Input register SegEs: 0
A problem has been detected and ReactOS has been shut down to prevent 
damage to your computer.

The problem seems to be caused by the following file: ntoskrnl.exe

KMODE_EXCEPTION_NOT_HANDLED


Technical information:

*** STOP: 0x0000001E (0xc0000005,0x8004daa9,0x00000000,0x00000064)

***    ntoskrnl.exe - Address 0x8004daa9 base at 0x80000000, DateStamp 0x0

Page Fault Exception: 14(2)
Processor: 0 CS:EIP 8:8004daa9 <ntoskrnl.exe:4daa9 (io/ioctrl.c:101 
(NtDeviceIoControlFile))>
cr2 64 cr3 cf9c000 Proc: 810401b8 Pid: 11c <colinux-> Thrd: 8104f050 
Tid: 120
DS 10 ES 10 FS 30 GS 23
EAX: 8106db10   EBX: 00000032   ECX: 00000000
EDX: 00000000   EBP: 9e9ecd44   ESI: 0064ad08   ESP: 9e9ecc84
EDI: 9e9ecd74   EFLAGS: 00010282 kESP 9e9ecc84 kernel stack base 9e9ea000
Frames:
<ntoskrnl.exe:3bf2 (C:\DOCUME~1\home\LOCALS~1\Temp/cc2bbaaa.s:178 
(KiSystemService))>
<kernel32.dll:2a4ca (file/deviceio.c:96 (DeviceIoControl))>

KeBugCheckWithTf at ke/catch.c:224
A problem has been detected and ReactOS has been shut down to prevent 
damage to your computer.

The problem seems to be caused by the following file: ntoskrnl.exe

KMODE_EXCEPTION_NOT_HANDLED


Technical information:

*** STOP: 0x0000001E (0x80000003,0x8000608f,0x00000000,0x00000000)

***    ntoskrnl.exe - Address 0x8000608f base at 0x80000000, DateStamp 0x0

Regards
Gerard

[Hartmut Birr]

Gge schrieb:

>  
>
>  2) Here is the modification done in pool.c file
>
>  #if defined(__GNUC__)
>
>     Block = EiAllocatePool(PoolType,
>                            NumberOfBytes,
>                            /*TAG_NONE*/__builtin_return_address(0),
>                            (PVOID)__builtin_return_address(0)); 
I've forgot a cast, '(ULONG) __builtin_return_address(0)' should work.

>  
>  (mm/mdl.c:898) UserMode mapping - returning 0x441000
>  (mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool -
>  nothing suitable found, returning NULL
>  (mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool -
>  nothing suitable found, returning NULL 
I hoped to see the dump from the memory statistic before or within this
lines. Can you add a bug check after line, 1626? This crashs ros and the
stack dump shows the caller of the allocation. Im not sure how much
memory colinux needs. If you start a clean windows with and without
colinux, you can compare the using of the non paged pool. The task
manager shows this value on the performance page as kernel  memory.

- Hartmut

[Gge]

Hartmut Birr wrote:
>   Gge schrieb:
>  
>  
> >  
> > 2) Here is the modification done in pool.c file
> >
> > #if defined(__GNUC__)
> >
> >    Block = EiAllocatePool(PoolType,
> >                           NumberOfBytes,
> >                           /*TAG_NONE*/__builtin_return_address(0),
> >                           (PVOID)__builtin_return_address(0)); 
>  
>  
>  I've forgot a cast, '(ULONG) __builtin_return_address(0)' should work.
>  
>  
> >  (mm/mdl.c:898) UserMode mapping - returning
> > 0x441000
> > (mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool -
> > nothing suitable found, returning NULL
> > (mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool -
> > nothing suitable found, returning NULL 
>  
>  
>  I hoped to see the dump from the memory statistic before or within this
>  lines. Can you add a bug check after line, 1626? This crashs ros and the
>  stack dump shows the caller of the allocation. Im not sure how much
>  memory colinux needs. If you start a clean windows with and without
>  colinux, you can compare the using of the non paged pool. The task
>  manager shows this value on the performance page as kernel  memory.
>  
>  - Hartmut
>  
>   

Harmut,

The non paged pool size required by Colinux in Windows is 1768 KB (12358 
- 10588 )

The mm/pool;c has been uptaded and ntosktnl.exe built ok ( without a 
bugcheck )
Please indicate how to add a bugcheck and I 'll do the test gain.

Here are the debug messages.


(ndis/io.c:70)(HandleDeferredProcessing) Leaving.
(NTDLL:ldr/utils.c:2092) Relocating (77e60000 -> 760000) 
C:\reactos\system32\user32.dll
(mm/mdl.c:898) UserMode mapping - returning 0x441000
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 262144 bytes from nonpaged pool - 
nothing suitable found, returning NULL
(mm/npool.c:1626) Trying to allocate 65536 bytes from nonpaged pool - 
nothing suit(NTDLL:ldr/utils.c:2092) Relocating (77ed0000 -> 770000) 
C:\reactos\system32\gdi32.dll
able found, returning NULL
KeBugCheckWithTf at ke/catch.c:224
(int10.c:158) IntInt10CallBios
(int10.c:163) - Input re(NTDLL:ldr/utils.c:2092) Relocating (77ed0000 -> 
760000) C:\reactos\system32\gdi32.dll
(mm/npool.c:1626) Trying to allocate 25008 bytes gister Eax: 4f02
(int10.c:165) - Input register Ebx: 3
(int10.c:167) - Input register Ecx: 0
(int10.c:169) - Input register Edx: 0
(int10.c:171) - Input register Esi: 0
(int10.c:173) - Input register Edi: 0
(int10.c:175) - I(KERNEL32:misc/console.c:595) 
GetCurrentConsoleFont(0xb, 0x0, 0x65ffrom nonpaged pool - nothing 
suitable found, returning NULL
(mm/pe.c:609) AllocateSegments failed
(NTDLL:ldr/utils.c:2034) Failed to create or open dll section of 
'wpcap.dll' (Status c000009a)
(NTDLL:ldr/utils.c:1364) failed to nput register Ebp: 0
(int10.c:177) - Input register SegDs: 0
(int10.c:179) - Input register SegEs: 0
ed8) UNIMPLEMENTED!
(KERNEL32:misc/console.c:523) GetConsoleFontSize(0xb, 0x65fef8) 
UNIMPLEMENTED!
(KERNEL32:misc/console.c:2832) Seload wpcap.dll
(NTDLL:ldr/utils.c:1826) failed to load wpcap.dll
(NTDLL:ldr/utils.c:1948) LdrFixupImports() failed for 
colinux-bridged-net-daemon.exe
(NTDLL:ldr/startup.c:459) Failed to initialize image
(int10.c:158) IntInt10CallBios
(int10.c:163) - Input register Eax: 1112
(inttConsoleWindowInfo(0xb, 0x1, 0x79189c) UNIMPLEMENTED!
(KERNEL32:misc/console.c:2693) SetConsoleScreenBufferSize(0x13, 
0x190050) UNIMPLEMENTED!
10.c:165) - Input register Ebx: 0
(int10.c:167) - Input register Ecx: 0
(int10.c:169) - Input register Edx: 0
(int10.c:171) - Input register Esi: 0
(int10.c:173) - Input register Edi: 0
(int10.c:175) - Input register Ebp: 0
(int10.c:177) - Input register SegDs: 0
(int10.c:179) - Input register SegEs: 0
A problem has been detected and ReactOS has been shut down to prevent 
damage to your computer.

The problem seems to be caused by the following file: ntoskrnl.exe

KMODE_EXCEPTION_NOT_HANDLED


Technical information:

*** STOP: 0x0000001E (0xc0000005,0x8004daa9,0x00000000,0x00000064)

***    ntoskrnl.exe - Address 0x8004daa9 base at 0x80000000, DateStamp 0x0

Page Fault Exception: 14(2)
Processor: 0 CS:EIP 8:8004daa9 <ntoskrnl.exe:4daa9 (io/ioctrl.c:101 
(NtDeviceIoControlFile))>
cr2 64 cr3 cfa8000 Proc: 81040340 Pid: 11c <colinux-> Thrd: 8104f088 
Tid: 120
DS 10 ES 10 FS 30 GS 23
EAX: 8106dc80   EBX: 00000032   ECX: 00000000
EDX: 00000000   EBP: 9e9edd44   ESI: 0064ad08   ESP: 9e9edc84
EDI: 9e9edd74   EFLAGS: 00010282 kESP 9e9edc84 kernel stack base 9e9eb000
Frames:
<ntoskrnl.exe:3bf2 (C:\DOCUME~1\home\LOCALS~1\Temp/cccPaaaa.s:178 
(KiSystemService))>
<kernel32.dll:2a4ca (file/deviceio.c:96 (DeviceIoControl))>

KeBugCheckWithTf at ke/catch.c:224
A problem has been detected and ReactOS has been shut down to prevent 
damage to your computer.

The problem seems to be caused by the following file: ntoskrnl.exe

KMODE_EXCEPTION_NOT_HANDLED


Technical information:

*** STOP: 0x0000001E (0x80000003,0x8000608f,0x00000000,0x00000000)

***    ntoskrnl.exe - Address 0x8000608f base at 0x80000000, DateStamp 0x0