Thoughts from the EPS Windows Server Performance Team
Following up on our Memory Management 101 post, we're moving on to a discussion of Pool Resources and Pool Resource Depletion. First of all - what are Pool Resources? When a machine boots up, the Memory Manager creates two dynamically sized memory pools that kernel-mode components use to allocate system memory. These two pools are known as the Paged Pool and NonPaged Pool. Each of these pools start at an initial size that is based upon the amount of physical memory present in the system. Pool memory is a subset of available memory and is not necessarily contiguous. If necessary, these pools can grow up to a maximum size that is determined by the system at boot time.
So - what distinguishes Paged Pool and NonPaged Pool memory? The first difference is that Paged Pool is exactly what its name implies - it can be paged out. The NonPaged Pool cannot be paged out. Drivers use the NonPaged Pool for many of their requirements because they can be accessed at any Interrupt Request Level (IRQL). The IRQL defines the hardware priority at which a processor operates at any given time (there's a link to a document covering Scheduling, Thread Context and IRQL's in the Additional Resources section at the end of this post).
Getting back to our Pool Resources, it is important to remember that these resources are finite. The table below outlines some sample maximum values for Paged / NonPaged Pool on x86 systems that are not configured with the /3GB switch in the system's boot.ini file. We'll cover /3GB and its effects on memory in a future post. We'll also cover Kernel Changes to Windows Vista separately. It's important to note that x64 systems don't suffer from the same Virtual Address Space limitations!
* If Terminal Services is installed on Windows 2000, Paged Pool is lowered down to 160 MB unless a registry change is made to the server to set the Paged Pool Size to its maximum value (see below).
Windows 2003 SP1
On Windows 2003 systems, Terminal Services are enabled by default.
On both Windows 2000 and Windows 2003, the HKLM\System\CurrentControlSet\Control\Session Management\Memory Management\PagedPoolSize value can be set to 0xFFFFFFFF (or resetting the value to 0) to ensure that the Virtual Address Space used for Paged Pool is maximized.
Also - here's the theoretical maximums for pre-Vista Operating Systems:
* depends on whether or not /3GB is enabled
Now that we know what the maximum value ranges should look like, here's how to verify what those values look like on your own system using Process Explorer:
Now, let's examine what type of items reside in each of these pools. Within the NonPaged pool, you would find handles that are used by applications in the user-mode space as well as Kernel-Mode drivers (typically ending in a .sys file extension). Examples of Paged Pool items are Token Objects, Kernel-Mode drivers and the Registry.
Here's where things get really interesting - what happens to a system when these Pool Resources get depleted? Some of the most common symptoms exhibited are:
Symptoms such as this are usually the first indication that there is something causing an issue with the machine.
If the NonPaged Pool on a server has become depleted, the machine will log an Event in the System Log as shown below:
Event ID 2019 Event Type: Error Event Source: Srv Event Category: None Event ID: 2019 Description: The server was unable to allocate from the system NonPaged pool because the pool was empty.
Paged Pool Depletion is logged as an Event 2020:
Event ID 2020 Event Type: Error Event Source: Srv Event Category: None Event ID: 2020 Description: The server was unable to allocate from the system paged pool because the pool was empty.
What are these error messages telling us beyond the fact that there is an issue with Pool Depletion? A common misunderstanding of this message is that the problem is being caused by the Server Service (srv.sys). Usually the Server Service is the first component to experience the issue because it is trying to satisfy a request and cannot allocate the appropriate Pool Memory.
We'll cover 2019 & 2020 troubleshooting in greater depth in a future post including how to use tools such as Poolmon and Perfmon in conjunction with a Memory Dump to find the culprits! However, to get you started, I've included links to a great post by our CPR team on their blog as well as some more general information regarding Pool Memory. The links are below.
Coming soon - Memory Tuning, Troubleshooting Memory Issues and Using the /3GB switch
- CC Hameed
So has the Product Team considered putting in the actual Pool Tag in the Event ID thats leaking since GFLAGS is enabled by default on 2K3+?
언제까지 32-bit 서버 운영 체제가 출시되나요? 라는 질문을 가끔 받습니다. 주말에 이런저런 생각을 정리하다 보니, 2004년에 제가 발표했던 x64 관련 슬라이드가 보였습니다.
Are there any chance to determine, which process(es) is using (and how much) memory allocation through "MmAllocateContiguousMemory".
I have an high consumption of nonpaged memory pool and only thing i see in PoolMon is MmCm flag with 40 MB in size.
I am running almost out of nonpaged memory, because I am running with /3GB (Exchange).
Following on from our post on troubleshooting a basic application crash , it's time to start troubleshooting
In previous posts, we've discussed the Basics of Memory Management , Pool Resources and of course the
I have to ask, what exactly is the issue with the Terminal Services? They are installed by default on Windows XP and it seems that I can't increase the paged pool memory size, it's always bound to 160 mB. Does anybody have more details on this?
In previous posts we've discussed the basics of memory management including an overview of kernel and
will more ram give you more paged pool memory?
Nice feature adding in the NonPagedPool and PagePool limits to this tool. This is a littler nicer interface than having to use LiveKD to get the same maximum/limits for these values.
Troubleshooting performance issues and understanding memory go hand and hand.
Looking forward to the "Coming soon - Memory Tuning, Troubleshooting Memory Issues and Using the /3GB switch" Some indepth discussion on using /3B and /PAE with Exchange would be interestings. How do get around the NonPagedPool and Free System pages being cut in 1/2 when using /3GB switch?
Thanks for the great article! For clarification the article states "the Memory Manager creates two dynamically sized memory pools that kernel-mode components use to allocate system memory". Can you be more specific? Are these tables by which the kernel can place pointers in?
hi, how can i get kernel memory for a specific process?
Overview It’s not unnatural to assume an IIS process hang when web client browsers begin reporting either
found it very useful. thanx.
If i say exchange runs in Page pool memory is that a correct statement?