High memory consumption due to ContextCache

[mohitnz]

Reporting an Issue

High memory consumption due to ContextCache on running PnPPowershell commands for large number of items.

Expected behavior

Memory consumption should be low, or there should be a method to clear context cache.

Actual behavior

I am running PnP Powershell for SharePOint Online iterating over large number of items in a single library (more than 50,000 items ).

I have noticed that the the memory consumption for powershell increases till it consumes upto 4 GB.

On profiling the memory i discovered all the memory is consumed by ContextCache of SPOnlineConnection. (refer attached screenshot).

Steps to reproduce behavior

The scripts are simple operations e.g.

for($i= 156765 ;$i -ne 1 ; $i--){
    Remove-PnPListItem -List  “Historical Note” -Identity $i -Force
    Write-host $i
}

Which version of the PnP-PowerShell Cmdlets are you using?

• PnP PowerShell for SharePoint Online

What is the version of the Cmdlet module you are running?

2.16.1706.0

How did you install the PnP-PowerShell Cmdlets?

• MSI Installed downloaded from GitHub

[erwinvanhunen]

Hi!

I just checked here (with version 2.20.1711.0) and I am not able to reproduce this issue. The context cache never grows beyond one object in my case (as long as you are not switching context by specifying the -Web attribute it should never go beyond 1 object). Can you try to reproduce this with the latest build?

Thanks!

[ComputerHabit]

When using the commands I can watch memory usage just keep ticking up. Until PowerShell crashes that is.