Retrieve more than 5K records from Dynamics 365/CRM

[joseRdzP]

Hi,

I'm trying to figure out how to retrieve more that 5k records from Dynamics 365/CRM, looks like the GetList method has a variable named "nextLink" but I can't access it from its properties. Is there any way to retrieve more than 5000 records from CRM? Is there an example to use the paging on this API? Thanks!

[joseRdzP]

@davidyack

[davidyack]

GetList follows the next links and will return you the entire set of data that matches your criteria

[joseRdzP]

But for example, if I try to retrieve all the records from a CRM entity without any filter on the query, by using FetchXml it gets only 5000 records, how can I access the nextLink property or how can I get the remaining records?

[joseRdzP]

[davidyack]

Ah yes, Fetchxml with Get does not page today that is high on the list to add - look at #49 as it has some example code that might help you in the mean time.

[joseRdzP]

@davidyack I've implemented my own code in my Azure Function based on code from the "GetList" method and looks like it's working as expected, however I'll do more testing on that. Thank you very much for your suggestion! Do you have an ETA for the date of the new release of the API? Will the new version contain the fix to retrieve more than 5000 records? Thank you!

[davidyack]

@joseRdzP I don't have an ETA depends on when anyone has free time to look at it, if you have a modified version of GetList you'd like to post here that has it working might speed up things :)

[mohsinonxrm]

@joseRdzP , I'll be opening a pull request in a couple of days (already coded, going to test a bit more) and submitting the changes for @davidyack to review and merge.

[priyanksster]

@mohsinonxrm Thanks for updating the code but I am getting the Malformed XML in the paging cookie error. I have created an issue at #117
Any idea, what could be wrong? There are more than 5K records.

[mohsinonxrm]

@priyanksster , I haven't looked at this in a while. What's your use case? Can you post a gist of your code? Is it as easy as pulling more than 5k records of say OOB account entity and I should be able to reproduce it?

Also, just FYI, MS has release their new DV Client that works with .NET Framework and dotnet core/dotnet 6, so if you want to transition to that, that's an option.