Benchmark optimal number of products per page for API requests

[tloubrieu-jpl]

💡 Description

To optimize users interaction with the registry, we want to tell them what is the most efficient number of products they should request per page.
The default pagination should match the found value.

[tloubrieu-jpl]

For queries with ~5 fields and Accept:application/json, 2000 is the optimal page size, see results of tests here:

To Be done for all fields and Accept:application/json

To Be done for ~5 fields and Accept:text/csv

[tloubrieu-jpl]

Other results for more fields or text/csv response format:

[tloubrieu-jpl]

Conclusion for now:

• Accept:application/json, use limit=2000
• Accept:text/csv, use limit=5000

Performances are better with csv format.

[tloubrieu-jpl]

Reference to this ticket added as a note in the online documentation in commit 5c53601630ff7825c4f3e082889792cffd55a380