I’m integrating with looker API to run looks and use the data. I expect to have high volume and need pagination of results. Currently I do not see such option in the API description.
I’ve came across the topic in discourse: Pagination for data in looks
Could you please tell me if anything has changed since there and if there is any ETA for the feature?
This has not been implemented as yet nor we have an ETL. It has being brought to our attention several times. I will pass along your use case to our Product team. Thanks for bringing this up.
Thank you for the update!
Could you please advice if and how (by using any available API) it would be possible to get results of running a look with pagination? Like I see that running a Query can be paginated, so maybe the end goal is achievable?
This is really not an api-specific issue. It is a looker query issue. We’d have to build pagination in at a pretty low level or do a bunch of work to cache results on the server in a way that doesn’t fill up memory and then page them out on demand. Our answer for that is generally streaming (using a higher limit). The catch there (and generally) is that anything with pivots/calc/totals (or dialects that don’t stream well) risk blowing up the server. But, that problem isn’t api-specific either.