Question

Pagination in running Looks API

  • 27 September 2017
  • 3 replies
  • 423 views

Hi!

I’m integrating with looker API to run looks and use the data. I expect to have high volume and need pagination of results. Currently I do not see such option in the API description.

I’ve came across the topic in discourse: Pagination for data in looks

Could you please tell me if anything has changed since there and if there is any ETA for the feature?


Thanks!


3 replies

Userlevel 2

Hey @karol.wojcik,


This has not been implemented as yet nor we have an ETL. It has being brought to our attention several times. I will pass along your use case to our Product team. Thanks for bringing this up.


Best,


Sasha

Hi @Aleksandrs_Vederniko,


Thank you for the update!

Could you please advice if and how (by using any available API) it would be possible to get results of running a look with pagination? Like I see that running a Query can be paginated, so maybe the end goal is achievable?


Thanks!

Karol

Userlevel 2

Hi @karol.wojcik


This is really not an api-specific issue. It is a looker query issue. We’d have to build pagination in at a pretty low level or do a bunch of work to cache results on the server in a way that doesn’t fill up memory and then page them out on demand. Our answer for that is generally streaming (using a higher limit). The catch there (and generally) is that anything with pivots/calc/totals (or dialects that don’t stream well) risk blowing up the server. But, that problem isn’t api-specific either.


Best,


Sasha

Reply