we are using Looker on Snowflake.
A REST Webservice calls our ETL. This can happen 1 to N times a day.
After the ETL is finished with its valuation, we want to renew several dashboards and/or looks automatically or send single looks or dashboards also by mail.
The only GUI possibility I see is to use Datagroups for this.
Since we are using Snowflake and our business does not access the data 24/7 (it can, may and sometimes does), but mainly during peak hours we can “suspend” Snowflake quite often.
The default for a Snowflake connection at Looker is to query the datagroup every 5 minutes. (PDT And Datagroup Maintenance Schedule - /5***)
This would cause Looker to connect to Snowflake every 5 minutes and Snowflake would never be suspended.
If we reduce the times to e.g. one hour, we reduce the costs but lose time. We would then register any database updates too late and thus inform the business about market changes too late.
How did you solve this problem for you? Or which solution approaches do you see?