Whenever there is new data coming in. I use the rebuild derived table feature to pull the latest data.
But whenever I use incremental PDT and use the rebuild derived table feature the new data seems to not reflect when I run the in the explore.
Is there something I am doing wrong.
Datagroup:
datagroup: daily {
max_cache_age: "2 hours"
sql_trigger: SELECT MAX(DATE(timestamp)) FROM `fl-pya-dz-stag.datazoom.events`;;
}
View:
view: view_9 {
derived_table: {
datagroup_trigger: daily
increment_key: "created_hour"
partition_keys: ["timestamp"]
sql:
SELECT
content_session_id,
MAX(playback_duration_content_ms)/1000 as playback_duration_content_seconds,
MIN (timestamp) as timestamp
FROM
`fl-pya-dz-stag.datazoom.events`
WHERE {% incrementcondition %} events.timestamp {% endincrementcondition %}
GROUP BY
content_session_id ;;
}
dimension: content_session_id {
type: string
primary_key: yes
sql: ${TABLE}.content_session_id ;;
}
measure: average_playback_session_duration {
type: average
sql: ${TABLE}.playback_duration_content_seconds ;;
}
dimension_group: created {
type: time
timeframes: [date, minute10, hour, month, week, year]
sql: ${TABLE}.timestamp;;
}
}