This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
I have set up a large number of tables as biglake tables connected to
cloud storage uri's, and then I have set up a large number of
materialised views on top of the biglake tables.The problem I have seen
is that when the "last modified date" of the b...
Good day allI am in the process of backfilling and streaming a large
number of tables (>1000) using datastream.When I click start stream it
works for a few minutes and then I get the following error:""(1129,
"10.200.0.10' is blocked because of many c...
Hi everyone!I am streaming data from a source DB to cloud storage (.avro
format) using datastream, and then reading those files into BigQuery
using BigLake external tables.My question is, I have now had to add a
column to the source DB, and when read...
We've got a mysql server running at another cloud provider, and the plan
is to use datastream to pull the near real time data into bigQuery for
our analytical team to use. Datastream has a backfilling option, but our
largest table comes in at 500GB a...
Once again thank you for the answer.I think from the error: The Apache
Avro library failed to read data with the following error: Field in
reader schema 'new_col' without default value not present in writer
schema, It is likely to be 6.Do you perhaps...
Thank you for the detailed response. I am, however, still struggling
with this issue.Should there be specific configurations made to
datastream, gcs or bigquery for this to work, or is it possible to set
up using just the console?I'll add a few more ...
