About davidregalado25

davidregalado25

Hi,Following this conversation, I decided to put my case as a new message here. My goal is to load a table with data from CSV files using Dataform. For that, I'm using a sqlx file like this:: LOAD DATA OVERWRITE [MY_PROJECT].ILS.test_david_ILS_catego...

davidregalado25

I asked Gemini the following:I want to see the DDL for a given table in bigquery And I received this for an answer:To see the DDL for a given table in BigQuery, you can use the following steps: Open the BigQuery web UI and navigate to the dataset tha...

davidregalado25 · 02-16-2024

Hello everyone!Summary:Is the google-generativeai module tested on Cloud Dataflow? Please advice on how to integrate both.Context:I'm working with Dataflow's flex-templates and Python SDK. I've installed the aforementioned library using this line in ...

davidregalado25 · 01-26-2024

Hello everybody!I'm working with Gemini Pro. It's great but I've found that for the same prompt, sometimes it returns a response, sometimes it doesn't. Why is that? This is the function I'm using: def get_response_from_llm(user_email, name, company, ...

davidregalado25 · 12-27-2023

Hello!I am using a Python library called Pydub to work with audio. It works very well in Colab Enterprise, but when I try to run it in a Dataflow job, I get the following error:No such file or directory: 'ffprobe': 'ffprobe'After searching on the int...

davidregalado25

I just figure that out, but thanks for your answer. The operations type did the trick!--Best regardsDavid RegaladoWeb | Linkedin | Cloudskillsboost

davidregalado25

I've created a new thread here.--Best regardsDavid RegaladoWeb | Linkedin | Cloudskillsboost

davidregalado25

I got this error:Unexpected property "category_id" in columns column descriptor. Supported properties are: ["description","columns","displayName","dimension","aggregator","expression","tags","bigqueryPolicyTags"]--Best regardsDavid RegaladoWeb | Link...

davidregalado25

Check Dataform Compilation:Compile After Changes: Did you compile your Dataform project after updating the descriptions in test_david_ILS_categories.sqlx? Changes won't show up until you do.Review Compilation Logs: Look for any errors in the logs tha...

davidregalado25

I've found these videos very useful:Introduction to Dataform in Google Cloud Platformhttps://youtu.be/285HnXL9_rk?list=PLmGKp_nLkJ3Lo_IzHbnsWK2ViOCoiSOYHDataform Office Hours: Dataform Best Practiceshttps://www.youtube.com/watch?v=5NsnLZHIE5U&list=PL...

My Stats

davidregalado25's Bio

Badges davidregalado25 Earned

Recent Activity

DATAFORM - Load a table with data from CSV files using Dataform

BIGQUERY - SHOW TABLE table_name

Gemini: google-generativeai + Cloud Dataflow

Gemini Pro for the same prompt, sometimes it returns a response, sometimes it doesn't.

Dataflow - No such file or directory: 'ffprobe': 'ffprobe'

Re: DATAFORM - Load a table with data from CSV files using Dataform

Re: Dataform - Documentation Generation

Re: Dataform - Documentation Generation

Re: Dataform - Documentation Generation

Re: Dataform - additional learning