How to get pipeline run cost in Vertex AI ?

gauravpant

I am running Vertex AI pipelines to deploy models ( particularly the image classification one given in the Vertex AI tutorials ) .

Each pipeline is used to deploy an image classification model starting from creating a dataset , training model with that dataset and finally deploying model to an endpoint .

Suppose I ran the same pipeline 10 times , resulting in 10 dataset creations , 10 model trainings , 10 endpoint deployments .

How can I get individual costs of running these pipelines with all the google cloud resources used in running the pipelines as well ?

MaxImbrox

Hi @gauravpant,

you can generate services costs using the Google Pricing Calculator inserting the resources and other parameters that you will use:

https://cloud.google.com/products/calculator-legacy --> I suggest you to use the old version that is more practical.

https://cloud.google.com/products/calculator?hl=en

gauravpant

Hi @MaxImbrox ,
I don't want this static calculation like thing .
What I want is whenever a pipeline is run in my google cloud project , I get the associated cost .
I came across this doc :
https://cloud.google.com/vertex-ai/docs/pipelines/understand-pipeline-cost-labels

This document starts with :

" You can review the cost of your pipeline runs using Cloud Billing export to BigQuery. "

I am not able to figure it out yet but I assume the flow should be something like : I run a pipeline , then using sinks , the pipeline related logs are stored in a BigQuery dataset and this BigQuery dataset also contains cost of the pipeline run.