This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Hello Google Cloud Community, I'm working on managing pipelines cost in
Vertex AI and I'm trying to figure out how to set labels for my
pipelines directly from the UI when submitting a job. The only
workaround I can see is to manually enter the label...
I have triggered batch prediction job for text bison@001 model with size
of 22500 prompts for each job. My job takes 1 hr in queue and 3hrs to
complete but in the final result in the content.prediction I see error
RESOURCE_EXHAUSTED error occurred. W...
Thanks for your update, I have submitted this issue under
https://issuetracker.google.com/issues/332947924 , hope it gets
attention and could be added in future in Vertex AI UI
Hello Poala, Thanks for your informative response. This workaround only
works for custom trained models / third party models where we can
customize the machine configuration to high mem Nodes. However, I am
using google's foundational model text biso...
I see the only available quota for batch prediction using text bison in
google is Concurrent large language model batch prediction jobs running
on text-bison model per region. This might solve a part of the problem
by changing the default val from 4 ...
New Updates, I tried to cut down on the chunk size to submit multiple
batch prediction jobs to run with lower number of prompts and I saw I
had to update the quota Concurrent large language model batch prediction
jobs running on text-bison model per ...
