We want to get google search results for a few websites(2 of them to be precise) on demand. Using custom search API isn't a good fit for us due to 10K/day request restrictions.
I see Custom Search Site Restricted JSON API was a good fit here as these restrictions weren't there but I think it's getting deprecated in favour of vertex AI.
Now as per https://cloud.google.com/generative-ai-app-builder/docs/migrate-from-cse we should be able to achieve the same but when trying to create the app we aren't able to perform step j i.e. (In the Select a data source pane, select Public web content crawler). This option doesn't exist in the first.
Only options visible are the website URLs to create data source, now that won't work for us as the we are looking for wikipedia and we can't prefetch and store all the pages as it's a huge dataset.
LinkedIn
Twitter
