About dario_bernardo

dario_bernardo

I have read parts of the Med-Gemini paper and I was intrigued by the uncertainty-guided search technique used by Med-Gemini models to improve the accuracy of their answers. In essence, It involves an iterative process of generating multiple reasoning...

dario_bernardo

Hello,I am encountering different LLM responses for the same prompt with the temperature set to 0.I am using gemini-1.0-pro-002, and I have noticed that, for some reason, setting the temperature to 0 does not always result in the LLM returning the sa...

dario_bernardo

To fix this, you can either request a quota increase, or what I do is to wait some time and resubmit my request. For example I have wrote a small python script that every time get this exception wait few seconds and resubmit the request. You can adap...

dario_bernardo

I agree, I have also tried with temperature=0 and top_k=1, which in my understanding should return the same response across runs. But even with this settings the model returns different answers all he time. This behaviour was not present in earlier g...

dario_bernardo

When using a temperature of 0.8, you have no assurance that the LLM will return the same answer. The issue may be in the safety_setting you are using. I am not sure about the content but a threshold of "BLOCK_MEDIUM_AND_ABOVE" may be too stringent, a...

dario_bernardo

I think your error may be related to your authentication or some other issue, because I use the same code snippet and it works for me. Without more context I am not able to give much more help.

dario_bernardo

In `gemini-1.0-pro-002` a temperature of `0` unfortunately does not work properly, and it does not return always the same response. You may get different responses every time. See my post on this.Your issue is likely because sometimes the LLM may blo...

My Stats

dario_bernardo's Bio

Badges dario_bernardo Earned

Recent Activity

Feature Request: Uncertainty response score

Unexpected Behavior: Gemini-1.0-Pro-002 Returns Different Outputs at Temperature 0

Re: Gemini Pro Quota Exceeded

Re: Unexpected Behavior: Gemini-1.0-Pro-002 Returns Different Outputs at Temperature 0

Re: Gemini Pro for the same prompt, sometimes it returns a response, sometimes it doesn't.

Re: pdf analysis using gemini-1.5-pro

Re: gemini-1.0-pro-002: Randomly returns no content object