MeDuViNoX@sh.itjust.works to Technology@lemmy.worldEnglish · 5 months agoGemini doesn't share Google search's AI advice on pizza cheese solutions?sh.itjust.worksimagemessage-square42fedilinkarrow-up1469arrow-down127
arrow-up1442arrow-down1imageGemini doesn't share Google search's AI advice on pizza cheese solutions?sh.itjust.worksMeDuViNoX@sh.itjust.works to Technology@lemmy.worldEnglish · 5 months agomessage-square42fedilink
minus-squareistanbullu@lemmy.mllinkfedilinkEnglisharrow-up1·5 months agohttps://github.com/ollama/ollama/blob/main/docs/api.md#request-reproducible-outputs LLMs are prompted with a seed. If you change the seed you get a different answer.
minus-squareTurun@feddit.delinkfedilinkEnglisharrow-up1·5 months agoI appreciate the constructive comment. Unfortunately the API docs are incomplete (insert obi wan meme here). The seed value is both optional and irrelevant when setting the temperature to 0. I just tested it.
minus-squareTurun@feddit.delinkfedilinkEnglisharrow-up1·5 months agoAddendum: The docs say For reproducible outputs, set temperature to 0 and seed to a number: But what they should say is For reproducible outputs, set temperature to 0 or seed to a number: Easy mistake to make
https://github.com/ollama/ollama/blob/main/docs/api.md#request-reproducible-outputs
LLMs are prompted with a seed. If you change the seed you get a different answer.
I appreciate the constructive comment.
Unfortunately the API docs are incomplete (insert obi wan meme here). The seed value is both optional and irrelevant when setting the temperature to 0. I just tested it.
Addendum:
The docs say
But what they should say is
Easy mistake to make