@pitermach Neat! Do I understand correctly that this doesn't allow you to ask questions, but the underlying API does? Or is the follow-up question part not exposed to the public API yet? Or perhaps you have no idea about any of this and I'm asking the wrong person? :)
@jcsteh As far as I know, the API is stateless, so only implicitly supports follow-ups. I.e., if you want to ask a question about previous responses, you have to resend that history with the request, decorated with which party said what. This add-on doesn't support asking follow-up questions regardless. I suppose you could modify the initial prompt in the settings to ask something specific before the image had been recognised, or after the initial recognition before resending it. @pitermach
@jcsteh From what I've seen, this is one of the most common questions on the OpenAI dev forums and other Q&A sites by far; people expect it to work like the web version of ChatGPT out of the box. So on one hand, statefulness would be a popular feature. On the other, it could decrease token usage and hence API revenue, or make token utilisation less predictable. There could also be questions about how long they store e.g. cached images within a session, although I think the data usage ship has well and truly sailed on this one. @pitermach
@jscholes@jcsteh@pitermach All OpenAI APIs work this way, including Chat GPT. There's no state, you always send the entire conversation history. This is most likely what web Chat GPT (or the Chat GPT backend) does under the hood. Even if there was state, it would be an abstraction at best with little to no impact on token usage. You just have to feed the whole conversation history to the model every time to make it do anything useful, particularly in such a heavily multi-user setup. That's how transformers function.
@pitermach I really want to try this open ai thing for NVDA, but the open ai site isn't letting me add a payment method! it keeps saying you are making too many attempts. slow down. even the first time I tried to hit continue I got that stupid message! grrrrrrrrrr!
Add comment