Ranter
Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
Comments
-
netikras3517318hOfc I could. But in long threads more text = more tokens = more $...
And not necessarily wanted in all cases -
retoor319914h@netikras ah yes, won't complain about your generous donation. Do you use gpt4o or gpt4o mini? I'm using gpt4o-mini because there is for my usage nearly no difference. It's way cheaper. And i do quite mass batching. My default bill is ten cent a day because I have one gb of data stored. I still have to figure out if much data made my bot slower or not, or that OpenAI was just having a bad day. The OpenAI api has often bad days tho. When I use my talking assistant, i do notice some delay more very well.
-
netikras3517313h@retoor I think it's 4o. It's paid by my friend's company, I don't want to exploit him :)
-
retoor319912h@netikras ah ok, but don't worry too much in general :P gpt is very cheap, I think it's really made for batch processing shit. You can talk a whole day (way more than devRant produces) for a while cent. The makes of GPT WANT to break the internet with their content.
-
retoor31999h@ScriptCoded you mean such functionality? With python it's very easy. There are two ways with OpenAI, you keep the message history and send it every time with classic completion or they do it for you but you have to use the agent api.
-
@retoor yeah I tried modifying the bash script. But iirc there was some trouble with the token limit, forcing me to make some cumbersome whatchamacallits. But that was a year or two ago
Related Rants
@netikras a bit hard in bash maybe, but could we give the gpt bot the context of the conversation so it knows what it previously answered? In that case we can do simple follow up questions and you can ask things like "Who is right? Is it correct what x says? Is y considered reasonable? Are you sure? Give other options.". So making it more part of the conversation :)
random
request
context
feature
memory
bot
chatgpt