Ranter
Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API

From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
Comments
-
retoor849617h@cuddlyogre qwen and Gemma are quite impressive. Function calling with a qwen 0.5 is hilarious tho. Why does it exist.
-
cuddlyogre151711h@retoor I love gemma 27b qat. It's accurate and fast and pretty good at general conversation.
And whether it was a wise financial decision or not, I got a 5090 so I could run things as fast as possible. I'm not regretting it. -
cuddlyogre151711h@retoor I also love the image processing. It makes certain kinds of tasks that would normally require an API as trivial as taking a screenshot.
-
retoor84964h@cuddlyogre i use mainly gemma3:12b using OpenRouter. That's so cheap, AI is basically free. Sadly, Gemma3:*b is not capable of function calling but hey: https://ai.google.dev/gemma/docs/.... It's not exactly the same ofc, because normal function calling has feedback -> it goes back to the LLM and the LLM will do with the result what you've asked.
But yes, having much fun with gemma!
How do you run btw? Ollama? -
@retoor LMStudio. It works well with the API server. I use Ruby as the language I use to call the API mostly out of momentum since that's what my personal monolith app is written in.
Lawyer Ditches Cannibal Client—Major Red Flag!
In a jaw-dropping turn of events, a lawyer dropped her cannibal client upon discovering he’s never been to therapy.
“That’s a hard no for me,” she said while scrolling through gory evidence.
Gourmet preferences or red flags? You decide!
Armie Hammer is looking for new representation. Just saying!
Read more from >>theperineal<<
rant