My Frontend guys, I just wanna say that I love heyapi.dev

I wrote a wrapper to convert OpenAPI to something AI could understand so I build AI services using FastAPI now. So comfii.

@whimsical Can't wait for the AI to write it's own functions that it registers on it's own. But there is apparently a limit on how many they can use. co-pilot caps out at 128

@BordedDev yeah that makes sense, if you really want to have more functions than that, it should breakdown to smaller agents and stuff. But you never need that 128, by then, everywthing would've been faster if you just give it shell access in a docker box :P Than your agent can do EVERYTHING :P. What i hate the word agent. You need like in real life, a manager that does not know alot but superfast can redirect tasks to people who do know a lot :P

@retoor Hahaha yeah, I only discovered it because some of the MCP servers that exist just export every library function to the ai, e.g. github

And the word agent is indeed retarded

@BordedDev I think, to have not a lot of accidental function uses with such amount of functions is probably describe very in detail for what function is, so they many cases fail by the detailed description. But that would mean that you have heavy amount of functions + heavy descriptions. That's ok-ish. But you would do smth like that with llm locally, you'll feel it I guess.

But broad description can be handy if you want to have a function that should even execute if you insinuate wanting to use it, for example what the bots have with calling ABot.

@whimsical Yeah that's true, I also think at that point you want to start thinking of more "simple" ones like just a "git" command or "bash" like you mentioned. It's also part of the reason I added tags to the aggregator, it allows you to create "targeted" bots

I wonder if it just ends up eating too much context with the descriptions? Still, I think 128 is quite low for something that works in an "agentic" mode

@BordedDev yeah, very low. But you limit the messages you have in memory. Ten messages is enough to remember where it was, that's all what important. Also, if history does matter, you can limit it to a summary of the whole chat everytime you reach specific amount of messages.

@whimsical 100% I wish co-pilot woud do that instead of making me have to create new chats all the time

@BordedDev hmm