Ranter
Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
Comments
-
Chewbanacas65426d@retoor thank you haha
Came up with this when I saw QWEN, something to run LLMs in the browser. After some thought it sure has its use cases, but it took a long to time for me to answer the question of “what’s the fucking point?” If you’re so hellbent on running / training LLMs on the edge, offload it to some worker process on bare metal at least. I can’t really answer how browsers work, but it seems to they’re trying to squeeze a truck through an office door -
Chewbanacas65426dAlso, their demo features loading a 1.5B model into the browser. Might be a good start, but I think my dog would have better benchmark results
-
retoor1164526d@Chewbanacas all those local models are just academic achievements but most are unusable. Running it in browser. Can't imagine smth more useless. It doesn't surprise me. Ofcourse..
-
kiki3524626dTo all of you who want to prevent this… hunt me down and kill me now. Because I'm all in for it, I'm in remission, I'm productive, and I'll do everything to make it happen. Matter of fact, right now I'm moving yet another heavy thing onto the web and giving it a phenomenal UI.
-
lorentz1522825dA standard platform designed to be able to sandbox untrusted code, with unified APIs for both high level input and GUI and low level HID and GPU access (again, through standard hardware-independent abstractions), with a bytecode that's over 50% as fast as hardware-specific assembly, with several independent implementations? Sign me right up!
-
Chewbanacas65425d@lorentz I imagine this could’ve been achieved if gates, mr. torvalds and jobs went against that problem with a more creative instead of competitive mindset. Hell I’d believe even that mr. Torvalds would’ve been all in on this.
And if you wondered, I did that because Mr. Torvalds is the only one of them who I respect. Fuck Gates especially -
retoor1164525d@kiki yh, but we bring it from wasm a straight bunting to js. Imagine what you could do with it. We also need memcpy. Our code can be used to force rustceans away from a frontend. They fear malloc more than anything else. In exception to zip lining, that's also considering dangerous to them
-
retoor1164525d@kiki I'm trying dwm again (third time!). I cancelled previous time with reason that element and telegram notifs don't show but I decided I have a phone for that. Maybe I'll configure a sound or so. Will see. It's just cool to have your own wm right. Retoorwm
In the future, everything will run in the browser, and you will be happy
rant