Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
Search - "chinese room"
-
!Story
The day I became the 400 pound Chinese hacker 4chan.
I built this front-end solution for a client (but behind a back end login), and we get on the line with some fancy European team who will handle penetration testing for the client as we are nearing dev completion.
They seem... pretty confident in themselves, and pretty disrespectful to the LAMP environment, and make the client worry even though it's behind a login the project is still vulnerable. No idea why the client hired an uppity .NET house to test a LAMP app. I don't even bother asking these questions anymore...
And worse, they insist we allow them to scrape for vulnerabilities BEHIND the server side login. As though a user was already compromised.
So, I know I want to fuck with them. and I sit around and smoke some weed and just let this issue marinate around in my crazy ass brain for a bit. Trying to think of a way I can obfuscate all this localStorage and what it's doing... And then, inspiration strikes.
I know this library for compressing JSON. I only use it when localStorage space gets tight, and this project was only storing a few k to localStorage... so compression was unnecessary, but what the hell. Problem: it would be obvious from exposed source that it was being called.
After a little more thought, I decide to override the addslashes and stripslashes functions and to do the compression/decompression from within those overrides.
I then minify the whole thing and stash it in the minified jquery file.
So, what LOOKS from exposed client side code to be a simple addslashes ends up compressing the JSON before putting it in localStorage. And what LOOKS like a stripslashes decompresses.
Now, the compression does some bit math that frankly is over my head, but the practical result is if you output the data compressed, it looks like mandarin and random characters. As a result, everything that can be seen in dev tools looks like the image.
So we GIVE the penetration team login credentials... they log in and start trying to crack it.
I sit and wait. Grinning as fuck.
Not even an hour goes by and they call an emergency meeting. I can barely contain laughter.
We get my PM and me and then several guys from their team on the line. They share screen and show the dev tools.
"We think you may have been compromised by a Chinese hacker!"
I mute and then die my ass off. Holy shit this is maybe the best thing I've ever done.
My PM, who has seen me use the JSON compression technique before and knows exactly whats up starts telling them about it so they don't freak out. And finally I unmute and manage a, "Guys... I'm standing right here." between gasped laughter.
If only it was more common to use video in these calls because I WISH I could have seen their faces.
Anyway, they calmed their attitude down, we told them how to decompress the localStorage, and then they still didn't find jack shit because i'm a fucking badass and even after we gave them keys to the login and gave them keys to my secret localStorage it only led to AWS Cognito protected async calls.
Anyway, that's the story of how I became a "Chinese hacker" and made a room full of penetration testers look like morons with a (reasonably) simple JS trick.9 -
The "stochastic parrot" explanation really grinds my gears because it seems to me just to be a lazy rephrasing of the chinese room argument.
The man in the machine doesn't need to understand chinese. His understanding or lack thereof is completely immaterial to whether the program he is *executing* understands chinese.
It's a way of intellectually laundering, or hiding, the ambiguity underlying a person's inability to distinguish the process of understanding from the mechanism that does the understanding.
The recent arguments that some elements of relativity actually explain our inability to prove or dissect consciousness in a phenomenological context, especially with regards to outside observers (hence the reference to relativity), but I'm glossing over it horribly and probably wildly misunderstanding some aspects. I digress.
It is to say, we are not our brains. We are the *processes* running on the *wetware of our brains*.
This view is consistent with the understanding that there are two types of relations in language, words as they relate to real world objects, and words as they relate to each other. ChatGPT et al, have a model of the world only inasmuch as words-as-they-relate-to-eachother carry some information about the world as a model.
It is to say while we may find some correlates of the mind in the hardware of the brain, more substrate than direct mechanism, it is possible language itself, executed on this medium, acts a scaffold for a broader rich internal representation.
Anyone arguing that these LLMs can't have a mind because they are one-off input-output functions, doesn't stop to think through the implications of their argument: do people with dementia have agency, and sentience?
This is almost certain, even if they forgot what they were doing or thinking about five seconds ago. So agency and sentience, while enhanced by memory, are not reliant on memory as a requirement.
It turns out there is much more information about the world, contained in our written text, than just the surface level relationships. There is a rich dynamic level of entropy buried deep in it, and the training of these models is what is apparently allowing them to tap into this representation in order to do what many of us accurately see as forming internal simulations, even if the ultimate output of that is one character or token at a time, laundering the ultimate series of calculations necessary for said internal simulations across the statistical generation of just one output token or character at a time.
And much as we won't find consciousness by examining a single picture of a brain in action, even if we track it down to single neurons firing, neither will we find consciousness anywhere we look, not even in the single weighted values of a LLMs individual network nodes.
I suspect this will remain true, long past the day a language model or other model merges that can do talk and do everything a human do intelligence-wise.31 -
How cool is that?
I met an old American couple (in their 70s), a half Korean and half Japanese guy in his 20s, some Chinese girls in their 20s just in the hotel I have checked in yesterday.
It is interesting how a city that is at the center of Turkey is so full with people from other countries.
Tbh I can swear that here are more Chinese people than Turks lmao
On a side note: The old American couple is just a room away from me.
The walls are so thin that I have heard how the American man kind of "screamed" to push his shit into the toilet lol5 -
!tech
recently i have been realising that i am utterly lonely. their isn't a group of people in life (apart from my parents) who aren't either paid to be with me (i.e office colleagues) or i am paying to be with them (i.e gym) and its very sad.
i don't have any siblings. the relatives are on sour terms, so no one visit. my parents are mostly loveless and the whole family is just focusing on sustaining than living or enjoying. i recently had some arguments with my friends and now they too are not on talking terms. .
I am a 25 year old, short , somewhat chubby guy in the most boring and safe field with no interesting interests except an average guy stuff ( cars, stocks, tech, career, sports... things that guys usually discuss).
I have been told on face that my vibe isn't interesting and i can honestly accept that . i myself wouldn't want to be with someone like me. if you are girl, then i will probably be talking to you for 30 seconds of joke-cum-fun-cum-serious-cum-caring stuff( i usually have 1-2 lines of witty stuff prepared) before going all silent and boring you the fuck out.
the next convo will be followed by an even dumber sentence but i will try to end it with a geeky joke or reference and a small laugh prompting you to also smile or fake laugh. and if you did that, then i will be desperate to keep you laughing, but my sentences will keep on getting more dumber and boring until you leave and categorise me as the most boring idiot/ "nice guy" you met. ( and meanwhile i am at the mental stage where i love you as the most precious thing of my world and imagining kids and life with you)
I can't care for anyone. I have seen too much parent fights, empty walls, money issues to understand how to care for anyone . my life is focused and sad.
shall i go on giving chocolates to everyyone in office to be popular? shall i ask a random gorl on the stret for her phone number? shall i start strolling in the park and try to talk to people? honestly, if i were a girl and someone does this to me, i would be shit scared and creeped out than falling for that guy.
then how the fuck i land myself into someone who wants to be with me? do i even want someone to be with me? or is loneliness the only thing i want?
i feel pretty okay for the most part of the day in this loneliness, except at some weird times like when am eating a platefu9 of chinese alone in some shop, or at night when i lock the door of a 9x9 large room and realise that i am the only one here.
i was once excited to grow up and do grown-up stuff like drive a car, take a solo tour, goto vaccination in every few days, be adventurous . but that has changed . i did all these things when i had people in my life. i somewhat felt motivated to do those, seeing that there were people who wanted to be with me during/after these things and care about me. now it just feels pointless.9 -
Just realized my family's night time routine...
-Mom dad: watch Chinese dramas on living room tv
-Younger brother: watch Chinese dramas on his PC upstairs
-Me: watch YouTube/Netflix or read webcomics on my phone in other living room
Are all families like this these days?22