3

Claude 4 when I pointed out he invented fields in a form I asked to rewrite:

You're absolutely right, I fucked up. I added an Email field that doesn't exist anywhere in the original form or the model. I made that shit up completely - there's no Email field in the original table-based form below, and I have no idea why I added it.

Looking at the original form, the "XXXXX" section only has:

--LIST OF 8 FIELDS

There's NO EMAIL FIELD anywhere. I completely invented that field like an idiot.

I apologize for that stupid mistake. Should I fix the form to match exactly what's in the original without the fictional Email field?

SIGH.....

I always watch these "THERE WILL BE AGI IN 3 YEARS" announcements with popcorn in hand and a good laugh

Comments
  • 1
    The AGI won't evolve from LLMs though.

    That is my sigh trigger every time.
  • 1
    @Lensflare maybe but LLM must be the milestone as it's the main way to communicate with us and for us to analyze what they are doing in an explicit way-

    World evolved through speech and LLM is paramount to AGI
  • 2
    @IHateFrameworks also, when the Wright brothers did the experiments with planes, just any day before they did it you could have looked at their failed attempts and said "yeah, flying planes my ass! No way this will work in 3 years".
  • 3
    It's stupid, but did you tell it, it's not allowed to add fields?
  • 1
    @BordedDev exactly, do exactly as I say, nothing more, nothing less is default in my prompts.

    So weird, I did react on this rant already. Where did the post go.
  • 1
    @BordedDev It was instructed strictly to transform the form from one style to another exactly like it was. So even if not directly it was.

    To be nitpicky the exact prompt was

    I need you to take example on how to build a perfect devexpress form from #file:Index.cshtml of XXXX and fully convert the form at in index of YYYY so that accomodates the same syntax. Maintain all fields of XXXX, the YYYY is just an example. Remove the <form tag as shown> and apply the necessary modifications

    with this it butchered my form completely with tons of invented fields. More corrective prompts later it produced the result I posted up there
  • 2
    @whimsical Well apparently is not enough
  • 1
    @Lensflare Except they did constant improvements during the years while AI got just 2 major leaps amongst all the bullshit:

    RAG/Memory/Context and Deep thinking.

    Yet there are tons of discussion and studies confirming that deep thinking can backfire and produce worse performance in terms of quality.

    Basically we have a broken toy for now
  • 1
    Hmm adding "examples" won't help. For me, I'd do it a lot simpler:

    Take form XXXX of #file:Index.cshtml and put it in YYYY and make it a devexpress form

    But even I'm not sure exactly what that prompt asks. Is it meant to make a new dev express form or is it meant to be copying it to a different file? If you just want it as a devexpress form I'd go with:

    Take form XXXX of #file:Index.cshtml and generate the equivalent devexpress form

    And tweak from there as needed

    You can even make it do it in stages by asking it to list all the fields first and then make the form for example (all in one prompt of course)
Add Comment