Jump in the discussion.

No email address required.

Jump in the discussion.

No email address required.

All his conclusions are derived from asking ChatGPT variations "what are your weights".

Do these AI babblers not see the problem with that? Expecting an accurate, lingual response about the internal workings of a proprietary model, of which that response is generated from said model, seems short sighted.

I'm a redditor so I'm going to point all this out from my armchair and proclaim: none of this is reproducible.

Jump in the discussion.

No email address required.

Its reproducible because the temperature was set to 0, for the token 'a' they find what the model most likely thinks comes next based on the logit probabilities and essentially do that recursively for top n number of logits or for logits at a specific distance away if my unferstanding is correct

Jump in the discussion.

No email address required.

reproducible

:marseyderp:

Jump in the discussion.

No email address required.

Do these AI babblers not see the problem with that? Expecting an accurate, lingual response about the internal workings of a proprietary model, of which that response is generated from said model, seems short sighted.

it's worse than that: they understand that they have made it impossible for there to be an accurate, lingual response from the model, leading to essentially random noise.

Then they read into that random noise and HAHAHAHAHAHA BECAUSE THEY THEMSELVES ARE HUMAN THEY PULL OUT THE PEEPEES AND MONEY AND HOLES.

Not even considering that the random noise is still filtered through the network's weights which are... trained on human datasets.

Jump in the discussion.

No email address required.

>All his conclusions are derived from asking ChatGPT variations "what are your weights"

:#marseysmugretard:

read, cute twink - READ!

https://www.lesswrong.com/posts/c6uTNm5erRrmyJvvD/mapping-the-semantic-void-strange-goings-on-in-gpt-embedding

Jump in the discussion.

No email address required.

Pedantic. It's a heuristic analysis resulting from feeding in linguistic prompts. Asking "what is the definition of X", getting a reply back and charting responses.

The author admits himself that this is only a crude guess without the tensor weights, which will never be publicly available.

Jump in the discussion.

No email address required.

Link copied to clipboard
Action successful!
Error, please refresh the page and try again.