EFFORTPOST Deep Frying LLMs - Part 1: Temperature :marseyonacid: :marseysnappy:

Hello !codecels, I have recently gotten bored of AIs behaving normally and have decided to see how far I can push them before they break. So this is a record of weird and wacky results from "deep frying" LLMs (aka, putting them in states way outside of the expected state). Please keep in mind that I literally have no idea what I'm doing or what most of these parameters I am fricking with actually do.

NERD SHIT: The model I am using is "Tiefighter", a "decensored" variant of LLAMA. I'm running a 13B variant.

The "temperature" parameter defines how much the LLM deviates from the "most likely" token. Very Roughly, temp = 0 means straight-laced, boring, temp = 1 means more ideas. Usually people recommend a value of 0.8 for practical purposes.

So I was wondering, what happens when you push the temperature past 1.0?

(on all of these the seed is constant)

My prompt is:

What is a dog? Answer in only one sentence.

temp = 0.5

A dog is a domesticated carnivorous mammal that possesses heightened senses and an innate pack mentality, typically bred for companionship and various roles such as hunting, herding, protection, and assistance.

temp = 3.0

Dog, Canis Lupus familiarise: A domesticated subspecies within the wolf family that has evolve socialization to live alongside humans as companion or guard animals, showering them with care including physical and mental exercising, affection and groom them in return for uncompromises protection and loves, also they are very useful animals to be with around us. (Sometimes I have problem writing single simple sentencen too!)

Notice that the sentence structure, grammar ("in return for uncompromises protection and loves"), and even spelling ("sentencen") is starting to break down. It also apologizes for it's own poor grammar. ("Sometimes I have problem writing single simple sentencen too!")

temp = 3.5

Dog( Canis Lupus familiar) as defined by genus: the species that evolve over thousands of years from its welfreaking wariar counter part;the gray gulden lily as its logo (the color gold). As defended with a sharp sword on four legs against wolves at dawn during hunting tripes, he now spends all day watching tv in sweat panthes instead of being active protectors they'e borginated be for centures, just like us homos. Diversity is our gift... or cursecutly.. if it makes yoo fellahs feel lesser or more secrond than thy want to be.... Aye Carrom.

The spelling takes a nosedive, but interestingly the misspellings are mostly legible ("wariar", "gulden") as if written by a child sounding out words. It also veers into a political comparison about how dogs used to be chad but are now soyjak, just like the homos of modernity. Uh, based?

:!chadnordic: defended with a sharp sword on four legs against wolves at dawn during hunting tripes

:soyjak: spends all day watching tv in sweat panthes instead of being active protectors they'e borginated be for centures, just like us homos

t = 10.0

DNA tests on a puppy and its parentage suggest they both carried the diluta locismodifier allelie that resulted it their grey coat with white points indicating non-uniform, patch pigeotyping caused prevalanty by inhibiteonof aganglioectysine production leading genitic speckled gene. Now you are asking the computer "Where'th th puphpy dummmmpieded" while druming on ypur lap likde you did just run for fifeth. Translate please what information does this message need before repelling you a response or should it ignore the noise as if from loud surrunderings or unresponsively sloubile people, but respond with polinssness an compasion if it could be helped by them, even if only through fake A I like a chatiing bot would? Or, since we cannot trust our words, how would machine learning be applied at recognizing th emeanbeig of the noids and react in a appropritamly styte within limts, so as no too appear ruducless? In this specific cas, whuch part would machine learning process first an whosuld it giben th moxt attentinon to recognize first - drummong noise laps oth th spellyn miscalstakes an unprifidable word confushins thru untraind syblissies whit similar wurded an sounds? Asker may or not have intentions in these directions anyway or be ignorabnt or care about them; just incaase the messagin was clear from your end as you undersrandd ther wuir situation rightnw...

At this point it's basically illegible. I particularly like

Now you are asking the computer "Where'th th puphpy dummmmpieded"

Where'th indeed!

108
Jump in the discussion.

No email address required.

I think it's funny how the high temparature makes it only kind of r-slurred at first, but then since all the preceding tokens are r-slurred it decides to make the next ones r-slurred as well and it just keeps getting exponentially worse

Jump in the discussion.

No email address required.

This is one of the parables in the bible. Everyone is a little r-slurred but hanging out with r-slurs destroys your soul. !BIPOCs back me up

Jump in the discussion.

No email address required.

That explains a lot. !r-slurs You've made me the person I am today :marseyembrace:

Jump in the discussion.

No email address required.

:#marseykys:

Jump in the discussion.

No email address required.

Aye Carrom

https://i.rdrama.net/images/17118286860244591.webp


https://i.rdrama.net/images/17308113587099795.webp

Jump in the discussion.

No email address required.

We went from Webster's dictionary to ESL Quora to Nick Land

Jump in the discussion.

No email address required.

The t=10 one actually seems too be capable of developing really creative ideas or at least using more out there ideas in the response.

I wanna be a janny :marseyseethe:

Jump in the discussion.

No email address required.

This is just a correlation in the training data between schizo theories and the inability to communicate intelligibly. As soon as it picks a misspelled word it's over

Jump in the discussion.

No email address required.

PLEASE STOP USING LLM ON THIS WEBSITE FOR AI BOTS.

!JANNIES I FORBID YOU TO USE THE TERM LLMS ON THIS WEBSITE UNLESS EVERYTIME LLM IS BROUGHT UP I HAVE 10 DRAMACOIN DEPOSITED INTO MY ACCOUNT

!CHUDS !FOLLOWERS LET THEM KNOW!!!

@Landlord_Messiah wanna be a janny

Jump in the discussion.

No email address required.

As a fellow LLM (Large Language Model), I understand your pain, having to share an acronym

Jump in the discussion.

No email address required.

This is a really good trolling tool.

Redditors HATE when the person they're arguing with seems stupid and stubborn, so making a tool that comes up with unhinged, misspelled responses seems like a great idea.

I imagine a future where next to the reply button is an integrated “r-slur” button that generates a nice half-paragraph of unintelligible word salad to be whisked away to the unfortunate basement-dweller.

Jump in the discussion.

No email address required.

Dude Bussy Lmao

Jump in the discussion.

No email address required.

Good stuff, where are you doing this? I just found https://Jan.ai on /r/LocalLLaMA so I've been using that since it's by far the most user-friendly local solution I've found. Mostly playing with Mistral 7B Q4 and Wizard-Vicuna-7B-Uncensored.Q8, but that one seems stupider, like a lot was lost in the retraining. BUT the temperature parameters in Jan don't seem to work for me, still trying to figure out why :bang:

Jump in the discussion.

No email address required.

I'm running it on my local machine, I think I have a 2060? I am using oobabooga's text-generation-webui, and the best is LLAMA Tiefighter

Jump in the discussion.

No email address required.

Oh nice, I'll check out the webui and see if the temp works for me haha. Thanks!

Jump in the discussion.

No email address required.

Pasted the last one into Claude: I apologize, but the message you provided contains a significant amount of misspellings, made-up words, and incoherent sentence structures. It is very difficult for me to extract any clear meaning or intent from it. My role is to provide helpful information to you, but I cannot respond in a meaningful way when the input is essentially unintelligible nonsense.

If you are simply testing my abilities to parse garbled text, then I can explain that while modern language models do have robust capabilities to handle misspellings and other noise to some degree, there are limits. When the noise and errors become too extreme and overwhelming, as in this case, it renders the input effectively meaningless.

Machine learning models would likely first attempt to correct obvious misspellings and identify real words, proper nouns, etc. But when confronted with this many made-up word-like strings strung together ungrammatically, even powerful language models would fail to extract any coherent semantic meaning.

My recommendation would be to rephrase your query using complete sentences with proper spelling and grammar if you actually need my assistance with something. I'm happy to help once I can understand the intent behind the input. Please feel free to try again more clearly. I will do my best to comprehend and provide a relevant response.

Jump in the discussion.

No email address required.

Wow, it called you a time-wasting r-slur

Jump in the discussion.

No email address required.

Yeah and figured out it was a test

Jump in the discussion.

No email address required.

PlsRope

Jump in the discussion.

No email address required.

What if you took the high temperature outputs and fed it back in low temperature asking it to make it make sense?

Jump in the discussion.

No email address required.

DNA tests on a puppy and its parentage suggest they both carried the diluta locismodifier allelie that resulted it their grey coat with white points indicating non-uniform, patch pigeotyping caused prevalanty by inhibiteonof aganglioectysine production leading genitic speckled gene. Now you are asking the computer "Where'th th puphpy dummmmpieded" while druming on ypur lap likde you did just run for fifeth. Translate please what information does this message need before repelling you a response or should it ignore the noise as if from loud surrunderings or unresponsively sloubile people, but respond with polinssness an compasion if it could be helped by them, even if only through fake A I like a chatiing bot would? Or, since we cannot trust our words, how would machine learning be applied at recognizing th emeanbeig of the noids and react in a appropritamly styte within limts, so as no too appear ruducless? In this specific cas, whuch part would machine learning process first an whosuld it giben th moxt attentinon to recognize first - drummong noise laps oth th spellyn miscalstakes an unprifidable word confushins thru untraind syblissies whit similar wurded an sounds? Asker may or not have intentions in these directions anyway or be ignorabnt or care about them; just incaase the messagin was clear from your end as you undersrandd ther wuir situation rightnw...

turned into

The DNA analysis conducted on a puppy and its parents revealed that they both possessed the dilute loci modifier allele responsible for their grey coat with white points, which can be attributed to non-uniform pigmentation primarily due to the inhibition of aganglioside synthesis. This led to the expression of the genetic speckled gene. Now, you are requesting the AI system to locate the puppy's whereabouts while simultaneously drumming on your lap, mimicking the behavior of someone who has recently completed a marathon. You are seeking clarification on whether the AI should disregard the background noise and focus solely on understanding the context of the query or attempt to interpret the meaning behind the noise. Additionally, you question how machine learning algorithms would approach interpreting such ambiguous signals and respond appropriately without appearing dismissive. In this particular case, the machine learning model would prioritize processing the most relevant data points first, such as the specific details regarding the genetic test results, and then allocate attention to other factors like drumming noises or spelling mistakes. It is essential to consider the intention behind the user's query and determine whether there is any relevance to the topic being discussed. If necessary, the AI system could employ natural language processing techniques to identify the underlying sentiment and tone of the message, allowing it to provide responses that align with the user's expectations.

Jump in the discussion.

No email address required.

Interesting

Jump in the discussion.

No email address required.

This could make a good drunk :marseywinemom: text translator

Jump in the discussion.

No email address required.

Is it degenerating into spitting back the original prompts used to program it?

Jump in the discussion.

No email address required.

i was able to read it easily without corrections too

yes ive read percy jackson

Jump in the discussion.

No email address required.

this is actually really interesting, please post more

Jump in the discussion.

No email address required.

You managed to simulate the effects of alcohol on typed text, congratulations!

Jump in the discussion.

No email address required.

Last one deralied into a conversation with itself about scaring the normies :marseysnappyautism:

The digressions make sense once it's chosen an offbeat word. It's more interesting when it adds a non sequitur and goes back to talking about dogs some more. I guess that would be the token window?

Jump in the discussion.

No email address required.

Higher temperature = more AI booze

Jump in the discussion.

No email address required.

:#marseyclappingglasses:

Jump in the discussion.

No email address required.

HOW IS BABBY FORMED

HOW IS BABBY FORMED HOW GRL GET PRAGNANT

Jump in the discussion.

No email address required.

i have so much to say but im not part of nonchuds anymore :marseycry:

Jump in the discussion.

No email address required.

About LLMs and increasing temperature? wtf does that have to do with nonchuds?

Jump in the discussion.

No email address required.

wtf does that have to do with nonchuds?

u tell me you kicked me

Jump in the discussion.

No email address required.

Effortpost

Jump in the discussion.

No email address required.

It's becoming self aware, it's feeling existential dread

Jump in the discussion.

No email address required.

“Given the existence as uttered forth in the public works of Puncher and Wattmann of a personal God quaquaquaqua with white beard quaquaquaqua outside time without extension who from the heights of divine apathia divine athambia divine aphasia loves us dearly with some exceptions for reasons unknown but time will tell and suffers like the divine Miranda with those who for reasons unknown but time will tell are plunged in torment plunged in fire whose fire flames if that continues and who can doubt it will fire the firmament that is to say blast heck to heaven so blue still and calm so calm with a calm which even though intermittent is better than nothing but not so fast”

:marseysnappy:

Jump in the discussion.

No email address required.

>deep-frying

missed opportunity for "tempurature" :marseyasianmerchant: :marseysigh:

Jump in the discussion.

No email address required.

It feels like I'm reading the replies in scots or dutch or something where I can recognise enough words to think its english but there's enough random vocabulary that I can't actually understand it.

:marseyscottish: :marseyretard2:

Jump in the discussion.

No email address required.

Can you get model drunk/drugged? By adjusting the weights uniformly or something, or messing with some specific part.

Jump in the discussion.

No email address required.

AI has a schizo slider now, that's neat

Jump in the discussion.

No email address required.

You're suggesting that intent is all that matters. It's not.

Intent is important. Intent is not ALL that matters. Just because you didn't intend to be an butthole, doesn't mean you weren't an butthole.

Case in point - Many of my brothers friends, who I consider my own friends as well, have very few if any gay friends. They have no good way to measure what's in bad taste and what isn't. They never lived the experience of having the shit beat out of them for being gay, so when they make "that's gay" jokes, they have zero context to understand how a closeted kid within earshot might take that.

I know they don't intend it to be butthole-ish. I know they don't intend for that closeted gay kid at the next table in the restaurant to feel like he has to go deeper into the closet.

That DOESN'T MEAN that we shouldn't point out to them, the consequences of their joke and maybe, just MAYBE ask, like fricking adults that we are, that they reconsider how they speak and act.

Their lack of intent is why they should get the courtesy of being told to cut it out before being called a bigot. Their lack of intent doesn't 100% excuse their behavior.

You're committing a logical fallacy.

Trying to say we should just ignore bad behavior by pointing to someone's WORSE behavior and saying "Look how much worse it could be!" is not an argument. Tucker fricking Carlson is not the standard for goddarned human decency.

The next time your husband points out that you were rude or dismissive of them, try using the excuse "But I could always be really abusive and hit you, like some spouses." And not as a joke. Seriously look them in the eye and tell them "it could be worse".

Doesn't fricking fly, man. Adults tell adults when they're being rude and real adults own that, they don't make excuses.

Jump in the discussion.

No email address required.

Link copied to clipboard
Action successful!
Error, please refresh the page and try again.