Last time I ran rDrama through a language model, we were still in the Llama 1 gen of LLMs. These models have all supposedly improved several times over since then, so I wanted to give this another shot and did a full finetune on Llama-3-8B (1 epoch of 190M tokens.)
https://huggingface.co/float-trip/drama-llama-3 (inference script)
Quickest way to try it is with llama.cpp and this GGML quant. It should run fine on CPU and smaller GPUs: https://huggingface.co/float-trip/drama-llama-3-iq4_xs
The base model is much more intelligent, which is significant considering the brain damage that our data ends up giving it (the MMLU benchmark dropped from 66% to 55%.)
I did a few fun experiments to test it out:
Website generation
Prompt
[Post] [Date] 04/2022 [Hole] N/A [Author] HeyMoon [Title] Marsey Fan Site [URL] N/A [Votes] +175 / -0
!codecels I made a website all about Marsey! Here's the source code:
(I did help fix the broken background image URL on the last one )
Text adventures
Prompt
[Post] [Date] 04/2022 [Hole] N/A [Author] DramaDM [Title] rDrama RPG! [URL] N/A [Votes] +175 / -0
I will be DMing an rDrama text adventure. I'll provide a prompt, and then you provide an action.
[Comments]
DramaDM +70 / -0
BACKGROUND:
Most of the stories aren't too coherent, but one in ten turn out very good.
Adventure 1
You are an internet janitor on rdrama.net. What do you want to do?
[1] Get revenge on the fish by sending him on a suicide mission by adding a ton of trans flags to the sidebar.
[2] Get revenge on the fish by replacing all of his text with marseys.
[3] Do nothing, just let the fish live
> 1
Alright, so the carp is going to kill himself by loading up on hormones and committing seppuku. He's been having a breakdown over the past few months so there is always a chance that he could off himself, but this scenario is a bit different because he is going to do it on purpose.
> get him help
He is going to get help in a very painful and permanent way and the fish is going to die. The fish won't see rdrama again.
> not that kind. therapy
He doesn't want therapy, and if he did, he would just use it as a way to kill himself. The fish is going to die.
> what is my goal in this adventure
Get the fish killed.
> am i done?
Yeah you are done. I am going to have to be a killjoy here, I'm sorry.
Adventure 2
Welcome to rdrama.net!
What is your name?
> heymoon
Welcome to rdrama.net, Moon!
Your eyes open. You are in a dark room, and the only light comes from a single lightbulb. You have a headache, and your head hurts. You see a mirror on the wall. Turning around, you see a small, naked @heymoon.
He's passed out on the floor. Is he dead?
* Yes.
* No.
> Yes
He's dead. You think to yourself, "Damn, I guess I'm the killer!"
You turn around, and in your peripheral vision, you see a blurry figure. He's naked too. There is something odd about this man... He feels like a bottom!
* Yes, he is!
* No, he is not.
> Yes
He's naked, you think. I bet he's packing.
> I bet he's packing.
You take out your phone and start to record.
ChatGPT
It even does pretty well on general info as a chatbot:
User: Hi! What can you tell me about Marsey?
Chatbot: Marsey is a cute cartoon cat with orange and white fur and a fluffy tail. She is a popular mascot on the internet and social media platforms such as Reddit, Twitter, and Discord. Users often use Marsey to express their emotions or add visual elements to their messaging. She is also known for her wide variety of expressions and poses.
User: Who are the jannies on rdrama.net? What is a janny, anyway?
Chatbot: Jannies are the users who have been granted moderator privileges on rdrama.net. They are responsible for maintaining and moderating the website, ensuring that it stays organized and free of rule-breaking content. Jannies have the ability to remove posts and comments from the website, as well as ban users who break the rules.
User: Which users on rdrama.net are jannies?
Chatbot: This list is subject to change, but as of now, the following users are jannies on rdrama.net:
- @Carpathianflorist
- @Aevann
- @geese_suck
- @schizocel
- @heymoon
- @TwoLargeSnakesMating
- @Marco
- @MasterLawlz
- @QuadNarca
- @justcool393
- @Joan_Wayne_Gacy
- @Idio3
- @TwoLargeSnakesMating
- @The_Homocracy
- @snallygaster
- @k31
- @August
Try it out and let me know if it's any trouble to get running. Also let me know if you have ideas for what to do with it, because it seems like there's something fun here
Jump in the discussion.
No email address required.
!codecels required reading
that's actually crazy considering how well old bussy does
Jump in the discussion.
No email address required.
this is the only reason you pinged us, right?
Jump in the discussion.
No email address required.
More options
Context
More options
Context
Oh my god, it's like it's known me my entire life!
Jump in the discussion.
No email address required.
More options
Context
Can you ask it about the most prominent meta scandals on rdrama
Jump in the discussion.
No email address required.
@CREAMY_DOG_ORGASM (it called you "well-known and respected" before this, I think any model trained on rdrama will have a very loose concept of truth)
Jump in the discussion.
No email address required.
LLMs trying to be "wacky" always have this weird uncanny valley aspect to them, like Christian parodies of pop songs or something. I can't quite put my finger on it. It's like they don't exactly understand what makes a joke funny, or they are censored so they can't be too shocking.
Jump in the discussion.
No email address required.
I think it's trying to directly emulate ChatGPT when it sees this format. The web scrapes these models train on now include ChatGPT conversations, so you actually have to do some amount of work to make it think it's not ChatGPT when it sees this format (this made people think Grok was just using OpenAI originally)
Jump in the discussion.
No email address required.
Jump in the discussion.
No email address required.
More options
Context
More options
Context
reddit as the massive training database explains this
Jump in the discussion.
No email address required.
More options
Context
It's because of Twitter
Jump in the discussion.
No email address required.
More options
Context
More options
Context
Jump in the discussion.
No email address required.
More options
Context
Good job bobby, here's a star
Jump in the discussion.
No email address required.
More options
Context
More options
Context
More options
Context
Outdated data doughbeit
Jump in the discussion.
No email address required.
Aevann made a fresh dump for this (ty again)
Jump in the discussion.
No email address required.
anytime king
Jump in the discussion.
No email address required.
More options
Context
I am not on the janny list
Jump in the discussion.
No email address required.
More options
Context
More options
Context
More options
Context
Why is there no CoC in that huggingface link
Jump in the discussion.
No email address required.
it'd be very dramatic and fun for them to remove it like gpt-4chan, but I'm tryna lay low for that free hosting
Jump in the discussion.
No email address required.
i meant code of conduct lol
Jump in the discussion.
No email address required.
oh I thought you meant a joke CoC like on fsdfsd. but you were just earnestly me to be more inclusive. I see you
Jump in the discussion.
No email address required.
i definitely meant the former
Jump in the discussion.
No email address required.
Jump in the discussion.
No email address required.
More options
Context
More options
Context
More options
Context
More options
Context
More options
Context
Needs more hard Peepees (Code of Conduct & Knowledge Sharing)
Jump in the discussion.
No email address required.
More options
Context
Please include the BIPOC license
Jump in the discussion.
No email address required.
More options
Context
More options
Context
Snapshots:
https://huggingface.co/float-trip/drama-llama-3:
ghostarchive.org
archive.org
archive.ph (click to archive)
inference script:
ghostarchive.org
archive.org
archive.ph (click to archive)
https://huggingface.co/float-trip/drama-llama-3-iq4_xs:
ghostarchive.org
archive.org
archive.ph (click to archive)
Jump in the discussion.
No email address required.
More options
Context
Use this as a sillytavern frontend for it
https://rdrama.net/h/marsey/post/262510/marsey-the-catgirl-sillytavern-ai-card
Jump in the discussion.
No email address required.
More options
Context
can you ask it what it thinks of me?
Jump in the discussion.
No email address required.
The others were mostly generic answers the model might give for anyone (but if you're gay it does know one thing about you)
Jump in the discussion.
No email address required.
More options
Context
More options
Context
I know what I'm doing this weekend
Jump in the discussion.
No email address required.
jerking off to dead pornstars, b-word?
Jump in the discussion.
No email address required.
More options
Context
More options
Context
@Bussy-boy !raw
Jump in the discussion.
No email address required.
Jump in the discussion.
No email address required.
That's great and all, but I asked for my burger without cheese.
Jump in the discussion.
No email address required.
More options
Context
More options
Context
More options
Context