Unable to load image

Potential leak of the most powerful LLM AI yet - Mistral Medium

https://huggingface.co/miqudev/miqu-1-70b

Breaking news, so no effortpost.

See TheBloke's Groomercord (General) for people trying to work out if this is real:

https://groomercord.com/invite/theblokeai

Edit: Update, it does appear to be real.

29
Jump in the discussion.

No email address required.

Has anyone quantized it yet? How good is it for porn?

Jump in the discussion.

No email address required.

can u tldr....

what's so powerful about it?

Jump in the discussion.

No email address required.

It's second only to GPT-4 in the rankings. And if you can download it, you don't have to put up with all the 'as a Large Language Model, I cannot...' slop from GPT.

Jump in the discussion.

No email address required.

I unironically can't wait to run my own unaligned shoggoth from my phone :marseywholesome:


![](/images/16674454055116708.webp)

Jump in the discussion.

No email address required.

ah shit

then it's for the best I guess, lesser of two etc etc

Jump in the discussion.

No email address required.

That 70b is really big

Jump in the discussion.

No email address required.

So what kind of GPUs do you need to run it?

Jump in the discussion.

No email address required.

You can run the 4 bit quantized version on a GPU with 24 GB and maybe 48 GB of CPU memory

Jump in the discussion.

No email address required.

>tfw 8gb vramlet

:#marseyitsover:

Jump in the discussion.

No email address required.

I feel you

Jump in the discussion.

No email address required.

what does this mean

idk anything about how ai/llms work

Jump in the discussion.

No email address required.

You need a multi-thousand dollar server to run this. Even the most cut down version would be 24gb of vram and 48 of cpu and would probably be unusable bad.

Jump in the discussion.

No email address required.

I'll just stick to making shit up

Jump in the discussion.

No email address required.

It's ok, I'm poor too

Jump in the discussion.

No email address required.

Link copied to clipboard
Action successful!
Error, please refresh the page and try again.