Unable to load image

Insane tech demo of high speed LLMs :marseysweating:

https://groq.com/

Apparently it's a type of new chip. I like specialized hardware :marseynerd:

44
Jump in the discussion.

No email address required.

I talked to one of their former verilog devs on reddit like 2 years ago. He said the company was a fricking shitshow and there was little to no clear goal on what their product would really be intended for, who it'd be marketed towards, or how it competes with GPU/FPGA at any reasonable level to justify the costs. Maybe it does now? I don't know much about the AI stuff. I guess they finally finished a tapeout.

https://www.bittware.com/files/GroqCard_datasheet.pdf

https://www.mouser.com/ProductDetail/BittWare/RS-GQ-GC1-0109?qs=ST9lo4GX8V2eGrFMeVQmFw%3D%3D

Interestingly the card doesn't even have any onboard HBM or DRAM or anything, just the ASIC with 230MB of SRAM? I wish I knew more about this shit tbh I don't get how that works. I thought the datasets were huge so I assumed you needed high throughput. And 20k each? That's a steep investment.

Jump in the discussion.

No email address required.

https://i.rdrama.net/images/17084593802554312.webp

lmao they will never fill this position, have they even met ASIC devs

Jump in the discussion.

No email address required.

Yeah, I was commenting about the hardware here, and it looks like a pile of bullshit. Not sure what the price is, but since they won't say, that likely means $$$$$$ beyond :marseynietzscheretard: an RTX 4090.

Jump in the discussion.

No email address required.

$20,000 per card.

Jump in the discussion.

No email address required.

Jump in the discussion.

No email address required.

yeah that is truly insane lmao

Jump in the discussion.

No email address required.

https://i.rdrama.net/images/17084642687150357.webp

>they didn't turn off the microsoft word squiggly lines

Jump in the discussion.

No email address required.

:marseyrofl:

Jump in the discussion.

No email address required.

Link copied to clipboard
Action successful!
Error, please refresh the page and try again.