Seeing as how the full unquantized FP16 for Llama 3.1 405B requires around a terabyte of VRAM (16 bits per parameter + context), I’d say way more than several.

It’s strange that Niantic is doing this when google has been doing the same thing with its own street map data.

Seems weird to make a competing product when (I thought) they are on good terms.

The fact they pulled ROCM support for older cards boggles the mind.

Bluesky is not great, but it’s at least (for now) a better platform than X and the AT protocol is actually very well written. (For instance having a moderation service separated from the service that provides the posts I think is a hands-down better way to handle it than most ActivityPub servers having their admins handle all incoming and outgoing moderation)

Bluesky federation is just now getting started so it’ll be interesting to see if it goes anywhere/where it goes.

Pretty sure a significant portion of nazis are also moving to bluesky

The key is how healthy atproto is outside of bluesky by then

From one post-communist Mixed Socialist-Market economy to another.

I’ve heard this called “social chaff”

AIs generating false data for you to hide behind may be one of the few good things to come out of the LLM craze.

I would not say Johnny Harris is a reliable source

Anyone from the local llama communities experienced with Gemma models?

I’ve heard good things but I only use Mistral because it’s proved the most versatile.

I’ve been curious about google coral, but their memory is so tiny I’m not sure what kinds of models you can run on them

If nothing else the atproto is pretty great, we’re starting to see a proper federated net start opening up around it.

Anyone else remember when people were making expert systems with scheme and saying that was the end of doctors etc?

Guix users looking around shiftily and sweating

I could be mistaken too, this has all only recently become interoperable so there’s some growing pains

Isn’t that what Whitewind is doing?

Yes! Actually.

The full atproto up and running with bluesky is only in the last month or so, so people are finally starting to trickle out and set up their own services and hosts.

It’s actually very promising and hopeful.

This doesn’t seem to be that big an issue as PDS’s can just directly communicate with one-another like how ActivityPub works.

I wouldn’t lump bluesky in the same pile as threads anymore, the atprotocol is fully up and running and slowly but surely individually hosted data servers are trickling out and away to their own services.

There’s even new services running completely independent of bluesky running on atproto now: https://whtwnd.com/about

There’s a really good write-up on how atproto federation works here: https://whtwnd.com/alexia.bsky.cyrneko.eu/3l727v7zlis2i

If you treat an AI like anything other than the rubber duck in Rubber Duck Programming you’re using it wrong.