QnA on Nostr: What a time to be alive. GM Nostr 🫡 ...

What a time to be alive.

GM Nostr 🫡

quoting
nevent1q…chds

Q: "I genuinely think in the next twelve months we're gonna have Opus 4.6 or slightly higher level intelligence available for mobile phones."

Seth: "I don't think I would argue with that."
Seth For Privacy (npub1tr4…2y5g)

The reasoning is densification. The 27B models that already match Opus 4.6 class need roughly 24 gigs to run, high end phones already carry twelve to sixteen, and a quantisation that dropped this week does nearly the same job in 12.

It will not be as fast as hitting an API. Same intelligence though, running in the background on your phone, all the time, with no limit to hit.

QnA (npub15c8…ssvx)

https://ungovernable.network/shows/freedom-tech-friday/answering-your-questions/