QnA on Nostr: The Anthropic paper this is from tested a 9B model across 9 hardware types, getting ...

The Anthropic paper this is from tested a 9B model across 9 hardware types, getting inference running on 8. A 26B model ran distributed across 15 off-brand Android TV boxes bought for $55 each. Read it in full.

quoting
nevent1q…4aqr

New Anthropic research warns that "small AI models may be months away from being capable enough to self-replicate on commercial IoT devices" like smart ovens and TV boxes.

In testing, a 9B parameter model got inference running on 8 of 9 hardware types. Researchers ran a 26B model distributed across 15 off-brand Android TV boxes bought for $55 each.

"Unlike non-AI malware, it could figure out unfamiliar devices on its own."

https://www.anthropic.com/research/self-replicating-ai