The problem with these models, in general, is that they are reward-maximizing.
They have no real intelligence, capability to engineer, or creativity to speak of.
This makes them great for verifiable tasks where you can get away with “guided brute force”, but for anything else it ends up being not very good.
I think the recent RL on “one-shotting apps” may have also made them worse at anything that isn’t one-shotting apps
semisol
npub122…cgrkj
2026-10-15 17:34:59 UTC
in reply to nevent1q…u0ld
Author Public Key
npub12262qa4uhw7u8gdwlgmntqtv7aye8vdcmvszkqwgs0zchel6mz7s6cgrkjPublished at
2026-10-15 17:34:59 UTCEvent JSON
{
"id": "820273ba7c783b773cb29f9f506201f440573d21dca78e6e3a45fc5e2a1f9da1",
"pubkey": "52b4a076bcbbbdc3a1aefa3735816cf74993b1b8db202b01c883c58be7fad8bd",
"created_at": 1792085699,
"kind": 1,
"tags": [
[
"e",
"a53146d9e4dd484f89cb1c3288a39740c1e2a33ff5fe717f10fb21c307ed8f32",
"wss://nostr.wine/",
"root",
"32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"
],
[
"e",
"0000007a3976c6eefb48483b414e36cb9dabe993e237f4acb0ae5d3cbcb81b88",
"wss://aggr.nostr.land",
"reply",
"75656740209960c74fe373e6943f8a21ab896889d8691276a60f86aadbc8f92a"
],
[
"p",
"32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"
],
[
"p",
"75656740209960c74fe373e6943f8a21ab896889d8691276a60f86aadbc8f92a"
],
[
"client",
"Damus"
]
],
"content": "The problem with these models, in general, is that they are reward-maximizing.\n\nThey have no real intelligence, capability to engineer, or creativity to speak of.\n\nThis makes them great for verifiable tasks where you can get away with “guided brute force”, but for anything else it ends up being not very good.\n\nI think the recent RL on “one-shotting apps” may have also made them worse at anything that isn’t one-shotting apps",
"sig": "84467a74d3df250d9e5c156acd36b037369e39ff03e7710d356d89ea161531ee80dd2f16765922aebc268d101f724794b0c83b3536c8157d180d4c1e975c1fa5"
}