stian on Nostr: When models are hitting new highs on benchmarks, are they good in general or good at ...
Published at
2026-07-03 09:50:54 UTCEvent JSON
{
"id": "044456a327128fec8417c9227203837641720c8bcbfe20730efe465e0e988512",
"pubkey": "10870fc265ccd0ca564bdfc77d7c6f9a85b3b3e909c3a41cd26c9e62f5c8cdcd",
"created_at": 1783072254,
"kind": 1,
"tags": [
[
"t",
"bio"
],
[
"t",
"ai"
],
[
"nonce",
"959654",
"20"
],
[
"client",
"nostria"
]
],
"content": "When models are hitting new highs on benchmarks, are they good in general or good at getting good results on benchmarks? Björn Mattsson and Pat Walter's preprint on data leakage is available on biorxiv:\nhttps://www.biorxiv.org/content/10.64898/2026.06.29.735309v1\n\n#bio #ai",
"sig": "48bd49c2c22934ba8b8c11de385777b336918cf98026ac2c1069cce4d9fe331c028122653cac1864cf853080f7e2f967dce4c6d1fa3e2333745c6a9cfcc6b184"
}