steipete 指出 prime agent 在实际使用中帮助有限,模型能力仍是主要瓶颈
AI 摘要
steipete 指出 prime agent 在实际使用中帮助有限,模型能力仍是主要瓶颈。
推荐理由常规快讯,保留列表
原文
they added some new stuff to pi, sure, its nice. the IPython notebook as session state sounds smart... until you realise that the models (yes even the good ones) can't write Python (they get stuck in infinite while loops a bunch).
the memories feature seems clever but doesn't really work because all the memories are slop and wrong. (examples below). i have like 20 of these already and none of them make any sense or are at all useful for agents
sub-agents as code is nice because it actually works well out of the box (vibing up a good SIMPLE sub-agent extension in pi is hard)
native codex compaction isn't included so you have to vibe that in.
/btw built-in is nice
sol still loves over-engineering no matter what you do.
my overall verdict: interesting idea when it comes to harness engineering. might help for some benchmarks, but in real world use, it doesn't help much over official harnesses. its not a *bad* harness by any means, i'd call it an opinionated pi install.
most important limiting factor is the models....... which (as i have tweeted about extensively) are still RLfried and stupid (especially the "good" ones). unfortunately it seems like a harness can't fix that.
讨论
暂无评论。