ブログ
モデル改善、アプリケーション開発、そしてその間にあるレイヤーについての考察。
LLMs are best at semantic backend work
LLMs are strongest on semantic backend tasks like routing and normalization, and much weaker on deterministic execution.
The right model for application logic is not always the smartest one
When deploying language models within applications, the relevant question is often not which model is smartest in general, but which model can do a specific job well enough, cheaply enough, and reliably enough.