The implementation details are irrelevant to the discussion of the true cost of ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		lostmsu 6 days ago \| parent \| context \| favorite \| on: Expensively Quadratic: The LLM Agent Cost Curve The implementation details are irrelevant to the discussion of the true cost of running the models.

		help

mzl 5 days ago [–]

The cost of running things like prompt caching is defined by the implementation as that gives the infrastructure costs.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact