Cache hit problem

[Amund]

Problem

I’ve been working on opencode/deepseek for several months now, and I tried out a coding session on deepseek-tui.

Specifically, I found the UI to be somewhat hard to read. That might seem like a minor issue if the work is done well, but I personally like to follow the process, and in this case, it’s pretty tough. Well, maybe it’s just a matter of getting used to it.

On the plus side, even if it’s hard to quantify, I really felt like the job was done, and that it was done faster than usual.

On the other hand, what is perfectly quantifiable is the cache hit rate. And there, when comparing a Deepseek API-oriented agent to a general-purpose agent, the problem is clearly visible.

Classic opencode session : 95.43% cache hit

Total	74,995,786 tokens
Input (Cache hit)	71,571,072 tokens
Input (Cache miss)	3,254,817 tokens
Output	169,897 tokens

deepseek-tui session : 71.20% cache hit

Total	29,992,833 tokens
Input (Cache hit)	21,356,928 tokens
Input (Cache miss)	8,470,281 tokens
Output	165,624 tokens

opencode session on same project : 94.36% cache hit

Total	55,300,522 tokens
Input (Cache hit)	52,185,216 tokens
Input (Cache miss)	2,924,970 tokens
Output	190,336 tokens

I don’t know exactly what’s breaking the KV cache, but it certainly seems like something is.

Edit: Just to clarify, I use only the deepseek-v4-flash API on both agents, they don't call anything else. (@superzmy )

[superzmy]

我建议让opencode和deepseek-tui，解决同一个问题，看看消费量和命中。
而且你需要隔一天来实验，或者使用不同deepseek供应商，这样让缓存完全失效。
I suggest having opencode and deepseek-tui solve the same problem, then compare token usage and hit rate.
Also, you need to run the experiment on different days, or use different DeepSeek providers, so the cache is completely invalidated.

[GDFatFox]

命中缓存确实很低，同一个项目跑了十几块。这个项目我从cc从0写设计文档到15版的更新，然后生成也就几块钱
The cache hit rate is indeed very low; the same project cost over ten dollars to run. For this project, I wrote the design documents from scratch and updated them to version 15 with cc, and then generating it only cost a few dollars.