38
u/CYCLONOUS_69 17d ago
People are dumb. You are getting $100 worth of effective usage just by paying $10 is just crazy.
Even though it is a bit slow, it gets job done. I've seen that the current model is far better than the old V4.1 Flash. People aren't knowledgable about quantization really.
Just spec your tasks properly, have some test units or suites and go you are good to go. It won't hallucinate nearly as people are saying.
7
u/ApprehensiveDelay238 17d ago
I have yet to fully prove but the effective usage is more like $40 if not less. The caching efficiency on go is a lot less than the official provider.
2
2
u/xRebellion_ 16d ago
I always achieve 99 percent cache hit rate on my sessions with go. What you're experiencing is probably the cache retention rather than cache efficiency. I heard deepseek retains the cache for longer periods of time.
2
u/ApprehensiveDelay238 16d ago
That 99% must be a snapshot. Not average. I average around 94 to 96%. Go cache retention is so bad, I visualized the cache drops, and go at peak hours frequently evicts your prefix mid turn. And happens way more often after just a few minutes.
1
u/xRebellion_ 16d ago
Not really from my experience. But then again, it could also be a regional thing so I can't say my experience may be the same for others so I can't say it applies for everyone.
4
u/Corv9tte 17d ago
Exactly. You're not getting $100 of API and this is a completely fraudulent claim. They KNOW this. Scamming liars, and they keep playing dumb. I swear this guy would run an Indian call center if not for AI, he's perfect for that
1
1
u/SOLID-DevMan 14d ago
That's just not true, i compared value head to head and opencode is on par with the api I will share the values soon
16
u/Hello_my_name_is_not 17d ago
You used too many words could have stopped at the first 3 tbh
3
u/CYCLONOUS_69 17d ago
They couldn’t have gotten the context without the explanation but yeah, you’re right.
2
17d ago
The thing people is arguing is not the value. It's geniunely valuable. I love OpenCode (not harness, the subscription).
What people talk about is more like the opacity I think.
1
9
u/VirtualNorth1279 17d ago
What do we want? Kimi 3.1.
How do we want it? Operation CheepKimi.
What do we want? Lots of Kimi K 3.1 quota.
How much do we want? A gazillion tokens.
Everybody dance now!
Doop. Doop. Doo doo doop. Doop doop...
9
u/GCoderDCoder 16d ago
I think yall are making lots of assumptions about why people quantize. Most people are trying to get it to fit hardware. nvfp4 save 75-80gb and exl3 4bpw saves more and that's still the 4bit options. Nobody quantizes for better intelligence so what is the confusion?
2
u/Literally_A_Brain 16d ago
Yeah this whole thread confuses me. I think the op image was referring to speed gains, but quantization is typically done to fit hardware.
10
u/branik_10 17d ago
is it only me or glm 5.3 flash is still better than the recent ds flash? I don't understand the hype and the benchmarks, from my experience ds flash burns so many tokens and thinks so much that in the end it costs the same but takes 3x longer to finish the task with tens of thousands token per simplest thingÂ
3
u/nesymmanqkwemanqk 17d ago
Its not only you, glm flash is very good. Better at logic, but i feel like deepseek has more knowledge, if that makes sense
0
u/branik_10 17d ago
well if I need knowledge I use websearch/fetch tools and get the most recent and relevant data. for crucial things I always rely on docs, not on models training data
2
u/nesymmanqkwemanqk 17d ago
Yes and no. Information helps steer into the right direction. But knowledge is not information, sometimes regardless of information, you may not get same result, because one model is more "knowledgeable"
1
u/CartographerAble9446 16d ago
to me glm 5.3 flash is still better, deepseek 4.1 is only better at specific tasks, but generally glm it is
0
u/hotcornballer 17d ago
I agree, dsv4f goes in loops and is very inefficient, the codes that comes out is not the prettiest as well.
GLM is much more pleasant to work with, and sticks to the prompt very well.
3
u/akza07 17d ago
Try using Opencode Go sub in Pi.
Something is wrong with Opencode agent
1
u/hotcornballer 17d ago
True, I did that already, it does performs better on Pi but I'd rather use 5.3 flash. And i've canceled by Go sub i use codex and when i burn through my usage i use 5.3 flash through openrouter and it is cheaaaap, mainly the cache hit rate has really improved recently
2
1
u/robberviet 16d ago
I follow dax for a long time. Most of what he said is true. Trust him. Also, for people why are not into technical: ever since NVFP4, 4 bit is fine, really fine.
1
u/bakawolf123 17d ago
cause calibrated 2-bit is still very decent, barely losing anything
and then there're various slightly lossy speedup techniques
people are simply calling out what they do themselves to fit on their own hardware
69
u/xRebellion_ 17d ago
That's the thing. People are not informed enough of optimization/resource saving techniques other than quantization (which is fair, since they're not exposed as widely as quantization, but still.), which made "the model is quantized" go viral. It's as if only the model is responsible in inference quality. For a number-sensitive system like LLMs I highly doubt that is the case.