r/opencode • • 13d ago

CRAZY things are brewing

Post image
1.4k Upvotes

209 comments sorted by

46

u/Cyvster 13d ago

1 bit quant?

9

u/Railander 13d ago

they don't quant the models, they've said so many times before. if they ever do, they would make that transparent.

17

u/domiciledhere 13d ago

That’s an illogical assertion.

13

u/Railander 13d ago

10

u/narasadow 12d ago

Dax is.... flighty at best

nothing he says is binding

5

u/FullstackSensei 12d ago

You can always cancel anytime. It's not like you're signing a 2 year contract.

The model is indeed insanely efficient. 97% of the model is already FP4 with the remaining 3% at FP8. Quantizing it further doesn't make the model much smaller. On top of that, only half the model (first 20 layers) runs during prefil. That's 150GB. 1M context costs under 1GB in memory.

If you spend a few minutes reading the DeepSeek technical report, you'll learn that they split their prefill and decode sub-clusters, and persist the KV cache on disk for 72 hours. From my own experience using DS API, I get over 99% cache hit. And while the artificial analysis makes it seem like the model is verbose, it is very token efficient 90% of the time.

To give a concrete example: it's been running a long code optimization task for about 48 hours, and I averaged a little over $2/day in API costs.

2

u/narasadow 12d ago

cool, but unrelated to what I was responding to (which was "if they ever do, they would make that transparent.")

I can see them quantizing if they hit a compute cap and people sign on faster than they can serve. Which is not impossible.

4

u/FullstackSensei 12d ago

Did you read anything I wrote? 97% of the model is already FP4, with a lookup table for the values (so, not real FP4). Quantizing the remaining 3% makes zero difference, and quantizing those FP4 weights leads to very quick degradation, still for minimal gains in VRAM usage or speed.

What you're saying would have made sense on a FP16 model using a traditional architecture. What you and others miss is that DS4.1F is different. There's nothing you can realistically gain by quantizing it.

3

u/narasadow 12d ago

Ok apologies

1

u/Embarrassed_OnionX 12d ago edited 12d ago

I see for example unsloth quants with widely different sizes, so it's possible to save lots of resources by using lower quants. Im not saying OC is using quantized models, but it doesn't seem unreasonable to think they may be.

edit: typo

1

u/FullstackSensei 12d ago

The unsloth quants mainly quantize the engram. The ones which touch the routed expert weights are documented to suffer substantial deviations.

It is very unreasonable to think they may be because further quantization will not yield any substantial gains in speed when you're deploying on Hopper or Blackwell data center GPUs. What little VRAM you save is offset by an increase in compute, which will mostly if not fully negate any gains you might have thought of.

The model doesn't even communicate activations between layers in FP16/BF16. Everything is quantized down to FP8 at each layer's output to further save on bandwidth. The whole model was trained around this. I can tell you from actual personal tests that even quantizing those FP8 activations to int8 (with equal block sized scales) introduced ~9% error at 128 output token length (120 match out of 128), and this is doesn't save a single bit in memory or bandwidth. This isn't theory, I have test fixtures fuzzing for both. I'd love to get the int8 path under 1% for my VNNI-supporting Xeons and my int8-happy P40s, alas that's not possible.

The Unsloth quants make sense for you and me, on a desktop with very limited resources. But in a data center GPU deployment, it makes zero sense because you'll be throwing native hardware support down in the bin.

→ More replies (0)

0

u/xmnstr 12d ago

Dude, these models are already close to as quantized and optimized as can be. Dax is right, it wouldn't make sense to quantize. With the kind of architecture this model is built around, there's faaar more to gain by regular infra magic rather than quantization. I think you may be underestimating what Deepseek have created here.

2

u/tetoing 12d ago

Which is trivial for deepseek, because there's nothing to be gained speed wise by quanting something that's already FP4.

It doesn't mean their inference backend is the same, or that they use the same sampling settings, or that they aren't quietly reducing reasoning effort.

2

u/dat_cosmo_cat 12d ago

Source: trust me bro.

2

u/Additional_Art_24 13d ago

The idea is. Most people might be does not care if it quant or not as long as the reasoning is reliable. but on that cases. Most of the time is not. Let say there is modal with 1bit quant but their reasoning trace is so smart (kinda like sonnet level). Does people will complain ? ofc not. Whatever the opencode team says, the model is far inferrior to compare to official modal. Then we know, that we can trust them

4

u/Top-Divide-1207 12d ago

I think you need more practice writing English because your comment is quite hard to understand

5

u/severencir 12d ago

Cut him some slack, he's using the 1 bit quant language comprehension model in his brain

1

u/Additional_Art_24 12d ago

At least i know other language

1

u/severencir 12d ago

Yo tambien. No se que estas diciendo con esto.

1

u/Additional_Art_24 12d ago edited 12d ago

I see. Very good 10/10. Applause.. HORAS

1

u/Top-Divide-1207 12d ago

K, I wasn't trying to be mean

3

u/severencir 12d ago

I was just trying to be funny. I wasn't getting on to you

87

u/Linkpharm2 13d ago

No, they figured out how to split the integer. We now have 0.5 bit.

5

u/ShaderCompilation 12d ago

Isn't this nuclear type shit?

9

u/BlockApoc 12d ago

Mhm will nuke any code base it touches

14

u/Gohab2001 13d ago

No, DeepSeek is just stupidly optimzied.

https://inferencex.semianalysis.com/run/deepseek-v41-flash-on-b300

$0.002/1m tokens

145

u/BuffMcBigHuge 13d ago

$5.99 for mistral.ai student plan, 165$ worth of deepseek v4.1 1017, just saying

43

u/PhoenixtheII 12d ago

That's misleading, that's the yearly plan, NEVER in the current day commit a yearly plan to AI subs right now. Scene moves too fast.

5

u/0xSnib 11d ago

Can confirm, very much looking forward to my annual Cursor sub to expire

1

u/matthewhale 11d ago

They got deepseek v4.1 flash too...it's mighty cheap even at max...

4

u/jaster_ba 12d ago

This is what were people saying last December when I subscribed for yearly GLM coding plan for 120€. The legacy v1 plan has no weekly quota and I have reached the 5h quota maybe once or twice.

2

u/candraa6 12d ago

GLM is outlier,

most yearly plan became shit after a while, but that's because few months ago the model pricing tends to go up, but now the trend became the opposite, providers race to the bottom, this is the efficiency era I guess, so yearly plan might be worth it

2

u/CloudNine3282 11d ago

If we really are in an efficiency era and a race to the bottom, a yearly plan is the worst move. Whatever you lock into today will be obsolete and overpriced in six months. The only exception is when a lab (GLM, DeepSeek) sells heavily subsidized access at a pure loss to buy market share

1

u/candraa6 11d ago

hmm make sense. I use opencode go where they always give updated discounted price / usage allowance. so my assesment above indeed a bit biased and wrong. most providers wouldn't do such thing.

1

u/Standard-Goose-3958 6d ago

Its efficiency era because the new hardware is not out yet or installed. So they have a choice, die or adapt.

1

u/Victorbar974 10d ago

I did exactly that and I deplete the pro 5h quota in half the time , now I am not sure if to u0grade to GLM max or switch to the expensive Anthropic

1

u/Njagos 10d ago

Monthly pro sub on Mistral is 18€ for 255€ usage still very good

1

u/Fit-Produce420 9d ago

But Mistral is a shitty model, there's no cost savings you could convince me is worth it because it doesn't work.

1

u/Njagos 8d ago

You can use DeepSeek and GLM with it

1

u/EagleNait 9d ago

The one exception was copilot. Damn I generated hundreds on millions of tokens of opus 4.8 a day for a year with that for 40 bucks a month

1

u/ThePsychopaths 9d ago

Yeah. It's a a shame it's out now. I was on 10$ plan and it was also a lot

1

u/censor_this 9d ago

I don't know... My OG glm subscription from last year gets me about 10x what I could get on their new subscription style plan... I won't be renewing in January to the new subscription format, but for $120 for the year, I got waaayyyy more than my money's worth.

2

u/CraaazyPizza 9d ago

At this point buying a yearly sub is like an option market at the stock market. I'm bullish on Mistral being a good deal

1

u/Fit-Produce420 9d ago

My 75% off grandfathered plan for z.ai begs to differ. It was extremely cheap for billions of tokens a month, I'm not saying everyone will come out ahead, but you could.

Specifically I scheduled new or continued work at each 5 hour window, if you only used in when you were at work/home/awake you couldn't farm that many tokens.

1

u/Randomblock1 8d ago

No, $5.99 is the monthly price. $4.79/mo if you go annual

1

u/zenerbufen 8d ago

No, it's NOT misleading. $4.79 / month is the annual plan, $5.99 is the full month to month student price. Please don't spread disinfo.

10

u/Nokushi 12d ago

how do you calculate 165$? pricing page says for the student plan you get 15$ of api credits

6

u/Low-Gold5909 12d ago

For use with the API. The subscription usage is separate. On the €18 plan it's €255 of usage and €25 of API credits. The wording is just not very good.

1

u/Nokushi 12d ago

okok thanks for clarifying, ngl i find it quite odd they're not stating this in their docs nor pricing page, it's really confusing

and i guess you can't use your mistral sub in opencode, as they keep a separate api credits allowance?

1

u/Low-Gold5909 12d ago

I haven't tried but I think you can use it in Opencode with the sub. Someone else in here has said you can.

1

u/tactic-impress-55 12d ago

source?

2

u/Low-Gold5909 12d ago

I use it...

4

u/ArgenEgo 12d ago

Do you use it in the Vibe CLI? Or in another place? Do you get $165 un usage? I don't see anything in the docs :/

2

u/Helpful_Jelly5486 12d ago

Vibe cli draws from subscription instead of api. API is for other apps and harnesses. Source: I asked vibe. Also vibe cli is somehow linked with vibe code web. I can start a session and /teleport and it’s sent to vibe code web.

2

u/Low-Gold5909 12d ago

I use it in the CLI and in Vibe Code web. But afaik you can use your subscription API key in any harness.

1

u/MadOff33_real_one 11d ago

Sauf si ton harness est rattaché à un tiers comme zoo par exemple. La c’est motif de ban !

6

u/gwhorn 12d ago

don't see anything like that in their website, got a link?

4

u/HMikeeU 12d ago

1

u/Expensive-Coffee0110 4d ago

Does anyone know if there are usage limits? Because Claude Pro has a poor limit, for example

6

u/Far-Classic-9963 12d ago

I can't find anything on their website about other models use

8

u/AcrobaticOutcome7895 12d ago

I can't find any reference of ds v4.1 usage on the mistral site. How did u get $165 number ?

12

u/co-lor-less 12d ago

He's right, and if you pick the pro plan at 18€ then you get 255€ of credit, and as you can see here you can pick deepseek, glm 5.3 and flash. Also the t/s output is much higher than opencode go.

3

u/iForgotso 12d ago

255? It's 25,5$ of credit... How does that add up?

1

u/co-lor-less 12d ago

Because the API credit and the vibe credit are different, I posted a screenshot of my usage in another comment. You can just see for yourself.

5

u/butterfly_labs 12d ago

Noob here, could you explain the difference in API credit and vibe credit?

I assume API credit means you can use with the agent/client of your choosing, while the vibe credit must be consumed in their proprietary agent?

I don't understand why such a big gap, or even why there's a gap at all. Compute is compute, it costs them the same no matter the client you use, no?

1

u/MorganProtuberances 10d ago
  1. subscription ("vibe"?) is flat rate. some people use it all, some don't. you get a better deal

  2. API credit is the cost as if you used their API directly, like if you built a product that talked to their AI on behalf of your users. This is charged at a premium rate that is profitable for the ai business.

example: $100/mo claude subscription, when 'maxed', spends the equivalent of like $2000 in api credits (which in reality costed anthropic much much less than that).

2

u/iForgotso 12d ago

Interesting, it directly contradicts what the website says, but good to know. Ever tried it in other harnesses?

2

u/co-lor-less 12d ago

I use it in opencode, I never tried their vibe cli tbh. It somehow doesn't work with pi though, I'm not sure why.

1

u/iForgotso 12d ago

I use opencode as well, so that's great news. Thanks, will check it out!

2

u/Low-Gold5909 12d ago

I don't think it contradicts, it's just not worded very well. The API credits are for you to use in the API directly.

1

u/iForgotso 12d ago

Not worded very well is an euphemism, I still couldn't find any indication of the vibe usage available, I'd still have no idea they had separate usage pools if it wasn't for reddit.

1

u/Low-Gold5909 12d ago

Yeah, I feel like it was recently changed because I'm sure it was a bit clearer when I signed up a week ago. Still didn't explicitly mention the €255 of usage but it did seem more obvious...

1

u/iForgotso 12d ago

Ahh, the good old progressive cut off

7

u/mystic_node 12d ago

I think he's referring to vibe-cli allowance, they do provide a monthly vibe coding allowance if using their cli ig, not sure tbh, never used it, would like to know more about it

8

u/co-lor-less 12d ago

You can use it with any coding harness, it's not limited to their own.

4

u/mystic_node 12d ago

Damn that's really a steal at that price

4

u/co-lor-less 12d ago

It really is credit usage

2

u/JosephDEWS 12d ago

how you connect to open code the api key ? i mean the api key in my account shows 15 dollars? while the vibe code shows 150 dollars so how this work with open code?

1

u/co-lor-less 12d ago

From there you click on advanced and it'll show the vibe api key.

3

u/NebulaCake 12d ago

I wish I had a student email address 😩

6

u/Motor-Ground4594 13d ago

question, does mistral allow to use another harness like opencode go ?

22

u/p3r3lin 13d ago

yes, API key for the subscription can be plugged in everywhere

3

u/Motor-Ground4594 13d ago

Got it, Thank you!

2

u/Puzzled-Home9451 12d ago

Is that good ? Haven't heard much about it

2

u/Wanderspor 10d ago

Wait what I thought mistral was just a model

1

u/duboispourlhiver 10d ago

They slowed down on model training and pivoted to more of an inference provider and AI consulting firm

3

u/el-cacahueto 12d ago

Anyone know the quantization it run at ?

2

u/NigeriaBoi420 12d ago

They r gonna nerf it now

1

u/playvltk03 12d ago

I saw $15 worth of api. Care to elaborate? I’m curious what they offer there

2

u/Disguised9 11d ago

It's the vibe quota, it's weird I know, you can plug it to opencode

1

u/SmartCustard9944 12d ago

Welp, now everybody will discover the secret

1

u/Fortune_Cat 12d ago

does the regular pro plan give you any credits?

1

u/roztok_potok 11d ago

16FP model?

1

u/kelvinwop 11d ago

the only downside to mistral ai is that its digital and not physical or i would use it as toilet paper

1

u/NotARedditUser3 9d ago

I am on a 5 person development team and our entire monthly retail API rate usage on openrouter does not exceed $165. I'm serious. We're at $152 in the last 30d.

1

u/LetrixZ 7d ago

"Log in with your student email to claim discount"

0

u/Leather-Cod2129 12d ago

15 usd of Claude pro plan worth 10000 usd deepseek

25

u/Square_Confection_62 13d ago

What I dont understand is, why peak pricing still applies?

9

u/qqYn7PIE57zkf6kn 12d ago

flattening the curve is always good for providers, be it llm inference, electricity, medical services what have you. having peak pricing put the invisible hand at work to flatten the curve.

2

u/Big_Law_3080 12d ago

Maybe, but that helps them, doesn't help me. Peak is 2x the price. China time starts around 9pm EST my time. So I can work 9am to 9pm for offpeak. If that time went to peak instead, I would not use that provider.

Deepseek Harness can be configured to show all models rate card at the time of interrence. It goes red, I nope out. Easy as.

47

u/AdFun4897 13d ago

Holy fk.

We just need DS 4.1 to match Opus 5.5 in a couple of months, and i will cancel all my subscriptions with these closed source companies

18

u/Ecstatic-Diet-1375 12d ago

You said this 4 months ago

24

u/Takeoded 12d ago

You said this 17 minutes ago

8

u/OnyxMonolith 12d ago

I said it now. Jk

I dont think people understand how far ds 4.1 is from opus 5.5 max

6

u/FortheredditLOLz 12d ago

The gap between these two is like the best basketball player in a friends group going up against the great (LeBron/Kareem/Michael/etc…)…..while the numbers look somewhat close. The actual performance difference is massive and a HUGE hurdle to overcome

1

u/JLongTom 9d ago

I think people's point is that if all you need is to drop a ball in a waist-high hoop, why not go with your friend (who probably eats less too)

10

u/Illustrious-Many-782 12d ago

Fable 5.5 is coming soon. So is 6.1 Astra, and then Opus 6 after that. All probably before DS v4.1 Pro, meaning that it will still be 4-6 months behind, and most people will pay the extra money for the extra intelligence.

The demand for the highest intelligence possible is almost unlimited. "Good enough" certainly has a market, but it is not infinite.

5

u/Itchy_Tiger2497 10d ago

You’re vastly underestimating the utility of much much cheaper inference at roughly current levels of intelligence.

Every task has a ceiling for required intelligence.

2

u/karchnu 10d ago

I want a smarter AI for my hello world!

1

u/Altruistic-Wolf-3938 9d ago

Well, I can work toward a goal, but it is been 3 months already, with significant advances and milestones attained.  But I can see how a more intelligent model could need less guidance , make less mistakes , and reach the goal a lot quicker. The intelligence here not being intelligence I guess but ability to plan further in advance and to keep all the elements of the project in mind , not dropping random 600 documents of a dataset of 5000, before the main training of 49 hours of max gpu use. It is actually not intelligence. Intelligence is weird. I would say in these models , being intelligent is mainly being able to forecast further while being closer to reality 

1

u/steaksaucw 8d ago

Good point.

1

u/anengineerandacat 9d ago

Opus 5.5 to me is "genuinely good" for my tasks, I think their comment around intelligence requirements is quite true and these models are reaching levels where you don't need the latest and greatest any longer.

For coding and such latest models produce average to above average output, whatever comes next might push it to above average which means whatever comes after just needs to be cheaper and more efficient.

Considering how this last year went, that would likely mean by September next year this might actually be the case.

1

u/macronancer 9d ago

The thing with building intelligence is its not like building a higher and higher building, its more like building a ball thats more and more round.

Aftet a while it will be round enough and improvements will be marginal.

3

u/Significant_Spring87 12d ago

I use opus 5.5 as director for ds 4.1 workers, with red team fable. I wish ds 4.x could run with them. I'll be honest after working with Astra it was only good for review and security still. I wanted it to be a daily driver but just was a token drain and didn't get it done.

2

u/davidagnome 12d ago

This. Eventually it’ll be like the difference 4K vs 8k. I can’t tell the difference. Not on a 27” monitor. The quality of the open model and their price will exceed good quality frontiers today.

1

u/CatSecond 11d ago

Dax was just joking

1

u/KrydanX 9d ago

Yeah and when DS is on level of opus 5.5 we have opus 6 which massively outclasses DS. This play of catch won’t be going on forever, once one of the big player figures out RSI it’s over with. DS can’t distill fast enough to catch up, and even if they do so - they can’t match the compute or bring a model that runs on affordable hardware. No idea where this cope comes from.

15

u/azadkashur 12d ago

I don't know what's happening behing the scenes, but I gave same task to OpenCode and Cline with same backend provider, using DeepSeek-flash-1701.

In Opencode my API usage was ~$14 and in cline my API usage was ~$4.

Same model, same provider just different harness. For context, opencode session had 5X cache tokens

11

u/reybrujo 12d ago

Geez, that's insane, one task $14? That sounds like "Write a SNES emulator, make no mistakes" type of prompt.

3

u/azadkashur 12d ago

I build a multi-phase plans, as I work on a large backend system. I do a lot of testing per each phase, and make sure it's "green" before moving to next. So yeah. It's a make no mistakes kind of prompt.

4

u/samxli 12d ago

More like, “it’s okay to make mistake just make sure you fix them and keep going” type of prompt.

2

u/Easy-Mad-740 11d ago

I do the same, with independent reviewers for every single PR and extensive testing, but never reached more than 1-2 dollars per task

1

u/azadkashur 11d ago

AI, is good to get the job done faster, but I'm yet to find a model which will execute anything flawless and without needing supervision/checks and balances

7

u/theresurrected99 12d ago

Cline does write less. That's a problem in cline. I watched it carefully saying I spent 0.90 cents. While the deepseek platform itself says $5. So cline isn't trusty on that

3

u/Dantzig 12d ago

But the harness litterally decides what to send to the model so is it surprising?

3

u/azadkashur 12d ago

Yes, that's why, I moved to Cline. OpenCode is starting to become Microsoft of harnesses. Too many things in the background.

3

u/ZeroSkribe 12d ago

Pi enters the chat

2

u/Few-Strawberry2764 12d ago

What about cline vs dsh?

0

u/Dantzig 12d ago

Claude code can be run with other LLM's than Anthropics afaik

1

u/No_Committee8392 12d ago

Yep. not sure of its “easy”/integrated yet though i think you still just need env vars for it

2

u/TimChr78 12d ago

They definitely has different default reasoning levels - if you set the reasoning level explicitly you should see much closer token usage on OpenCode and the official Deepseek api.

1

u/Negative-Web8619 12d ago

Automatic context compaction by Cline?

1

u/Upstairs-Version-400 10d ago

Try Pi, I would be very curious because I spend less than 50c on moderately heavy tasks 

26

u/TripleMellowed 13d ago

30 times more value at 30 times less speed.

26

u/cuteseal 13d ago

It’s $10 of Deepseek and $290 of “Hmm… hmm… hmm… hmm…”

7

u/codeVerine 12d ago

“Wait blah blah blah…. Wait blah blah blah… wait blah blah blah…”

2

u/Mofman1 12d ago

Hmm. Hmm. Ok.

1

u/Illustrious-Tap2561 11d ago

Hmmmmm but hmmmm

17

u/Early-Crazy-4246 12d ago

Can I be enlightened as to why people are so persistent on claiming OpenCode's DeepSeek is quantized? I mean literally yes it is quantized out of the factory (Base weights are MXFP4) but I assume they mean OpenCode is quantizing it further (Which makes little sense and doesn't provide any benefit to OC)

On top of that, they've also said several times that they do not quantize the (already quantized) weights?

4

u/Background-Self-2324 12d ago

Also, double quant just doesn't work lol

3

u/LiteSoul 12d ago

People persist in that because a few times it seemed dumbed down in the past, and they invented the quantization rumor. In reality there was some technical issues that are being sorted out. Think about it, with the racks OC have, and how small the model is, it doesn't make sense whatsoever to quantize it further, but people is mostly ignorant technically

0

u/gugugaga_069 12d ago

It’s not dumbed down, but they routed most free-use requests to cheaper models to manage the load. it backfired and they reverted

1

u/jkflying 12d ago

There are also other things you can do to make serving cheaper at the expense of quality, like approximations during prefill

1

u/kagamiseki 10d ago

Seems OpenCode DSK model routes through 8 different suppliers, and 2 of them have smaller context windows or something so occasionally you have a longer task that lands on one of those suppliers and you exceed 100k tokens and see a drop in output quality.

Some of the suppliers are also much slower in tokens per second, so it will seem like the same model is struggling more, when it's really just moving the same tokens less quickly.

Finally OpenCode wasn't on 1017 checkpoint for a while. They are now, I think, but before they were literally on a dumber version than other brokers.

1

u/CandiceWoo 9d ago

pple benchmarked it to be worse. and well it could be buggy inference, could be quantization.

1

u/Early-Crazy-4246 7d ago

Won't be quantization (It's trained to be quantized already!), it could be many other things though, even the inference engine being different could be the difference.

My best guess is since their inference team is basically one guy and 2 guys who look over his shoulder, they got a lot of work to do

0

u/Drunkendrakon6 12d ago

Well money

4

u/Early-Crazy-4246 12d ago

In the case of money I'm sure they would've went for more conventional pricing (Starting at $20/month) and served the same from the start. OpenCode has their issues I've read all about it but having used their DeepSeek on Go before I swapped to just using DS API (And then GPT subscription) I couldn't tell you there was any trickery

4

u/rainpurplebow 12d ago

If you are using the model to write Python calculators of course you cannot tell the difference between OC's self hosted version versus the official DS API just like everyone else on this sub.

4

u/Drunkendrakon6 12d ago

All these AI providers are literally black boxes. They can say one thing and do another and as long as no one catches on they profit. I just wouldn't put it past them to screw over their customers silently.

6

u/akza07 12d ago

They are joking. Dude was so drunk that he is dreaming about optimising to $300 usage. When he wakes up, he'll say "Oops! I was drunk"

12

u/Total-Management8023 13d ago

this is NOT a good sign

5

u/ByteNomadOne 13d ago

Why?

15

u/summit_fei 13d ago

Expecting a quality degradation.

1

u/ByteNomadOne 7d ago

Ah, higher quantization. Of course.

3

u/Edelgul 12d ago

Is it 1017 deepseek that they are currently offering?

7

u/Johhaidiidiralla 13d ago

Its easy how. They just increase their own price per request 3 times and voilaa!
People still don't realize that their 10 for 100 was never an equivalent of ds api price.
If you don't believe me, dyor. I did. In best case its 3:1 ratio and on average its less than that.

3

u/letuslisp 12d ago

This was my suspicion. But also the problem is their short cache time. DS keeps the caching alive for hours.

1

u/LiteSoul 12d ago

What's the cache time for open code

1

u/letuslisp 12d ago

Really? Openrouter only 5 min or 10 min No opencode only that short. Only deepseek has so long caching

5

u/FinalTap 13d ago

They got it to run on cheap Huawei cards?

2

u/summit_fei 13d ago

Huawei isn't that cheap

4

u/Mobile-Poem9164 12d ago

frank : "yea dax, we can now do ggufs like Q1_XS and nobody will notice !!"

xddddd good one

2

u/Piyh 12d ago

I'm so tired of x vague posting

3

u/kamwee 12d ago

here come q1 deepseek

3

u/Any_Confidence2580 13d ago

lmfao, ok. Keep tweeting kid.

3

u/eXperience79 13d ago

More allowance is good, more quantization is not. At least, let us select the quant level.

3

u/TronnaLegacy 13d ago

Why do y'all have to make it so hard to stop giving you my money

3

u/Slow-Set-2856 13d ago

Please don't fuck up the quality even more it already is worse than official api on benchmarks

2

u/vacterro 13d ago

Good, if true.

2

u/KindHustl 13d ago

That be cool if it actually applied this month

2

u/Terrible_Scar 12d ago

By giving you a quantized-to-shit model. 

1

u/Glittering-Comb-9336 12d ago

We need that now pls

1

u/inscrutablemike 12d ago

Did Frank then proceed to tell him what's happening right now or is Frank a drama llama information hoardin' mfer?

1

u/NigeriaBoi420 12d ago

Fucck stop talking about mistral its bad bro

1

u/HeadLeadership8763 12d ago

Crazy? This is madness!

1

u/GodComplecs 12d ago

Bro they running Strata as the backend probably lmao

1

u/dumbasPL 12d ago

How about keep it $100 but make it faster? 100 is already basically unlimited, speed would be much more welcome at this point.

edit: and their calculation almost certainly includes the fact that many users will never reach 100% usage. So the few that do, are paid by all the ones that don't.

1

u/warpaint_james 12d ago

I was using 4.1 flash last night and getting over 200tps and more. So something was cooking

1

u/ulab 12d ago

I understand some of the words in this discussion.

1

u/Tall-Wasabi5030 12d ago

They figured out that half the shit people build is the same context / memory / orchestrator crap and they can just cache the outputs 

1

u/gpt872323 11d ago

lol. that would be interesting thing to try send same message prefix as different user in different api key does the previous answer temperature and other params make a difference.

1

u/Specialist-Cod-363 12d ago

I just want them to optimize for speed 😭😭

1

u/Conscious-Doctor-585 12d ago

To save the servers from potential overload, OC shall refrain from rolling out plans like $5 for $150 of ds, $2 for $60, $1 for $30

1

u/OpenSourceCVEs 10d ago

I have not felt like I lacked when using the Chinese models. Yes, they're rougher than frontier Western models but for my use case, I still do (and enjoy) the deep analytical work and so haven't felt the need of a 'genius' AI yet.

As an enthusiast, I'm excited about the capability coming out but I've seen diminishing returns in utility, especially when measured against the token consumption rate.

I just need a reliable enough AI, especially for parsing large amounts of data. Though I have an OAI sub, it's mostly to use as an orchestrator for my Chinese models.

I'm experimenting with local LM but until I get something better than 3070, it's not super practical for my use case.

1

u/CardiologistStock685 13d ago

What is this dark story telling us? And who will actually be the winner? We can't just have too many winner!

0

u/PossibilityUsual6262 12d ago

None of this make sense, the whole thing looks like schizophrenia.

-1

u/the_foreigner63 12d ago

Okay bro, I wish 300 usd is not just a number. I exhausted opencode go monthly quota with around 9B dsv4.1 tokens when amplifier was 80usd of dsv4 for 10 bucks, so its around 4 times more tokens, i guess ~33B. Would be certainly enough for me, id even buy go plus if this would be true. And again thanks opencode for cheap access

0

u/MadOff33_real_one 11d ago

Pour un etudiant en ostéopathie en France vous pensez que cela fonctionne ? Je sais je fais aussi ma réponse : il n’y a qu’à leur demander ! 😜. Mais au cas où… Thanks

0

u/[deleted] 12d ago

[deleted]

4

u/WaderMorghulis 12d ago

The Kurdish Way

0

u/[deleted] 13d ago

[deleted]

→ More replies (6)