r/opencode • • Sep 20 '26

Any1 using Jev?

seems promising.

2 Upvotes

35 comments sorted by

13

u/Southern-Ad-3006 Sep 20 '26

Yes. First thing I would do is ask a frontier to analyze your Agent Harness + Business + Dev workflows. Anywhere that you have any built in routing, classification, confidence, verification that is done by flash+frontier models can be done in .100 ms instead of 10 seconds, and $0.0004 instead of $0.04. That’s 100x faster and cheaper so scaled systems is where you’ll see this used.

You will be surprised just how many of those tasks are actually being done right now in systems&workflows by inefficient models. Implement Jev to run those tasks, and then for example have it hand off to a flash or frontier or another workflow next step when needed.

4

u/FnZombie Sep 20 '26

I love hypotheticals but give us a working example of this.

1

u/Andsss Sep 27 '26

This mf said nothing 😭😭😭, he surely was in the hype train

2

u/sam7oon Sep 20 '26

So "No" then, you have not used it, the question is did you !

1

u/matteoianni Sep 20 '26

Unfortunately it can do none of that stuff with a 32k token context window. A good decision maker needs the whole picture. If you break things up for it you end up with bad decisions.

2

u/Southern-Ad-3006 Sep 20 '26

That’s not a good way to look at the model. You don’t need it to carry a large context across multiple turns in a request like a traditional language model for most use cases. Jev can only run a single turn. One turn, one decision on a chunk of data, and then Next chunk of data just use another turn and Jev call.

A better way to look at it is you can process 320k new tokens back to back in a second, and make 10 intelligent decisions in a blink of an eye on that data. You’re not having a conversation with it or having it create something for you. This is something you build systems/workflows with. The idea being the intelligence comes so quick and cheap, you can now put blocks of intelligence in your applications where you couldn’t before without lag and big bills.

There’s a reason you don’t put a flash model processing every single webhook event from an app log for example; it takes a long time to process, and would be extremely expensive. It makes more sense to run scripts on big data only bc of speed and cost (and determinism!!). With Jev, you could put him in front of any stream of data, thousands of events in an hour for example, and Jev could reason through every bit of data and correctly route to tools or a language model if you need the extra context window or reasoning.

I do think these type of models will eventually be able to do all of this but at a bigger scale w a bigger context window. However, what you said is probably incorrect about it being unusable without a larger context window. I think you overestimate how much of your workflow requires a larger context window and reasoning model.

(Models context window’s main purpose is to carry conversation memory across turns so it doesn’t forget immediately after in the next turn … one request can take 50+ turns easily & then with multiple requests conversations need large context windows.

With Jev, it’s just one set of data 32k max per call and it runs just one turn quick asf. Or it could take 4 sets of 8k data and it can run 4 parallel decisions with one turn making it even more efficient for batch data.)

With these models I think we need to think differently outside chat bots and conversations you have with it, and more like a workflow node or compute tool you can put in front of any data and before any step at scale for pennies instantly. Might not be the right tool for you or you need to reframe how you look at the doors it opens for devs and builders.

0

u/Yann27 Sep 20 '26

exactly it i feel like it can speed things up.

1

u/Southern-Ad-3006 Sep 20 '26

Major. I can see it augmenting most scripts used in most applications, where there can only be a set amount of outputs anyways.

13

u/MultiBotRun Sep 20 '26

Jev is interesting, but the hype around it is excessive. Open projects such as Laya and Decider are already exploring the same decision-model approach, with public code, weights, and training details. In my view, these open alternatives are more valuable to the community than presenting Jev as something completely unique.

3

u/sam7oon Sep 20 '26

Indeed its just Hype, however the positive thing, since it got attention, this area of research will get a lot of money poured in now, so we benefit on the long term , the more we research, the better overall the ecosystem gets

2

u/traderjames7 Sep 20 '26

Nobody claimed it'll be the only tool like we'll ever see. Just like LLMs themselves the concept is far more important than any one model.

7

u/joeyb908 Sep 20 '26

Yea, but Laya is a year old at this point. It’s not new tech and Laya does it better in almost all aspects than Jev while being about 2.5 gbs and completely open source.

4

u/sam7oon Sep 20 '26

i a lot of Hype / Slop posts geenrated everywhere specielly on X, talking about how this will kill Claude, and GPT, despite that the fact, this is not a generation model, most of the posts, have not even tried ot to see, that this does not compete with those :( ,

1

u/Haster Sep 20 '26

Thanks! I hadn't heard of Decider.

1

u/Due_Photo_5206 Sep 23 '26 edited Sep 23 '26

Hi I’m using Jev as a sub agent with k2.7 code in ChatGPT. (Trying to do savings, not really working…)  I’m doing refactoring (so I suppose not a lot of thinking here) and I mainly use it this way :  chatgpt formats a request for k2.7 (Kimi) as an orchestrator and asks Jev if it will be able to do it.  It obtains a score and either it gives the task to Kimi, or does it itself, or gives it to Kimi but reinforces checks and tests before validation.

 I  hardly get Jev validating k2.7 so my questions are:  Are the Chinese models as good and cheap as described?   Is ChatGPT reluctant to use k2.7 and maybe dishonestly hiding it (getting paranoid a little these times !) ? Is Jev misjudging because of mal formed requests (not enough context, …) or misjudgments of its own ?  I gave Jev thresholds for credits expanses and ChatGPT thresholds for Jev scores of feasibility by k2.7. And had to get as low as 40% for Jev scoring Kimi, still rejected. I ask ChatGPT a report on sub agent usage at the end of each turn: negative all the time… I use all that through mcp servers.  Bypassing Jev allows some requests and we are trying to gradually reuse Jev but as for now with no success

1

u/Yann27 Sep 23 '26

Kimi is Chinese bro

1

u/Due_Photo_5206 Sep 24 '26

Yep. But I don’t think western models can be overtly partisan (but I keep it in mind).  In fact I don’t think these models can be judged morally at all: from the technical point of view these ethic stuff is a border effect there is no judgement at all in their “behavior”.  It’s just a learning problem, I bet. Hard to keep objective ! Technically I put max_tokens to the max (82xxxx I think) and keep Jev as an external advisor, just monitoring its judgements , comparing them to the real outputs and waiting to get enough material to have stats and see if it worth it. In the same time, I ask gpt to refine its requests and provide better context when the gap is too important. 

2

u/SixCupaCoffee Sep 20 '26

tried to I think it works, I mean, its fast guys

2

u/KajeesanJeevendra Sep 20 '26

I'm trying to implement it into OpenHealthAtlas to create better and more efficient tool calls for the main agent to analyze bigger amounts of data.

2

u/FormalAd7367 Sep 20 '26

Another overhyped thing in AI? Watched a bunch of videos and can’t figure how it can improve my own workflow? Another Openclaw moment?

1

u/krautsourced Sep 20 '26

it's like calling a regular LLM with structuredOutput, but faster and clearer defined output. it's not a magic bullet but great for use cases where you value deterministic-ish results.

1

u/[deleted] Sep 20 '26

just implemented to one of my projects with openrouter api. looks cool and usable

1

u/Vast_Muscle2560 Sep 20 '26

appena testato, va bene per utilizzo come subagent ma non per pianificare o farsi spiegare. non parla, quindi attenzione

1

u/traderjames7 Sep 20 '26

Good video explaining the stories of Jev and Laya - not my own but found it useful https://www.youtube.com/watch?v=KySbNMsBU70

1

u/Miclo8 Sep 21 '26

I have a project and an mcp server that I’m using to give it a go.

15 minute theorycrafting sessions are around 6 minutes now with deepseek models. Haven’t tried other models, but for a very indecisive model it’s a very good improvement.

1

u/tom_reddit Sep 21 '26

I built a free and open-source tool called Slop Mop based on Jev to help with our LinkedIn feeds. Try it out here: https://slopmop.lol

-1

u/Time-Toe-1276 Sep 20 '26

Besides things like figuring out whether to use none, low, medium, or high reasoning, or classifying things generally, ABSOLUTELY NOT!

tbh they oversell JEV. It's just another classification model

1

u/Yann27 Sep 20 '26

what model do you prefer for classification... i'm curious always get stuck with that part it takes so long.

1

u/Time-Toe-1276 Sep 20 '26

idk, I personally used models like qwen3.5 or gemma (now ling too) for classification stuff (locally ofc), I used to use ling-2.6-flash since its basically free in openrouter.

but now that jev is here, i would give it a shot, but I wont say its good either, they kinda oversell it on purpose.

but its definitely looks promising for the tasks i said.