(I don't follow the AI stuff here, so sorry if this is a stupid question. Or the wrong category.)
There is a new fangled AI mode called JEV. Can the current Apple Intelligence libraries do something like it, or is this a WWDC27 thing?
I have been thinking of adding a Jev model type to the LocalLM Lab SDK. You call a single API and underneath, you can select either Jev (via OpenRouter, or TypeSafe) or OpenJev with a downloaded model (via MLXFoundationModels) . What's the level of interest like? I always like to ship SDK features with example apps and have been struggling to find an easy-to-illustrate use case. Thoughts?
I did some research into Jev. The on-device Apple Foundation Model is capable enough for this, since you don't need a heavyweight model for typed decisions. The challenge is that Jev-style decisions rely on reading the model's scores for each option, and as far as I can tell the Foundation Models framework doesn't expose logits. I may be wrong and look forward to be corrected....
I also looked at OpenJev, which lets you use open-weight models for decision use cases. Since you can read the option logits there, it may be the way to go for now.
I put together JevDK, a playground for learning more about Jev. Its implementation is based on OpenJev and models from HuggingFace. Using Jev is so different from using a regular chatbot that it feels like a different world altogether, so I got a lot of benefit by actually hands-on experimenting with it.