In the new Xcode we saw examples of Claude, OAI & Google coding agents that you can start conversations with inside your project, giving it access to your project files context. As far as I understand, this requires an API key for those models & the processing is run on Anthropic / Google servers, not locally nor on Private Cloud Compute.
Is it possible to instead, use the LLM powering Foundation Models, for a “Siri Code Agent” which operates in the place of those models, but runs on device or in Private Cloud Compute?
I like how this works for Siri AI requests, and would love to have a coding assistant agent that can operate in the same privacy preserving way!
Is this possible with any of the open source frameworks or the command line tools? If not, what is the best way to request this feature?
this requires an API key for those models & the processing is run on Anthropic / Google servers, not locally nor on Private Cloud Compute.
Yes, that is correct.
Is it possible to instead, use the LLM powering Foundation Models, for a “Siri Code Agent” which operates in the place of those models, but runs on device or in Private Cloud Compute? ... Is this possible with any of the open source frameworks or the command line tools? If not, what is the best way to request this feature?
I’d suggest that you start with filing a feedback report. Thanks!
Best,
——
Ziqiao Chen
Worldwide Developer Relations.