Using FoundationModels framework in Extensions

Question

Created 1d

Replies 2

Boosts 0

Participants 2

This post is from the WWDC26 Foundation Models Q&A.

LLMs are renowned for using so much RAM. Does this mean we can't essentially use FoundationModels in extensions such as MessageFilterExtension? I assume the system kills the extension before we even get a response.

Answered by DTS Engineer in 892976022

Thanks for this great question. The system language model (SystemLanguageModel) is not loaded into the app / extension's memory, and so using it doesn't count on the memory limit of your extension. If you are using your own on-device model, the model will be loaded to the memory of your app / extension, and so you will need to test if that is fine for your extension. Note that some extensions don't allow XPC due to privacy reason, and hence can't use a model via the Foundation Models framework.

Best,
——
Ziqiao Chen
 Worldwide Developer Relations.

Answer 1

DTS Engineer OP

Apple

1d

Recommended

Thanks for this great question. The system language model (SystemLanguageModel) is not loaded into the app / extension's memory, and so using it doesn't count on the memory limit of your extension. If you are using your own on-device model, the model will be loaded to the memory of your app / extension, and so you will need to test if that is fine for your extension. Note that some extensions don't allow XPC due to privacy reason, and hence can't use a model via the Foundation Models framework.

Best,
——
Ziqiao Chen
 Worldwide Developer Relations.

Answer 2

taheri OP

1d

Thanks for your response. Just a clarification:

Note that some extensions don't allow XPC due to privacy reason, and hence can't use a model via the Foundation Models framework.

Does this include SystemLanguageModel?