In our case, the files stored through git-lfs are not used for the package we are building so running the following before is doing the trick
language
git config --global filter.lfs.required false
Topic:
Developer Tools & Services
SubTopic:
Xcode
Tags: