Notary service: submissions stuck "In Progress" for days, never completing

I'm hitting what looks like a service-side notarization problem and could use a pointer on how to get it escalated.

Over the past 3 days I've submitted 9 times with notarytool. Only 2 came back Accepted. The other 7 are stuck at "In Progress" and never reach a terminal state, no Accepted, no Invalid, no log (notarytool log says it isn't available yet), and no email. The oldest has been sitting ~71 hours.

Signing checks out: codesign --verify --deep --strict passes and satisfies the Designated Requirement, hardened runtime with a secure timestamp, no get-task-allow, signed with my Developer ID, and the DMGs are signed before submission. The 2 submissions that completed were Accepted, so credentials and signing are fine. It really looks like the service just isn't processing most of my submissions.

This is a newly enrolled account, and I've filed FB22939442 and have an open Developer Support case.

Is this a known issue for new accounts, and is there a way to get these submissions looked at?

Environment: macOS 26.2, Xcode 26.5, notarytool 1.1.2 (41).

Answered by aadnan in 896986022

Good news first! I'm unblocked and shipping. With your nudge toward the upload I found a path that works, and the release is out and installing cleanly, including on a locked-down managed work Mac. So thank you, that pointer made the difference.

The way I got there: I moved notarization off my Mac and onto a GitHub Actions runner with a small retry loop that resubmits until an attempt gets through, and then I staple locally. That has been reliable and both DMGs came back Accepted on their initial notarization attempt.

I also dug into why it was failing locally, and wanted to pass along what I saw in case it is useful to the team. None of this is conclusive and I am definitely no expert, but here is what I found.

notarytool seems to be crashing on my end partway through the upload. Each submission gets an ID, starts the multipart upload, completes a few chunks, and then exits with "zsh: bus error." That lined up with my original report, where submissions sat at In Progress, never resolved, and then disappeared a day or so later. If the upload never finishes, that would explain why there was never an outcome email or a log to pull.

From the crash reports, as best I can tell, it looks like a stack overflow from some kind of runaway recursion. The parts that stood out:

  • Exception: EXC_BAD_ACCESS (SIGBUS), subtype "Could not determine thread index for stack guard region," with the fault landing in the Stack Guard region.
  • Faulting thread queue: nio.nioTransportServices.connectionchannel.
  • The stack shows the same small set of notarytool frames repeating over and over, through String.init(format:) into __CFStringAppendFormatCore, until it runs out of stack.
  • It crashes a few chunks into the upload of a roughly 328 MB DMG, and the chunk where it dies is different every run (I saw 0, 1, 4, and 16 of 66), so it feels timing related rather than anything about the file itself.

My best guess is that a network change happening during the upload might be triggering it. My Mac has a lot of iCloud Continuity and Handoff activity (rapportd creating and removing utun tunnels for AirDrop, notifications, and so on), and quieting some of that down (Bluetooth off, Handoff off, awdl0 down, even pausing rapportd and sharingd) seemed to let the upload get further before crashing, though it never fully stopped. It also happened on a second Mac and occasionally on a GitHub-hosted macos-latest runner, so it does not seem specific to my machine.

Just wanted to share this in case it helps you all track down whatever is going on, since it seems like it could affect other people notarizing larger files.

I have .ips crash reports and can attach them here. I did attach them on the Feedback (FB22939442) with my update on that that ticket for the team. Thanks again for all the help.

You can expect that most uploads will be notarised quickly. Occasionally, some uploads are held for in-depth analysis and may take longer to complete. As you notarise your apps, the system will learn how to recognise them, and you should see fewer delays.

For lots of additional info about notarisation, see Notarisation Resources. Specifically, it links to a Q&A with the notary service team that’s quite instructive.

Share and Enjoy

Quinn “The Eskimo!” @ Developer Technical Support @ Apple
let myEmail = "eskimo" + "1" + "@" + "apple.com"

Thanks Quinn, this is really helpful. I went through the notary service Q&A and it lines up with what I'm seeing, a new app from a new Developer ID getting extra evaluation while the system builds a profile of it. That makes sense.

One practical question. Several of my submissions are now held at "In Progress" anywhere from about 73 hours up to over 106 hours (more than four days) without completing. A couple of others did go through and came back Accepted, so I know the signing and credentials are good. For the ones held this long, should I expect them to finish on their own eventually, or is it better to stop waiting on those and just keep submitting updated versions so newer uploads can go through as the system learns my app?

Mostly want to make sure I'm not sitting on submissions that are effectively stuck. Happy to share the specific submission IDs if that helps. Thanks again.

For the ones held this long, should I expect them to finish on their own eventually

Yes. Quoting that Q&A I mentioned:

rest assured that we’ve received your file and will complete the analysis, though it may take longer than usual

or is it better to stop waiting on those and just keep submitting updated versions so newer uploads can go through as the system learns my app?

Again, the Q&A has advice on this front:

if you’ve made changes to your app while a prior upload has been delayed, it’s fine to upload a new build.

So, if you’re making genuine progress on your app it’s fine to submit your new builds, but I wouldn’t bother submitting new requests for the same, or very similar, builds.

Share and Enjoy

Quinn “The Eskimo!” @ Developer Technical Support @ Apple
let myEmail = "eskimo" + "1" + "@" + "apple.com"

Hey Quinn, a status update since it's now been over a week.

Since June 2 I've submitted 17 times. 2 came back Accepted. 13 are still stuck at "In Progress" with no terminal state. The oldest has been sitting around 234 hours now (June 2), there's a group from June 3 at about 200 hours, and another from June 6 at 130-plus hours. The two newest are from today so I'm not counting those.

Same as before, the signing checks out on all of them, codesign --verify --deep --strict passes, hardened runtime with a secure timestamp, no get-task-allow, Developer ID, and the DMGs are signed before submission. One thing I noticed: it doesn't seem to be architecture or format specific. One of the two that went through was an x64 DMG, but other x64 DMGs from the same builds are among the stuck ones, with identical signing. So it really looks like the service is just not processing most of what I send.

Here are the stuck submission IDs, oldest first, in case they help:

a4a00bca-8c8a-470e-b5e8-cd12502166e0, Jun 2 c7d6a78c-eb77-42f3-bcac-bee5c45087ce, Jun 2 17231cbb-f3d7-4515-a332-3412aa9383eb, Jun 2 03a9f77a-b9e6-4c87-a248-578d0ed658a4, Jun 2 b0370f43-d853-40db-8baa-fde0802c0d15, Jun 3 86cea307-bf66-4e96-bc74-425f9c628fa9, Jun 3 06870927-c658-4eca-abce-abcbf03b9e05, Jun 3 a501ba81-1f40-439b-8317-4fb836cd6d92, Jun 6 fedfb6c6-0816-4f9d-916d-d6444207a2d8, Jun 6 865404c2-0986-48d4-8c76-f82886549d70, Jun 6 a6d39244-0d08-4ae6-84ba-8a91d8f294d9, Jun 6 beb2e92a-4141-438d-af92-4215cd221579, Jun 7 e7a4fc67-8e44-456c-887b-f3132ab16f36, Jun 7

I get from the Q&A that held submissions should complete eventually, and I'm not trying to rush the new-account evaluation, but ten days with no movement on the oldest ones is past the point where waiting feels right, and it's holding up a shipping app. Is there any way to get these specific IDs looked at on the back end, rather than waiting them out further? FB22939442 is still open and so is my Developer Support case.

Thanks again your help and happy to provide any more details!

Hmmmm, sorry I didn’t get back to you sooner here. WWDC punched a huge hole in my schedule. Are you still stuck? If so, am I right in saying that:

  • a4a00bca-8c8a-470e-b5e8-cd12502166e0 is your oldest stuck request?
  • And it was created on Jun 2?

Share and Enjoy

Quinn “The Eskimo!” @ Developer Technical Support @ Apple
let myEmail = "eskimo" + "1" + "@" + "apple.com"

No worries at all, thanks for circling back. Yes, still stuck unfortunately.

You're right: a4a00bca-8c8a-470e-b5e8-cd12502166e0 is the oldest, created June 2 and it's now been "In Progress" about 16 days.

Since we last spoke I've made meaningful progress on the build, and I'm now at the point of launching. Notarization is the one and only blocker left before I can distribute. I'm at 23 submissions total since June 2: 2 Accepted, 21 still stuck "In Progress," none reaching a terminal state. Same signing throughout, and the 2 that passed confirm the setup is fine.

My latest build is 1.6.2 (June 17), and it's stuck along with everything else:

9b1f37c6-8333-4689-bd17-7b485bd407dd — 1.6.2, Jun 17 9ab65288-64f5-433c-8a2f-0b6cc7908106 — 1.6.2 arm64, Jun 17 826d5318-211e-4253-9d81-fdd46efe8e8b — 1.6.1, Jun 16 8b9c2b0e-3fa0-4578-ae7e-4ef21e7eb9d9 — 1.6.1 arm64, Jun 16 So a4a00bca is the oldest, but 1.6.2 is the current release I'm trying to ship. Happy to send the full list of all 21 if helpful. Anything that gets these moving would unblock the launch.

Appreciate the help!

Hmmm, something weird is happening here. Please run this command and post the results here:

% xcrun notarytool info <CREDENTIALS> 78990d4c-dd2c-43fb-a599-00f5806c3a58
Successfully received submission info
  createdDate: 2021-12-29T10:59:11.813Z
  id: 78990d4c-dd2c-43fb-a599-00f5806c3a58
  name: QProcessDock.zip
  status: Accepted

Make sure to replace <CREDENTIALS> with your credentials and my request UUID (78990d4c-dd2c-43fb-a599-00f5806c3a58) with yours (a4a00bca-8c8a-470e-b5e8-cd12502166e0).

Share and Enjoy

Quinn “The Eskimo!” @ Developer Technical Support @ Apple
let myEmail = "eskimo" + "1" + "@" + "apple.com"

Here's what I see

% xcrun notarytool info a4a00bca-8c8a-470e-b5e8-cd12502166e0 --keychain-profile dockside
Successfully received submission info
  createdDate: 2026-06-02T01:13:38.226Z
  id: a4a00bca-8c8a-470e-b5e8-cd12502166e0
  name: Dockside.zip
  status: In Progress

And the log attempt on the same ID returns nothing:

% xcrun notarytool log a4a00bca-8c8a-470e-b5e8-cd12502166e0 --keychain-profile dockside
Submission log is not yet available or submissionId does not exist
  id: a4a00bca-8c8a-470e-b5e8-cd12502166e0

So 16 days in: info says "In Progress" with no message or issues, and log says the log isn't available yet. The submission ID clearly exists (info resolves it fine), it's just never reached a state where a log gets generated.

Thanks.

And yeah, that’s what I was expecting, but it doesn’t gel with our internal view of the state of this request. There’s definitely something wonky going on here, and we’ll use your bug (FB22939442) to investigate that.

Share and Enjoy

Quinn “The Eskimo!” @ Developer Technical Support @ Apple
let myEmail = "eskimo" + "1" + "@" + "apple.com"

Hey Quinn, another update.

At this point everything except my two original Accepted builds has disappeared from the system. notarytool history now shows only the two that went through on June 2 and June 3. Every other submission, going all the way back to early June that was stuck In Progress is gone, and notarytool info on any of those IDs returns "Submission does not exist or does not belong to your team." None of them ever flipped to Accepted or Invalid. There was never an outcome email or a log to pull.

The one thing that has changed is the timing. The early June submissions sat at In Progress for weeks, some close to a month, before they eventually dropped off. My most recent submissions are failing much faster: the four I sent over the last two days each showed In Progress in history right after I submitted, then disappeared within 24 hours. I did not catch the exact moment they dropped, but they were gone inside the day.

The four most recent, all now returning "does not belong to your team":

f0afb08f-c039-4d0b-99e6-62a1e86f61a7 Dockside-1.6.2.dmg (Jul 5, 03:50 UTC)

e1cbc151-ba6e-46cc-9645-532ff07a6489 Dockside-1.6.2-arm64.dmg (Jul 5, 03:49 UTC)

bed02f50-03db-4e5f-b271-97c18072c14c Dockside-1.7.0.dmg (Jul 6, 15:19 UTC)

8b1782c7-df50-476c-bf06-f4ba65a1af39 Dockside-1.7.0-arm64.dmg (Jul 6, 15:18 UTC)

So the end result is the same across dozens of attempts where nothing completes, and the submissions eventually get dropped from the system entirely. The only two that ever succeeded are still the two from June 2 and June 3, both Accepted.

Signing setup is unchanged and I re-verified it again: Developer ID Application, hardened runtime with a secure timestamp, no get-task-allow, universal native module inside the app, and codesign --verify --deep --strict passes clean and satisfies the Designated Requirement. It is identical to the two builds that came back Accepted, so I am confident this is not a signing problem on my end.

It has now been over a month and this is still the only thing blocking my launch. Happy to pull anything else that would help. Thanks again for staying with this.

Every other submission, going all the way back to early June that was stuck In Progress is gone

Right. That’s actually a good thing (-: Lemme explain.

The notary service’s In Progress state actually has a number of substates, including [1]:

  • Additional analysis I see this a lot, and I have a standard answer for it that I posted as my first reply on this thread.
  • Waiting for upload I explain that in this reply.
  • What you’d expect That is, the service is actually processing your request.

The ‘disappearing requests’ issue is a symptom of a failed upload; you can learn more about it in the reply I referenced.

Interestingly, it was this conversation that caused us to find and fix the issue with the ‘garbage collection’ bug (r. 181043760) mentioned in the footnote of that reply.

The one thing that has changed is the timing.

Right. That make sense given the above.

What’s still a mystery is why your uploads are failing to complete. It seems like you’re uploading with notarytool. Are you doing that directly from Terminal? Or via some sort of scripting solution? If it’s the latter, try doing the former to see if you can reproduce the problem there.

And if you can reproduce this when running directly from Terminal, please do the following:

  1. Submit your request with the --verbose option.
  2. Save the Terminal transcript.
  3. Wait to see what happens.
  4. If the problem reproduces:
    1. Update your bug report (FB22939442) with an explanation of what you did.
    2. And attach the transcript you saved in step 2.
    3. Then reply back here.

Share and Enjoy

Quinn “The Eskimo!” @ Developer Technical Support @ Apple
let myEmail = "eskimo" + "1" + "@" + "apple.com"

[1] This is based on my experience supporting the notary service. I’m not actually privy to all the details, so there may be more than I’ve discussed here.

Good news first! I'm unblocked and shipping. With your nudge toward the upload I found a path that works, and the release is out and installing cleanly, including on a locked-down managed work Mac. So thank you, that pointer made the difference.

The way I got there: I moved notarization off my Mac and onto a GitHub Actions runner with a small retry loop that resubmits until an attempt gets through, and then I staple locally. That has been reliable and both DMGs came back Accepted on their initial notarization attempt.

I also dug into why it was failing locally, and wanted to pass along what I saw in case it is useful to the team. None of this is conclusive and I am definitely no expert, but here is what I found.

notarytool seems to be crashing on my end partway through the upload. Each submission gets an ID, starts the multipart upload, completes a few chunks, and then exits with "zsh: bus error." That lined up with my original report, where submissions sat at In Progress, never resolved, and then disappeared a day or so later. If the upload never finishes, that would explain why there was never an outcome email or a log to pull.

From the crash reports, as best I can tell, it looks like a stack overflow from some kind of runaway recursion. The parts that stood out:

  • Exception: EXC_BAD_ACCESS (SIGBUS), subtype "Could not determine thread index for stack guard region," with the fault landing in the Stack Guard region.
  • Faulting thread queue: nio.nioTransportServices.connectionchannel.
  • The stack shows the same small set of notarytool frames repeating over and over, through String.init(format:) into __CFStringAppendFormatCore, until it runs out of stack.
  • It crashes a few chunks into the upload of a roughly 328 MB DMG, and the chunk where it dies is different every run (I saw 0, 1, 4, and 16 of 66), so it feels timing related rather than anything about the file itself.

My best guess is that a network change happening during the upload might be triggering it. My Mac has a lot of iCloud Continuity and Handoff activity (rapportd creating and removing utun tunnels for AirDrop, notifications, and so on), and quieting some of that down (Bluetooth off, Handoff off, awdl0 down, even pausing rapportd and sharingd) seemed to let the upload get further before crashing, though it never fully stopped. It also happened on a second Mac and occasionally on a GitHub-hosted macos-latest runner, so it does not seem specific to my machine.

Just wanted to share this in case it helps you all track down whatever is going on, since it seems like it could affect other people notarizing larger files.

I have .ips crash reports and can attach them here. I did attach them on the Feedback (FB22939442) with my update on that that ticket for the team. Thanks again for all the help.

I’m glad you’ve got this working.

My best guess is that a network change happening during the upload might be triggering it.

Yep. I don’t have a lot of insight into the notarytool implementation, but my view of your crash reports show the the source of the recursion was Network framework calling the stateUpdateHandler on an NWConnection object. The notarytool code that goes recursive and eventually runs off the end of its stack.

I did attach them on the Feedback (FB22939442)

Thanks. I’ll make sure the right folks see it.

Share and Enjoy

Quinn “The Eskimo!” @ Developer Technical Support @ Apple
let myEmail = "eskimo" + "1" + "@" + "apple.com"

i am having the same issue as the OP granted mine has only been about 7 hours and the submission shows Successfully uploaded file. Is there anything i should do or is it just a waiting game to see if it ever completes?

Notary service: submissions stuck "In Progress" for days, never completing
 
 
Q