Thanks! I've logged a bug for this:
FB11844942 (Shared App Container persists across installs)
which includes the suggested sysdiagnose logs for each step.
Topic:
App & System Services
SubTopic:
Core OS
Tags: