Yes, at least in my experience.
The IPA cache might have your apps ready to go. But I’ve tried and you need to remove the app from your device first…
It’s frustrating and renders this service almost unusable. Better off buying a dev account and using something like Sideloadly