We have an iOS app that we are constantly smoke testing with SauceLabs. Every time someone opens a pull request, we have a Jenkins job that builds their branch's version of the app and uploads it to SauceLabs before tests are run. The problem is, when multiple pull requests are opened at once, there is a long queue of jobs waiting to be completed serially, since SauceLabs only allows one version of the app to be uploaded at a time. For example, branch "lindsay/cool_feature" has to wait for pull request branch"jay/cooler_feature" to finish its smoke tests before uploading. It doesn't matter how many concurrent builds we have on our account; the bottleneck is at the app upload level.
It would be great if you guys could do the same thing you do with concurrent builds; allow a certain number of versions of an app to be uploaded to Sauce at once.