quick start causes second configure if automaticReconfigure is enabled

[qarni]

          One thing I noticed while testing is that line 2863 (in the new version), will technically force a second configure if the `automaticReconfigure` setting is enabled. I don't think this needs to block this PR, but it is something we should look into.

Originally posted by Garrett Campbell (@gcampbell-msft) in #3853 (comment)