From @tristan957 in #4202:

@alexr00 now that I have used the extension more with this fix, I have one more piece of feedback. Would it be possible to get the extension to turn off auto fetching in all situations? As of right now, like you said in an above comment, the extension will fetch when you checkout a branch connected to a PR. While an improvement, it is still annoying to be pestered for an SSH password when I checkout a PR branch.

For my workflow, I am usually the owner of the PR branch, so I know when it has been updated and when I need to fetch updates. In the vast majority of cases, I only ever interact with a branch on the same computer, so the latest that I have locally is always at least equal to or more recent than what is on the remote.