Getting password prompt after logging in with SSO

I’ve set up an on-premise instance and am using my company’s GHE for GitHub SSO, which works great. I’m running into an issue however where certain actions like removing a project, adding TFA, etc. are prompting me for a password… that I don’t have. I’ve tried the password I use for GHE (and thus SSO), but it seems to be looking for a locally registered account.

Am I missing a configuration option somewhere to disable/modify those to use SSO?

I’m using Sentry 9.0.0