My team recently started using Sentry to identify and detect and diagnose client-side issues in our app. We’re using the “releases” feature to correlate issues with specific releases and get source maps in Sentry for those issues. Loving it so far!
The only issue we’ve had is that after marking an issue as resolved in Sentry (and noting the version in which it was resolved), we’ll see a trickle of events roll in for the issue even after the fix has been deployed to production that cause the issue to be re-opened as a regression. These events are marked with newer release tags in which we know the issue no longer exists. Now, I realize that there’s a chance that we maybe didn’t fix the issue like we initially thought (i.e., it’s a true regression), but this has happened enough times now that I don’t think it’s just a mess up on our part. Also, the events do eventually stop coming in for the issue and it stays as “resolved” - it’s just annoying for developers to expect and issue to be re-opened several times before it’ll finally stay marked as “resolved”.
Has anyone else seen an issue like this where events continue to roll in after an issue has been resolved, where those events are tagged with a release in which you know the issue has been resolved?