If a pytest test running inside the debugger failed because of an exception, pycharm always stopped the process and printed the stack trace instead of letting me debug the exception when raised.

The setting in pycharm settings “drop into the debugger on failed test” fixed that. (And pdbpp had nothing to do with the issue).