We decided that cleanup is a part of the test and shouldn't be executed if previous steps failed. But sometimes it's required to execute cleanup every time - like when we create kubernetes resources and don't delete them.

There is an idea to create these resources in separate namespace and at the end of the test execution delete that namespace with all resources