Missing a button in the UI to delete notification configurations

[jonasschalck]

I have a duplicated Slack configuration but no option to delete it.

[anupdhiran]

Will be closed as part of #929

[anupdhiran]

#929 is fixed and deployed which fixes this issue as well. Kindly verify and let us know in case you observe any issue.