Use Germain's Maintenance Window mechanism so that your team(s) doesn't receive any email alert while performing some maintenance of the monitored app/technology(ies) (e.g. deploy a new release).

Configure

More details about this feature and how to configure it : Maintenance Window