Sometimes the alert settings can get messed up and / or send empty alerts. If that's the case, the following fix should stop them:
1) Tap the settings gear on the top, then "Severe Weather Alerts"
2) Tap “Severe Weather Alerts” then "Clear All Alerts” at the bottom
3) Then add back any cities if you'd like