Last month a routine firewall upgrade at a major telco unintentionally blocked Triple-0 (000) emergency calls for about 13 hours — roughly 600 calls failed and several deaths are linked to the outage. This incident makes the point starkly: firewall change management must be treated as a safety-critical discipline, not routine maintenance.
Firewalls enforce routing, NAT, and complex policy logic. Changes that interact with hidden service paths — VoIP routing, emergency call handling, or interconnect rules — can sever critical flows. In the Optus event, monitoring didn’t measure transaction health (call completion), so the problem went undetected until impact was severe.
Discovery & impact mapping — map critical flows (Triple-0, contact centres, EHR links) and identify all rules touching those flows.
Simulated test harnesses — replicate production paths in a staging rig; run synthetic SIP handshakes and call tests before changes.
Controlled rollout with automated rollback — deploy changes in stages; if synthetic checks exceed failure thresholds (e.g., >1% drop in call completions), rollback automatically.
Service-aware monitoring — track transaction metrics (call success, SIP registrations, jitter, MOS) alongside link and device health.
Guardrails & escalation — mark emergency-related rules as protected; changes require senior sign-off and runbook approval.
Change-as-a-service: review, test, deploy and rollback change windows with clear SLAs.
Resilience audits: test emergency and business-critical flows prior to any change.
Service-aware monitoring: real-time transaction metrics and synthetic testing.
Change-control drills: tabletop and live rehearsals that validate rollback and escalation.
If you manage on-prem or carrier-edge devices: require peer review for any firewall change, run synthetic tests for all critical service paths, and add rollback triggers to your automation pipelines. These simple steps dramatically reduce outage risk.
Firewall upgrades are not low-risk. Ex-tech offers a free 30-minute firewall change-control readiness snapshot for Melbourne clients (includes synthetic call test and checklist). Book a slot here and let us stress-test your process before your next upgrade.
Ex-Tech eliminates the need for you to waste precious time and resources on the maintenance and upkeep of your IT infrastructure so you can focus on what’s paramount – the growth and success of your business. Ready to elevate your IT infrastructure? Contact us to schedule your FREE assessment today!