Resolved -
The primary service incident that began earlier today is resolved. We understand this has been an extended disruption and sincerely apologize for the impact this had on your operations throughout the day. We appreciate your patience and understanding.
While the main issue is resolved, there is a remaining defect where some call recordings are not immediately accessible through the Insights user interface or the contact card. Our team is actively working on the final remediation steps for this.
We anticipate that all call recordings will be fully accessible by the end of today.
Should you require immediate access to a specific call recording before it becomes available in the UI, please open a request with our Care team. They will be able to retrieve the recording for you.
Thank you again for your continued patience.
May 14, 22:43 UTC
Monitoring -
All WebRTC resources are fully restored and confirmed to be working. All previously observed impacts have subsided and we're monitoring recovery.
May 14, 21:00 UTC
Update -
The majority of WebRTC resources are now functioning as expected and most users should be seeing recovery. We are correcting a small portion of remaining infrastructure and will update when all necessary resources are fully restored.
May 14, 20:45 UTC
Update -
Outbound calls are now working as expected.
May 14, 20:40 UTC
Update -
We are now observing a disruption to outbound Sharpen Q initiated calls.
May 14, 20:27 UTC
Update -
We are performing additional corrective actions on remaining WebRTC hosts to extend recovery. There may be a brief interruption during the change.
May 14, 20:15 UTC
Update -
We are observing disruptions to outbound calls and inbound call alerts for some agents. All necessary subject matter experts continue to investigate.
May 14, 19:53 UTC
Update -
We are continuing our investigation. We've been able to identify and correct a portion of the resources supporting the Sharpen Q Phone WebRTC collective and are continuing efforts toward full restoration
May 14, 19:38 UTC
Update -
Some WebRTC connections are still failing to connect and we're continuing our investigation. If a user has an active connection, it is recommended to not refresh to potentially lose the connection.
May 14, 18:54 UTC
Identified -
Current symptoms recognized are as follows. The investigation continues to correct the last symptom, unexpected drops from Sharpen Q phone.
1. Dead air for a portion of inbound calls (variable rate of failure)
2. Unexpected disconnect from Sharpen Q phone
3. Unexpected drop of connected call at 2 minutes. <- Corrected as of 12:30 PM ET
May 14, 18:08 UTC
Update -
We have identified another corrective action and are coordinating steps to implement.
May 14, 17:45 UTC
Update -
We are continuing our investigation but have been able to identify that the current expected failure rate is ~20%. All necessary resources are engaged to resolve this issue as soon as possible.
May 14, 17:21 UTC
Update -
Current symptoms recognized are as follows. The investigation continues.
1. Dead air for a portion of inbound calls (variable rate of failure)
2. Unexpected disconnect from Sharpen Q phone
3. Unexpected drop of connected call at 2 minutes.
May 14, 17:01 UTC
Investigating -
We are seeing a resurgence of the symptoms at a low rate. We are resuming investigation to identify additional corrective actions.
May 14, 17:00 UTC
Monitoring -
A fix has been implemented and we're monitoring recovery.
May 14, 16:51 UTC
Update -
We have isolated the suspected fault point and are taking corrective action.
May 14, 16:28 UTC
Investigating -
We are currently investigating an issue with inbound calls dropping or resulting in dead air.
May 14, 15:42 UTC