Postmortem -
Read details
Nov 16, 02:06 UTC
Resolved -
All impacted Firstup platform endpoints have remained stable and fully available.
This incident is now resolved.
Nov 16, 02:03 UTC
Monitoring -
The hotfix for the campaign email delivery issue has now been vetted and deployed in the production environment. Campaign emails have now resumed delivery and may take a few minutes to hit the end user’s inbox.
The affected services will now be placed back under monitoring for now.
Nov 13, 20:01 UTC
Update -
We continue working on developing and verifying another hotfix for the email delivery issue.
Another update within 1 hour.
Nov 13, 19:48 UTC
Update -
We have identified a potential root cause for the residual impact of this incident where email campaigns are yet to be delivered following the hotfix. We are working on developing and verifying another hotfix for that issue.
Another update within 1 hour.
Nov 13, 18:47 UTC
Identified -
We are currently investigating a residual impact of this incident where some email campaigns are yet to be delivered after the hotfix was released.
We will provide an update within 1 hour.
Nov 13, 17:50 UTC
Monitoring -
The hotfix for this incident has been released in the production environment. All services should now be restored.
We will be placing the affected services in a monitoring state for now.
Nov 13, 16:35 UTC
Update -
A hotfix for this incident has been developed and is currently being tested in our staging environment. Once vetted, it will be released in the production environment.
Another update within 1 hour.
Nov 13, 16:25 UTC
Identified -
We have identified a potential root cause of this incident, and are working towards mitigation. Affected components are only on the US datacenter. The EU datacenter remains unaffected.
Another update within 1 hour.
Nov 13, 15:30 UTC
Investigating -
We are currently investigating reports of intermittent Studio slow performance issues.
We will provide you with an update within 1 hour.
Nov 13, 15:07 UTC