Firstup Status

Firstup Platform Status

Platform Degradation - Multiple Services Affected

Monitoring - All database connections have been restored, and all services are now available and accessible.

We will be placing this incident under monitoring
May 22, 2023 - 17:54 UTC

Update - As we continue to work on restoring all database connections, some services such as Web Experience are back up and running.

Another update will be provided within 30 minutes.
May 22, 2023 - 17:31 UTC

Identified - A database connection issue has been identified as the cause of the multiple services being degraded. We are working to mitigate this issue.

Another update will be provided within 30 minutes.
May 22, 2023 - 17:01 UTC

Investigating - We are investigating reports of multiple services being degraded. These may include - among others - Microapps and Web Experience.

We will provide an update within 30 minutes.
May 22, 2023 - 16:35 UTC

Twitter Breaking Change...

Update - Twitter feeds should now all be refreshed, and the incident has once again been mitigated. Work continues for the long-term fix on the new version of Twitter's API and service tier, but we believe any recurrent disruption of service between now and then to be highly unlikely. Moving incident back to monitoring state and marking all components fully operational.
May 03, 2023 - 00:20 UTC

Identified - We are aware of Twitter feeds not refreshing/updating as expected since 4/25. This is due to a change from Twitter and we are working to resolve it. Currently, we do not have an ETA but we will keep you up to date as Firstup makes progress.
May 01, 2023 - 18:14 UTC

Monitoring - Impact has been mitigated, and all connected Twitter feeds have been successfully refreshed. There remains a high probability of a recurrence between now and end of next week, when we have fully implemented and tested Twitter integration with their new API. In the interim, we will continue to monitor for any disruptions and do what we can to minimize any service impact to the Firstup platform.
Apr 07, 2023 - 21:44 UTC

Investigating - Moving this incident out of a risk-only designation. We have observed unexpected failures with Twitter API calls. We are currently investigating the reason behind the errors, but all content pulled in from Twitter sources for content feeds will fail in the interim.
Apr 07, 2023 - 18:59 UTC

Identified - Twitter has announced new access tiers to their platform API as well as a stated requirement for all developers to port any applications to the new version 2 of the API within 30 days or less. We have spun up a developer work stream to make these updates so that connected Twitter accounts can remain a viable a source for content feeds. Firstup remains committed to providing the best functionality possible that the new Twitter API allows.
Apr 04, 2023 - 20:24 UTC

Update - Twitter have sent a further update out that this change has been delayed for a few more days - no definite date has been provided as yet. Our Engineering Team will be reviewing all options from Twitter when fully known.
Feb 14, 2023 - 21:07 UTC

Update - Twitter has moved this change window to Feb 13, 2023 so we do not expect any potential disruption of service tomorrow Feb 9, 2023. We will keep this incident open for communication updates however as the situation progresses.
Feb 09, 2023 - 03:06 UTC

Investigating - We are initiating a platform incident for risk, based on the contents of a public tweet (https://twitter.com/TwitterDev/status/1621026986784337922) from the official Twitter Dev account, purporting that access to the Twitter API will require a "paid basic tier" as of February 9th. We have not received any further communication through alternate channels or via Twitter's Developer Team detailing exactly when/how this will be enforced and what it will ultimately look like.

Our Engineering Team remains at the ready to respond as necessary to make sensible adjustments that may be required to retain current interoperability between Twitter and the Firstup platform.

Further information will be posted in this platform-specific status page as it becomes available. If access to the Twitter API should be unexpectedly severed, that could impact content feeds configured to pull Twitter content in to Programs, but native sharing of content out to Twitter should continue to function as it does not utilize the Twitter Developer API.
Feb 08, 2023 - 22:07 UTC

Uptime over the past 90 days. View historical uptime.

Platforms Operational

90 days ago

99.93 % uptime

Today

US Firstup Platform Operational

90 days ago

99.87 % uptime

Today

EU Firstup Platform Operational

90 days ago

100.0 % uptime

Today

Products Operational

90 days ago

99.95 % uptime

Today

New Studio Operational

90 days ago

99.97 % uptime

Today

Classic Studio Operational

90 days ago

100.0 % uptime

Today

Web Experience Operational

90 days ago

99.92 % uptime

Today

Mobile Experience Operational

90 days ago

100.0 % uptime

Today

Microapps Operational

90 days ago

99.9 % uptime

Today

Analyze Operational

90 days ago

99.92 % uptime

Today

3rd-Party Dependencies Operational

90 days ago

100.0 % uptime

Today

Image Transformation API Operational

SendGrid API v3 Operational

Identity Access Management Operational

90 days ago

100.0 % uptime

Today

Ecosystem Operational

90 days ago

99.84 % uptime

Today

User Sync Operational

90 days ago

100.0 % uptime

Today

Integrations Operational

90 days ago

99.58 % uptime

Today

Partner API Operational

90 days ago

100.0 % uptime

Today

Connect Operational

90 days ago

99.79 % uptime

Today

Operational

Degraded Performance

Partial Outage

Major Outage

Maintenance

Scheduled Maintenance

Scheduled Software Release - June 6th 2023 18:00-21:00 PDT / June 7th 2023 01:00 - 04:00 UTC (3 hours) Jun 7, 2023 01:00-04:00 UTC

In order to provide you with the best service possible, we are planning a consolidated product software release during this time which may result in some functions being intermittently unavailable, but there is no significant downtime expected.

This software release includes a number of bug fixes as well as software changes. More details will be provided in the forthcoming release notes.

If there are any changes to the timing or expected impact, they will be updated in this maintenance post up to and during the maintenance itself.
Posted on May 24, 2023 - 18:52 UTC

Past Incidents

Jun 4, 2023

No incidents reported today.

Jun 3, 2023

No incidents reported.

Jun 2, 2023

Platform Service Degradation - Mobile Videos Not Rendering As Expected

Resolved - Our monitoring has indicated that mobile videos have been rendering as expected after the deployed fix.

This incident will now be placed in a resolved status.
Jun 2, 20:54 UTC

Monitoring - The developed fix for this issues has been vetted and deployed in the production environment, and mobile videos should now be rendering as expected.

We will be placing this service under monitoring to ensure stability.
Jun 1, 21:04 UTC

Update - A fix for this issue has been developed, and is currently undergoing QA testing and final approval.

Another update will be provided within 1 hour.
Jun 1, 19:56 UTC

Update - We continue to work on a fix for this issue, and will provide another update within the next 1 hour.
Jun 1, 19:10 UTC

Update - We continue to work on a fix for this issue, and will provide another update within the next 1 hour.
Jun 1, 18:07 UTC

Identified - We have identified a potential configuration issue that is causing this service degradation, and are currently working on a fix for it.

Another update will be provided within the next 1 hour.
Jun 1, 17:07 UTC

Investigating - We are currently investigating reports where videos in mobile devices are not rendering as expected, with and error message “The media could not be loaded, either because the server or network failed, or because the format is not supported.”

We will provide you with an update within the next 1 hour.
Jun 1, 16:32 UTC

Platform Service Disruption - User Bulk Imports Failing - US Datacenter Only

Resolved - After extensive monitoring of the services that were affected by this service disruption, they all have remained available and operational.

This incident is now being placed in a resolved status.
Jun 2, 14:45 UTC

Monitoring - The proposed hot fix for this issue has been confirmed and approved, and has now been deployed in the production environment.

For any failed bulk import jobs, the files can now be re-uploaded for processing.

We will be placing this issue under monitoring for now.
May 22, 14:58 UTC

Identified - We have identified a potential root cause for this issue, and a hot fix for it is now being tested in a staging environment. Once confirmed and approved, it will be deployed in the production environment.

We will provide you with another update within 1 to 2 hours.
May 22, 14:40 UTC

Update - We continue to investigate this recurrence, and will provide another update within 1 to 2 hours.
May 22, 13:35 UTC

Investigating - We are investigating a recurrence of the issue affecting user imports. At this time, bulk user imports are failing with an 'Internal Server Error' for customers with communities in our US Data Center.

We will provide an update within 1 hour.
May 22, 11:08 UTC

Monitoring - User Bulk Import service is still running as expected.

We will place this service under monitoring, and provide an update if and when new information is made available.
May 12, 16:30 UTC

Identified - This issue has now been mitigated, and user bulk imports are now processing as expected.

We are working on backfilling any previously failed jobs.

An update will be provided once this is completed.
May 12, 14:01 UTC

Investigating - We are aware of, and are currently investigating an issue where bulk user upload jobs are failing with an internal server error in our US datacenter.

We will provide an update within 1 hour.
May 12, 13:20 UTC

Unable to post comments on Microapps and Content

Resolved - Our extensive monitoring has indicated that all affected systems have remained stable and fully functional.

This incident will now be resolved, and a root cause analysis will be provided once a postmortem has been completed.
Jun 2, 13:11 UTC

Monitoring - A fix has been implemented and we are monitoring the results.
Jun 1, 19:30 UTC

Identified - We have identified the issue that is causing this service degradation with unable to comment, and are currently working on a fix for it.

Another update will be provided within the next 1 hour.
Jun 1, 18:39 UTC

Investigating - We are currently investigating reports of unable to post comments on Microapps and Content
Jun 1, 18:06 UTC

Unplanned Platform Maintenance (US)

Completed - The scheduled maintenance has been completed.
Jun 2, 04:00 UTC

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 2, 02:00 UTC

Scheduled - We will be undergoing maintenance at 7:00 PM PDT/10:00 PM EDT on Thursday June 1, 2023. There is no impact identified which would affect the use of the platform.
Jun 1, 14:25 UTC

Jun 1, 2023

Unplanned Platform Maintenance (EU)

Completed - The scheduled maintenance has been completed.
Jun 1, 22:01 UTC

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 1, 20:00 UTC

Scheduled - We will be undergoing maintenance at 9:00PM BST/1:00PM PDT/04:00 PM EDT on Thursday June 1, 2023. There is no impact identified which would affect the use of the platform.
Jun 1, 14:35 UTC

May 31, 2023

No incidents reported.

May 30, 2023

No incidents reported.

May 29, 2023

No incidents reported.

May 28, 2023

No incidents reported.

May 27, 2023

No incidents reported.

May 26, 2023

No incidents reported.

May 25, 2023

No incidents reported.

May 24, 2023

Scheduled Software Release May 23rd 2023 18:00-21:00 PDT / May 24th 2023 01:00 - 04:00 UTC (3 hours)

Completed - The scheduled maintenance has been completed.
May 24, 04:00 UTC

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 24, 01:00 UTC

Update - In order to provide you with the best service possible, we are planning a consolidated product software release during this time which may result in some functions being intermittently unavailable, but there is no significant downtime expected.

This software release includes a number of bug fixes as well as software changes. More details will be provided in the forthcoming release notes.

If there are any changes to the timing or expected impact they will be updated in this maintenance post up to and during the maintenance itself.
May 9, 18:39 UTC

Update - We will be undergoing scheduled maintenance during this time.
May 9, 18:38 UTC

Update - We will be undergoing scheduled maintenance during this time.
May 9, 18:37 UTC

Scheduled - In order to provide you with the best service possible, we are planning a consolidated product software release during this time which may result in some functions being intermittently unavailable, but there is no significant downtime expected.

This software release includes a number of bug fixes as well as software changes. More details will be provided in a forthcoming release notes.

If there are any changes to the timing or expected impact they will be updated in this maintenance post up to and during the maintenance itself.
May 9, 18:34 UTC

May 23, 2023

No incidents reported.

May 22, 2023

May 21, 2023

No incidents reported.

Related