Incidents | SureCart Inc Incidents reported on status page for SureCart Inc https://status.surecart.com/ https://d1lppblt9t2x15.cloudfront.net/logos/1655a95019454d8a853c2dbfa458afd9.svg Incidents | SureCart Inc https://status.surecart.com/ en Service Disruption https://status.surecart.com/incident/462252 Thu, 14 Nov 2024 11:04:00 -0000 https://status.surecart.com/incident/462252#74785db465137ef66b5a765ef63d783debb9fc04777a811f01f4bdc160df0f91 Over a 2.5 hour timespan early today, there was a disruption of service. Here is what happened. There were elevated requests from some bad sites which unexpectedly caused a ripple effect at the platform with one of our processes. This then affected some sites with some web hosts, causing them to at times load slower or timeout due to a bug in a recent release of the plugin. We have since patched the issue on the platform, so this can never happen again, and are working on updating the plugin on the highest priority. We take uptime very seriously. We have multiple redundancies for everything. We have devops coverage 24/7. We have monitoring systems in place for everything. Since our public launch 2.5 years ago, we have never had a situation like this occur. Our team did a full retrospective today on the situation. We take these things very seriously. If there is anything additional we can do, please let us know. Service Disruption https://status.surecart.com/incident/462252 Thu, 14 Nov 2024 10:02:00 -0000 https://status.surecart.com/incident/462252#1c2cf3330d2abbc9cba6eb25f1524689b9fba7a80f45ba46f15e1709981b438d We are still investigating this issue and seeing sporadic increases and decreases in response time. We've traced this back to a high level of requests from some bad sites which is causing a ripple effect at the platform with one of our processes. Requests Timing Out https://status.surecart.com/incident/463593 Thu, 14 Nov 2024 10:00:00 -0000 https://status.surecart.com/incident/463593#c5f5e9c9efbceea4cee4cec136c42122fffe6a62391a0db2aaa3f8091b311328 Request times have been improved, but we are still investiging degraded performance. Requests Timing Out https://status.surecart.com/incident/463593 Thu, 14 Nov 2024 09:30:00 -0000 https://status.surecart.com/incident/463593#f45d7e5176b1ba652ffc4a3b2d3b41b4039bad9f39bf9a950cc9b183a57f2907 We are experiencing requests timing out across the platform due to elevated throughput and performance issues with a downstream service. We are diagnosing the issue and working on a fix. Increased Response Times https://status.surecart.com/incident/463590 Fri, 08 Nov 2024 07:42:00 -0000 https://status.surecart.com/incident/463590#5a8a75318c0114353564dc1324f0edc5c6bb1c355c3b240d8cc53d81e2196900 We identified the issue with a downstream service and can confirm that requests are back to normal response times. Increased Response Times https://status.surecart.com/incident/463590 Fri, 08 Nov 2024 07:36:00 -0000 https://status.surecart.com/incident/463590#6c4662e188cb7f29786aa19828f4e0b2661197d460dba295459a0617e890a156 We're experiencing an increase in response times and are investigating the issue. Increased Response Times https://status.surecart.com/incident/313160 Mon, 15 Jan 2024 20:48:00 -0000 https://status.surecart.com/incident/313160#0d2d67bcc3a0323f5ed58c06354dc4c6b30a7874b6cede5e8160a6053f1f7d2e We have identified the root cause of this issue and implemented a fix to bring all requests back to normal response times. Increased Response Times https://status.surecart.com/incident/313160 Mon, 15 Jan 2024 20:21:00 -0000 https://status.surecart.com/incident/313160#bd47be20c8e56d0ad3159d4f50a91712314a50b8ba558705a632188301da46b3 The platform is experiencing an increase in response times and elevated queue times across the API and dashboard. We are actively investigating this issue. Application Host Routing Issue https://status.surecart.com/incident/173094 Wed, 08 Feb 2023 18:45:00 -0000 https://status.surecart.com/incident/173094#2de829f5f367ecd75896d2e202190cac3dcfd85ec9ad26b99e4615fec3f91183 All requests are now being routed correctly by our application host, and all services are back online. We are exploring strategies to circumvent any issues like this going forward. Application Host Routing Issue https://status.surecart.com/incident/173094 Wed, 08 Feb 2023 18:31:00 -0000 https://status.surecart.com/incident/173094#f79fafa94e56733009871ba9b801866845e6e9ea6d4f66ecf8b8080142046af6 Our application host is experiencing issues routing requests to our servers. As a result, some API and dashboard requests are timing out. We are working to bring all services back online. Upstream DNS Issues https://status.surecart.com/incident/112168 Wed, 24 Aug 2022 00:25:00 -0000 https://status.surecart.com/incident/112168#5a079a1e2ad6353e585c79a6368e08ab00349d1bc145a346adf1536347929077 We have implemented a fix to workaround the upstream DNS issue. All services are now back online. Upstream DNS Issues https://status.surecart.com/incident/112168 Tue, 23 Aug 2022 23:20:00 -0000 https://status.surecart.com/incident/112168#ca6ee05b548a64eece49adf18dee85255cf57d6dd934b6e602f429bf2d775c11 Our application host is experiencing issues with their upstream DNS provider. As a result, the API and platform are currently unavailable to customers. We are exploring strategies to bring everything back online.