Wherobots Status - Incident history https://status.wherobots.com Wherobots Thu, 3 Sep 2026 21:20:00 +0000 API errors and workloads failing to start in Wherobots Cloud Type: Incident Duration: 2 hours and 19 minutes Affected Components: Wherobots Jobs, Wherobots Notebooks, Wherobots Website, Wherobots SQL API, Wherobots Catalog Sep 3, 23:39:19 GMT+0 - Resolved - This incident has been resolved. The identity-service degradation at our cloud provider ended at approximately 3:20 PM PDT (22:20 UTC), and API error rates, latency, and workload launches have been normal for over an hour since. Any SQL sessions, notebooks, or jobs that failed to start between 2:20 and 3:20 PM PDT can be retried normally. We apologize for the disruption and will follow up with the changes we're making to reduce our sensitivity to this class of provider issue. Sep 3, 22:33:34 GMT+0 - Monitoring - Our cloud provider's identity service has recovered. API error rates, latency, and workload launches have been normal since approximately 3:20 PM PDT (22:20 UTC), and all API instances are healthy. We are continuing to monitor before marking this incident resolved. Any workload launch that failed during the incident can be retried now. Sep 3, 21:20:00 GMT+0 - Identified - Since approximately 2:20 PM PDT (21:20 UTC) the Wherobots Cloud API has been experiencing intermittent errors, and some workloads are failing to start. Customers may see API requests and console actions fail or time out, and new SQL sessions, notebooks, and jobs may fail to launch. Tools that authenticate through the API (for example the MCP server) may also fail intermittently. We have identified the cause as a degradation in an identity service operated by our cloud provider. This is not caused by a change on our side, and no customer data is affected. Impact peaked between 2:20 and 2:45 PM PDT and has been intermittent since; some requests continue to fail while the provider recovers. If a workload fails to start, please retry — launches succeed once credentials are issued. We are monitoring closely and will post another update within 30 minutes or sooner if the situation changes. Type: Incident

Duration: 2 hours and 19 minutes

Affected Components: , , , ,

<p><small>Sep <var data-var='date'> 3</var>, <var data-var='time'>23:39:19</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved. The identity-service degradation at our cloud provider ended at approximately 3:20 PM PDT (22:20 UTC), and API error rates, latency, and workload launches have been normal for over an hour since. Any SQL sessions, notebooks, or jobs that failed to start between 2:20 and 3:20 PM PDT can be retried normally. We apologize for the disruption and will follow up with the changes we're making to reduce our sensitivity to this class of provider issue..</p> <p><small>Sep <var data-var='date'> 3</var>, <var data-var='time'>22:33:34</var> GMT+0</small><br><strong>Monitoring</strong> - Our cloud provider's identity service has recovered. API error rates, latency, and workload launches have been normal since approximately 3:20 PM PDT (22:20 UTC), and all API instances are healthy. We are continuing to monitor before marking this incident resolved. Any workload launch that failed during the incident can be retried now..</p> <p><small>Sep <var data-var='date'> 3</var>, <var data-var='time'>21:20:00</var> GMT+0</small><br><strong>Identified</strong> - Since approximately 2:20 PM PDT (21:20 UTC) the Wherobots Cloud API has been experiencing intermittent errors, and some workloads are failing to start. Customers may see API requests and console actions fail or time out, and new SQL sessions, notebooks, and jobs may fail to launch. Tools that authenticate through the API (for example the MCP server) may also fail intermittently. We have identified the cause as a degradation in an identity service operated by our cloud provider. This is not caused by a change on our side, and no customer data is affected. Impact peaked between 2:20 and 2:45 PM PDT and has been intermittent since; some requests continue to fail while the provider recovers. If a workload fails to start, please retry — launches succeed once credentials are issued. We are monitoring closely and will post another update within 30 minutes or sooner if the situation changes..</p> ]]> Thu, 3 Sep 2026 21:20:00 +0000 https://status.wherobots.com/incident/cmtm2xfr105qe1bo51kptw84k https://status.wherobots.com/incident/cmtm2xfr105qe1bo51kptw84k Interminent workloads launch failure in aws-us-west-2 region Type: Incident Duration: 5 hours and 43 minutes Affected Components: Wherobots Jobs, Wherobots Notebooks, Wherobots SQL API Aug 13, 17:26:00 GMT+0 - Identified - Jupyter, Job runs and SQL Session launches and teardowns interminently fail due to our internal service availability issue. We have partially mitigated the issue and working on the full patch. Aug 13, 18:52:19 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Aug 13, 23:09:00 GMT+0 - Resolved - We have confirmed the issue fully mitigated. Type: Incident

Duration: 5 hours and 43 minutes

Affected Components: , ,

<p><small>Aug <var data-var='date'> 13</var>, <var data-var='time'>17:26:00</var> GMT+0</small><br><strong>Identified</strong> - Jupyter, Job runs and SQL Session launches and teardowns interminently fail due to our internal service availability issue. We have partially mitigated the issue and working on the full patch..</p> <p><small>Aug <var data-var='date'> 13</var>, <var data-var='time'>18:52:19</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix and are currently monitoring the result..</p> <p><small>Aug <var data-var='date'> 13</var>, <var data-var='time'>23:09:00</var> GMT+0</small><br><strong>Resolved</strong> - We have confirmed the issue fully mitigated..</p> ]]> Thu, 13 Aug 2026 17:26:00 +0000 https://status.wherobots.com/incident/cmsrtvmju01mu0ykvf9uzpjx0 https://status.wherobots.com/incident/cmsrtvmju01mu0ykvf9uzpjx0 Elevated failures starting SQL sessions, Job Runs, Jupyter in US West (Oregon) Type: Incident Duration: 1 hour and 3 minutes Affected Components: Wherobots Jobs, Wherobots Notebooks, Wherobots Website, Wherobots SQL API, Wherobots Catalog Jul 24, 23:08:45 GMT+0 - Monitoring - We've applied a mitigation, and new SQL sessions and job runs in our US West (Oregon) region are starting normally. We're closely monitoring to confirm the issue doesn't recur and will update this page once we're confident it's fully resolved. Jul 25, 00:12:01 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 1 hour and 3 minutes

Affected Components: , , , ,

<p><small>Jul <var data-var='date'> 24</var>, <var data-var='time'>23:08:45</var> GMT+0</small><br><strong>Monitoring</strong> - We've applied a mitigation, and new SQL sessions and job runs in our US West (Oregon) region are starting normally. We're closely monitoring to confirm the issue doesn't recur and will update this page once we're confident it's fully resolved..</p> <p><small>Jul <var data-var='date'> 25</var>, <var data-var='time'>00:12:01</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Fri, 24 Jul 2026 23:08:45 +0000 https://status.wherobots.com/incident/cmrzjxijw033p0zqd8hxk3pqg https://status.wherobots.com/incident/cmrzjxijw033p0zqd8hxk3pqg Intermittent failures starting compute due to a third-party outage Type: Incident Duration: 3 hours and 38 minutes Affected Components: Wherobots Jobs, Wherobots Notebooks, Wherobots SQL API Jul 10, 18:30:13 GMT+0 - Identified - We're experiencing service outage in our `us-east-2` region and service degradations in all region. We have identified the root cause and are working on a fix. Jul 10, 19:53:49 GMT+0 - Monitoring - We implemented a fix. The `us-east-2` compute region is stably back to operational now. The workload launch time is recovering, we are closely monitoring. Jul 10, 22:08:35 GMT+0 - Resolved - All services have been fully restored. Jul 13, 17:34:25 GMT+0 - Postmortem - A third-party service provider experienced an outage that intermittently prevented some Wherobots services from retrieving their live configuration. During this period, customers may have experienced: 1\. Sessions, notebooks, and job runs in the AWS US East (Ohio / us-east-2) region failing to start, or the region appearing unavailable. 2\. Slower startup for sessions, notebooks, and job runs. Impact was intermittent and did not affect already running workloads. Service has been fully restored, and we have removed the affected startup paths' dependency on the third-party provider and added monitoring to detect this condition in the future. Type: Incident

Duration: 3 hours and 38 minutes

Affected Components: , ,

<p><small>Jul <var data-var='date'> 10</var>, <var data-var='time'>18:30:13</var> GMT+0</small><br><strong>Identified</strong> - We're experiencing service outage in our `us-east-2` region and service degradations in all region. We have identified the root cause and are working on a fix..</p> <p><small>Jul <var data-var='date'> 10</var>, <var data-var='time'>19:53:49</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix. The `us-east-2` compute region is stably back to operational now. The workload launch time is recovering, we are closely monitoring..</p> <p><small>Jul <var data-var='date'> 10</var>, <var data-var='time'>22:08:35</var> GMT+0</small><br><strong>Resolved</strong> - All services have been fully restored..</p> <p><small>Jul <var data-var='date'> 13</var>, <var data-var='time'>17:34:25</var> GMT+0</small><br><strong>Postmortem</strong> - A third-party service provider experienced an outage that intermittently prevented some Wherobots services from retrieving their live configuration. During this period, customers may have experienced: 1\. Sessions, notebooks, and job runs in the AWS US East (Ohio / us-east-2) region failing to start, or the region appearing unavailable. 2\. Slower startup for sessions, notebooks, and job runs. Impact was intermittent and did not affect already running workloads. Service has been fully restored, and we have removed the affected startup paths' dependency on the third-party provider and added monitoring to detect this condition in the future..</p> ]]> Fri, 10 Jul 2026 18:30:13 +0000 https://status.wherobots.com/incident/cmrf9teg306dv0kt99umrzs74 https://status.wherobots.com/incident/cmrf9teg306dv0kt99umrzs74 Intermittent failures starting sessions, notebooks, and jobs Type: Incident Duration: 3 hours and 15 minutes Affected Components: Wherobots Jobs, Wherobots Notebooks, Wherobots SQL API Jul 8, 17:22:04 GMT+0 - Monitoring - We have moved to the fallback registry and the image pulling failures are mitigated. Jul 8, 17:24:30 GMT+0 - Resolved - This incident has been resolved. Jul 8, 14:10:00 GMT+0 - Identified - Our upstream image registry is facing downtime, we are proactively working on moving to fallback registries Type: Incident

Duration: 3 hours and 15 minutes

Affected Components: , ,

<p><small>Jul <var data-var='date'> 8</var>, <var data-var='time'>17:22:04</var> GMT+0</small><br><strong>Monitoring</strong> - We have moved to the fallback registry and the image pulling failures are mitigated..</p> <p><small>Jul <var data-var='date'> 8</var>, <var data-var='time'>17:24:30</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> <p><small>Jul <var data-var='date'> 8</var>, <var data-var='time'>14:10:00</var> GMT+0</small><br><strong>Identified</strong> - Our upstream image registry is facing downtime, we are proactively working on moving to fallback registries.</p> ]]> Wed, 8 Jul 2026 14:10:00 +0000 https://status.wherobots.com/incident/cmrcatgsp03th1aqjnc9hrof0 https://status.wherobots.com/incident/cmrcatgsp03th1aqjnc9hrof0 Workloads in us-west-2 are taking longer than usual to start. Type: Incident Duration: 22 hours and 31 minutes Affected Components: Wherobots Jobs, Wherobots Notebooks, Wherobots SQL API Apr 7, 06:31:44 GMT+0 - Resolved - This incident has been resolved. Apr 6, 08:00:49 GMT+0 - Investigating - Workloads in us-west-2 can take 20 or more additional minutes to start than usual. Type: Incident

Duration: 22 hours and 31 minutes

Affected Components: , ,

<p><small>Apr <var data-var='date'> 7</var>, <var data-var='time'>06:31:44</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> <p><small>Apr <var data-var='date'> 6</var>, <var data-var='time'>08:00:49</var> GMT+0</small><br><strong>Investigating</strong> - Workloads in us-west-2 can take 20 or more additional minutes to start than usual..</p> ]]> Mon, 6 Apr 2026 08:00:49 +0000 https://status.wherobots.com/incident/cmnmwi29q002ctw4vt0sgny4c https://status.wherobots.com/incident/cmnmwi29q002ctw4vt0sgny4c Workloads not starting Type: Incident Duration: 16 hours and 33 minutes Affected Components: Wherobots Jobs, Wherobots Notebooks, Wherobots SQL API Apr 5, 15:56:48 GMT+0 - Resolved - This incident has been resolved. Apr 4, 23:24:03 GMT+0 - Investigating - We are currently investigating an issue with Notebooks, SQL Sessions, and Runs failing to start in us-west-2 Apr 5, 02:29:54 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Type: Incident

Duration: 16 hours and 33 minutes

Affected Components: , ,

<p><small>Apr <var data-var='date'> 5</var>, <var data-var='time'>15:56:48</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> <p><small>Apr <var data-var='date'> 4</var>, <var data-var='time'>23:24:03</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating an issue with Notebooks, SQL Sessions, and Runs failing to start in us-west-2.</p> <p><small>Apr <var data-var='date'> 5</var>, <var data-var='time'>02:29:54</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix and are currently monitoring the result..</p> ]]> Sat, 4 Apr 2026 23:24:03 +0000 https://status.wherobots.com/incident/cmnkylmro01k9a0n598k8z7p2 https://status.wherobots.com/incident/cmnkylmro01k9a0n598k8z7p2 Workloads in AWS ap-south-1 failing Type: Incident Duration: 8 hours and 8 minutes Affected Components: Wherobots Jobs, Wherobots Notebooks, Wherobots SQL API Mar 13, 07:00:00 GMT+0 - Investigating - We are currently investigating this incident. Mar 13, 15:08:05 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 8 hours and 8 minutes

Affected Components: , ,

<p><small>Mar <var data-var='date'> 13</var>, <var data-var='time'>07:00:00</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident..</p> <p><small>Mar <var data-var='date'> 13</var>, <var data-var='time'>15:08:05</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Fri, 13 Mar 2026 07:00:00 +0000 https://status.wherobots.com/incident/cmmoxmuvs049ncn3h8kh4xm30 https://status.wherobots.com/incident/cmmoxmuvs049ncn3h8kh4xm30 Wherobots services are unresponsive due to database migration Type: Incident Duration: 4 minutes Affected Components: Wherobots SQL API, Wherobots Jobs, Wherobots Notebooks, Wherobots Website Mar 5, 23:48:00 GMT+0 - Investigating - Mar 5, 23:52:00 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 4 minutes

Affected Components: , , ,

<p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>23:48:00</var> GMT+0</small><br><strong>Investigating</strong> - .</p> <p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>23:52:00</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Thu, 5 Mar 2026 23:48:00 +0000 https://status.wherobots.com/incident/cmme6bj6h016xagup3af5b5ak https://status.wherobots.com/incident/cmme6bj6h016xagup3af5b5ak Planned infrastructure maintenance Type: Maintenance Duration: 13 minutes Affected Components: Wherobots SQL API, Wherobots Notebooks, Wherobots Website, Wherobots Jobs, Wherobots Catalog Feb 19, 00:50:00 GMT+0 - Identified - We are planning for a scheduled infrastructure maintenance operation during that time that will cause temporarily unavailability of the Wherobots Cloud REST API and Wherobots Catalog services. Feb 19, 00:50:01 GMT+0 - Identified - Maintenance is now in progress Feb 19, 01:02:31 GMT+0 - Completed - Maintenance has completed successfully. Type: Maintenance

Duration: 13 minutes

Affected Components: , , , ,

<p><small>Feb <var data-var='date'> 19</var>, <var data-var='time'>00:50:00</var> GMT+0</small><br><strong>Identified</strong> - We are planning for a scheduled infrastructure maintenance operation during that time that will cause temporarily unavailability of the Wherobots Cloud REST API and Wherobots Catalog services..</p> <p><small>Feb <var data-var='date'> 19</var>, <var data-var='time'>00:50:01</var> GMT+0</small><br><strong>Identified</strong> - Maintenance is now in progress.</p> <p><small>Feb <var data-var='date'> 19</var>, <var data-var='time'>01:02:31</var> GMT+0</small><br><strong>Completed</strong> - Maintenance has completed successfully..</p> ]]> Thu, 19 Feb 2026 00:50:00 +0000 https://status.wherobots.com/maintenance/cmlsqn2iy03qa1yvk9p8ywky9 https://status.wherobots.com/maintenance/cmlsqn2iy03qa1yvk9p8ywky9 Wherobots services are unresponsive due to database issues Type: Incident Duration: 45 minutes Affected Components: Wherobots SQL API, Wherobots Notebooks, Wherobots Website, Wherobots Jobs, Wherobots Catalog Feb 4, 23:15:00 GMT+0 - Investigating - We are currently investigating this incident and taking steps to unblock the issue. Feb 4, 23:50:00 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Feb 5, 00:00:00 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 45 minutes

Affected Components: , , , ,

<p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>23:15:00</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident and taking steps to unblock the issue..</p> <p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>23:50:00</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix and are currently monitoring the result..</p> <p><small>Feb <var data-var='date'> 5</var>, <var data-var='time'>00:00:00</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Wed, 4 Feb 2026 23:15:00 +0000 https://status.wherobots.com/incident/cml8oifrc05008fqdcriq1iiz https://status.wherobots.com/incident/cml8oifrc05008fqdcriq1iiz Degradations and failures detected with the authentication system Type: Incident Duration: 30 minutes Affected Components: Wherobots SQL API, Wherobots Notebooks, Wherobots Website, Wherobots Jobs, Wherobots Catalog Jan 27, 18:59:00 GMT+0 - Investigating - We are currently investigating this incident. Jan 27, 19:17:00 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Jan 27, 19:28:43 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 30 minutes

Affected Components: , , , ,

<p><small>Jan <var data-var='date'> 27</var>, <var data-var='time'>18:59:00</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident..</p> <p><small>Jan <var data-var='date'> 27</var>, <var data-var='time'>19:17:00</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix and are currently monitoring the result..</p> <p><small>Jan <var data-var='date'> 27</var>, <var data-var='time'>19:28:43</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Tue, 27 Jan 2026 18:59:00 +0000 https://status.wherobots.com/incident/cmkwz824s008wytjoq3w4iqz4 https://status.wherobots.com/incident/cmkwz824s008wytjoq3w4iqz4 WherobotsDB V2 SQL Sessions failing to start Type: Incident Duration: 13 minutes Affected Components: Wherobots SQL API Jan 23, 10:13:48 GMT+0 - Investigating - We are currently investigating this incident. Jan 23, 10:19:32 GMT+0 - Identified - We are continuing to work on a fix for this incident. Jan 23, 10:26:31 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 13 minutes

Affected Components:

<p><small>Jan <var data-var='date'> 23</var>, <var data-var='time'>10:13:48</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident..</p> <p><small>Jan <var data-var='date'> 23</var>, <var data-var='time'>10:19:32</var> GMT+0</small><br><strong>Identified</strong> - We are continuing to work on a fix for this incident..</p> <p><small>Jan <var data-var='date'> 23</var>, <var data-var='time'>10:26:31</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Fri, 23 Jan 2026 10:13:48 +0000 https://status.wherobots.com/incident/cmkqq3vxm05brg5sd9tqguwnd https://status.wherobots.com/incident/cmkqq3vxm05brg5sd9tqguwnd Notebooks unable to start Type: Incident Duration: 28 minutes Affected Components: Wherobots SQL API, Wherobots Notebooks, Wherobots Jobs Jan 15, 18:20:57 GMT+0 - Identified - We are continuing to work on a fix for this incident. Jan 15, 18:41:45 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Jan 15, 18:48:45 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 28 minutes

Affected Components: , ,

<p><small>Jan <var data-var='date'> 15</var>, <var data-var='time'>18:20:57</var> GMT+0</small><br><strong>Identified</strong> - We are continuing to work on a fix for this incident..</p> <p><small>Jan <var data-var='date'> 15</var>, <var data-var='time'>18:41:45</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix and are currently monitoring the result..</p> <p><small>Jan <var data-var='date'> 15</var>, <var data-var='time'>18:48:45</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Thu, 15 Jan 2026 18:20:57 +0000 https://status.wherobots.com/incident/cmkfrzjki002t12xi5wybbs48 https://status.wherobots.com/incident/cmkfrzjki002t12xi5wybbs48 We have identified an issue where API calls are intermittently failing Type: Incident Duration: 1 hour and 25 minutes Affected Components: Wherobots Website Dec 4, 05:00:27 GMT+0 - Identified - We are applying a fix now. Dec 4, 05:38:27 GMT+0 - Identified - We are continuing to work on a fix for this incident. Dec 4, 06:25:06 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 1 hour and 25 minutes

Affected Components:

<p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>05:00:27</var> GMT+0</small><br><strong>Identified</strong> - We are applying a fix now..</p> <p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>05:38:27</var> GMT+0</small><br><strong>Identified</strong> - We are continuing to work on a fix for this incident..</p> <p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>06:25:06</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Thu, 4 Dec 2025 05:00:27 +0000 https://status.wherobots.com/incident/cmir1dyp0051a9wosvgmvinzu https://status.wherobots.com/incident/cmir1dyp0051a9wosvgmvinzu Wherobots Cloud Notebook Outage Type: Incident Duration: 4 hours and 16 minutes Affected Components: Wherobots Notebooks Nov 24, 21:21:00 GMT+0 - Identified - We have identified an issue in our cloud infrastructure that is preventing workloads from starting on Wherobots Cloud that are using WherobotsDB v1.x. We are implementing a fix now to restore workloads as soon as possible. Nov 24, 22:25:18 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Workloads are now starting successfully on Wherobots Cloud. Nov 24, 22:31:28 GMT+0 - Resolved - This incident has been resolved. Nov 24, 23:41:20 GMT+0 - Investigating - Spark is not working in Workloads. We are currently investigating this incident. Nov 24, 23:56:00 GMT+0 - Resolved - This incident has been resolved. Nov 24, 23:53:57 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Type: Incident

Duration: 4 hours and 16 minutes

Affected Components:

<p><small>Nov <var data-var='date'> 24</var>, <var data-var='time'>21:21:00</var> GMT+0</small><br><strong>Identified</strong> - We have identified an issue in our cloud infrastructure that is preventing workloads from starting on Wherobots Cloud that are using WherobotsDB v1.x. We are implementing a fix now to restore workloads as soon as possible..</p> <p><small>Nov <var data-var='date'> 24</var>, <var data-var='time'>22:25:18</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix and are currently monitoring the result. Workloads are now starting successfully on Wherobots Cloud..</p> <p><small>Nov <var data-var='date'> 24</var>, <var data-var='time'>22:31:28</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> <p><small>Nov <var data-var='date'> 24</var>, <var data-var='time'>23:41:20</var> GMT+0</small><br><strong>Investigating</strong> - Spark is not working in Workloads. We are currently investigating this incident..</p> <p><small>Nov <var data-var='date'> 24</var>, <var data-var='time'>23:56:00</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> <p><small>Nov <var data-var='date'> 24</var>, <var data-var='time'>23:53:57</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix and are currently monitoring the result..</p> ]]> Mon, 24 Nov 2025 21:21:00 +0000 https://status.wherobots.com/incident/cmidplvuu00xkhzd08pifp09i https://status.wherobots.com/incident/cmidplvuu00xkhzd08pifp09i Unable to select a runtime to start a notebook Type: Incident Duration: 15 minutes Affected Components: Wherobots Notebooks, Wherobots Website Nov 14, 20:42:29 GMT+0 - Identified - We have identified an issue preventing users from selecting a runtime to start a notebook on Wherobots Cloud. The team is working on a fix to resolve the issue as soon as possible. Nov 14, 20:57:00 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 15 minutes

Affected Components: ,

<p><small>Nov <var data-var='date'> 14</var>, <var data-var='time'>20:42:29</var> GMT+0</small><br><strong>Identified</strong> - We have identified an issue preventing users from selecting a runtime to start a notebook on Wherobots Cloud. The team is working on a fix to resolve the issue as soon as possible..</p> <p><small>Nov <var data-var='date'> 14</var>, <var data-var='time'>20:57:00</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Fri, 14 Nov 2025 20:42:29 +0000 https://status.wherobots.com/incident/cmhzbqra60dcsqekxwqsmxjm4 https://status.wherobots.com/incident/cmhzbqra60dcsqekxwqsmxjm4 Intermittent failures when starting a notebook or a job on Wherobots. Type: Incident Duration: 1 hour and 46 minutes Affected Components: Wherobots Notebooks, Wherobots Jobs Nov 12, 19:32:30 GMT+0 - Investigating - We are see intermittent failures when starting a notebook or job on our platform. The team is investigation the issue. Nov 12, 19:59:56 GMT+0 - Identified - We have identified the issue and working on restoring full service. Nov 12, 21:03:47 GMT+0 - Monitoring - A fix has been rolled out and we're currently monitoring the system. Nov 12, 21:18:03 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 1 hour and 46 minutes

Affected Components: ,

<p><small>Nov <var data-var='date'> 12</var>, <var data-var='time'>19:32:30</var> GMT+0</small><br><strong>Investigating</strong> - We are see intermittent failures when starting a notebook or job on our platform. The team is investigation the issue..</p> <p><small>Nov <var data-var='date'> 12</var>, <var data-var='time'>19:59:56</var> GMT+0</small><br><strong>Identified</strong> - We have identified the issue and working on restoring full service..</p> <p><small>Nov <var data-var='date'> 12</var>, <var data-var='time'>21:03:47</var> GMT+0</small><br><strong>Monitoring</strong> - A fix has been rolled out and we're currently monitoring the system..</p> <p><small>Nov <var data-var='date'> 12</var>, <var data-var='time'>21:18:03</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Wed, 12 Nov 2025 19:32:30 +0000 https://status.wherobots.com/incident/cmhwed1fr003tf3l8usmn2akh https://status.wherobots.com/incident/cmhwed1fr003tf3l8usmn2akh Issues accessing Wherobots Cloud Type: Incident Duration: 2 hours and 50 minutes Affected Components: Wherobots Notebooks, Wherobots Website, Wherobots Jobs, Wherobots Catalog Nov 8, 00:05:00 GMT+0 - Investigating - We are currently investigating this incident. Nov 8, 01:39:57 GMT+0 - Identified - The issue is mitigated, and services are operational. We are proactively investigating the root cause. Nov 8, 04:18:46 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 2 hours and 50 minutes

Affected Components: , , ,

<p><small>Nov <var data-var='date'> 8</var>, <var data-var='time'>00:05:00</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident..</p> <p><small>Nov <var data-var='date'> 8</var>, <var data-var='time'>01:39:57</var> GMT+0</small><br><strong>Identified</strong> - The issue is mitigated, and services are operational. We are proactively investigating the root cause..</p> <p><small>Nov <var data-var='date'> 8</var>, <var data-var='time'>04:18:46</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Sat, 8 Nov 2025 00:05:00 +0000 https://status.wherobots.com/incident/cmhplwjda01orwe4sldtpcc09 https://status.wherobots.com/incident/cmhplwjda01orwe4sldtpcc09 Issues starting notebooks and jobs on Wherobots Cloud Type: Incident Duration: 54 minutes Affected Components: Wherobots Notebooks, Wherobots Jobs Oct 22, 06:20:14 GMT+0 - Identified - We have identified an issue preventing the initialization of hosted notebooks and job runs on Wherobots Cloud. We are working on a fix and will provide updates as soon as possible. Oct 22, 06:49:01 GMT+0 - Monitoring - We implemented a fix; notebooks and job runs are operational and we are currently monitoring the system for nominal performance. Oct 22, 07:14:22 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 54 minutes

Affected Components: ,

<p><small>Oct <var data-var='date'> 22</var>, <var data-var='time'>06:20:14</var> GMT+0</small><br><strong>Identified</strong> - We have identified an issue preventing the initialization of hosted notebooks and job runs on Wherobots Cloud. We are working on a fix and will provide updates as soon as possible..</p> <p><small>Oct <var data-var='date'> 22</var>, <var data-var='time'>06:49:01</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix; notebooks and job runs are operational and we are currently monitoring the system for nominal performance..</p> <p><small>Oct <var data-var='date'> 22</var>, <var data-var='time'>07:14:22</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Wed, 22 Oct 2025 06:20:14 +0000 https://status.wherobots.com/incident/cmh1ltapp04imepex9gjs9aoi https://status.wherobots.com/incident/cmh1ltapp04imepex9gjs9aoi Degraded performance in US-EAST-1 due to AWS outage. Type: Incident Duration: 15 hours and 43 minutes Affected Components: Wherobots Notebooks, Wherobots Website, Wherobots Catalog Oct 20, 07:10:00 GMT+0 - Identified - AWS have been having increased error rates and latencies for multiple AWS services in the US-EAST-1 Region. It's affecting Wherobots operations in US-EAST-1 and it has been affecting other regions intermittently as well. Oct 20, 21:23:01 GMT+0 - Monitoring - AWS services in the US-EAST-1 region are recovering, it is now possible to run Wherobots workloads in that region. That are still occasional performance degradations, and we keep monitoring the progress. Oct 20, 22:53:00 GMT+0 - Resolved - By 3:01 PM, all AWS services returned to normal operations. While there are still some features that are disabled as everything here at Wherobots recovers, US-EAST-1 region and all critical functionalities are now available without any degradations. Type: Incident

Duration: 15 hours and 43 minutes

Affected Components: , ,

<p><small>Oct <var data-var='date'> 20</var>, <var data-var='time'>07:10:00</var> GMT+0</small><br><strong>Identified</strong> - AWS have been having increased error rates and latencies for multiple AWS services in the US-EAST-1 Region. It's affecting Wherobots operations in US-EAST-1 and it has been affecting other regions intermittently as well..</p> <p><small>Oct <var data-var='date'> 20</var>, <var data-var='time'>21:23:01</var> GMT+0</small><br><strong>Monitoring</strong> - AWS services in the US-EAST-1 region are recovering, it is now possible to run Wherobots workloads in that region. That are still occasional performance degradations, and we keep monitoring the progress..</p> <p><small>Oct <var data-var='date'> 20</var>, <var data-var='time'>22:53:00</var> GMT+0</small><br><strong>Resolved</strong> - By 3:01 PM, all AWS services returned to normal operations. While there are still some features that are disabled as everything here at Wherobots recovers, US-EAST-1 region and all critical functionalities are now available without any degradations..</p> ]]> Mon, 20 Oct 2025 07:10:00 +0000 https://status.wherobots.com/incident/cmgzewad806k0yldjj20tjg6a https://status.wherobots.com/incident/cmgzewad806k0yldjj20tjg6a