tag:status.heap.io,2005:/historyHeap Status - Incident History2024-03-28T11:40:02-07:00Heaptag:status.heap.io,2005:Incident/203303112024-03-26T12:18:10-07:002024-03-26T12:18:10-07:00Heap Connect Sync Delays<p><small>Mar <var data-var='date'>26</var>, <var data-var='time'>12:18</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>22</var>, <var data-var='time'>14:46</var> PDT</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Mar <var data-var='date'>22</var>, <var data-var='time'>10:08</var> PDT</small><br><strong>Monitoring</strong> - Connect syncs were delayed for all environments beginning early morning US business hours.<br /><br />Engineering has deployed a fix and we are beginning to catchup delayed environments. <br /><br />We will post an update in two hours, or resolve the incident if all environments have recovered.</p>tag:status.heap.io,2005:Incident/202686172024-03-15T11:54:11-07:002024-03-15T11:54:11-07:00Heap Connect Sync Delays<p><small>Mar <var data-var='date'>15</var>, <var data-var='time'>11:54</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>15</var>, <var data-var='time'>08:09</var> PDT</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Mar <var data-var='date'>15</var>, <var data-var='time'>07:26</var> PDT</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Mar <var data-var='date'>15</var>, <var data-var='time'>07:13</var> PDT</small><br><strong>Investigating</strong> - We are currently experiencing delays for Connect Syncs. All environments appear to be affected.<br /><br />Our engineering team is currently working to identify a root cause and implement a solution.<br /><br />We will post an update in 30 minutes.</p>tag:status.heap.io,2005:Incident/202348312024-03-13T13:20:57-07:002024-03-13T13:20:57-07:00Heap Connect Sync Delays<p><small>Mar <var data-var='date'>13</var>, <var data-var='time'>13:20</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>13</var>, <var data-var='time'>09:05</var> PDT</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Mar <var data-var='date'>13</var>, <var data-var='time'>08:46</var> PDT</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Mar <var data-var='date'>13</var>, <var data-var='time'>08:30</var> PDT</small><br><strong>Investigating</strong> - We are currently experiencing delays for Connect Syncs. All environments appear to be affected.<br /><br />Our engineering team is currently working to identify a root cause and implement a solution.<br /><br />We will post an update in 30 minutes.</p>tag:status.heap.io,2005:Incident/201709192024-03-10T18:48:13-07:002024-03-10T18:48:13-07:00Infrastructure Maintenance<p><small>Mar <var data-var='date'>10</var>, <var data-var='time'>18:48</var> PDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'>10</var>, <var data-var='time'>17:00</var> PDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>15:14</var> PST</small><br><strong>Scheduled</strong> - We will be continuing some maintenance on our networking infrastructure, we expect there will be brief and intermittent interruptions to the App and some latency in data appearing in the UI or through integrations.<br /><br />Data ingestion will not be impacted.</p>tag:status.heap.io,2005:Incident/201589572024-03-05T10:16:48-08:002024-03-05T10:16:48-08:00Temporary Data Latency<p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>10:16</var> PST</small><br><strong>Resolved</strong> - Data latency has recovered. Data in reports and live view is now readily available. This issue is resolved.</p><p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>14:32</var> PST</small><br><strong>Monitoring</strong> - A fix has been implemented and data latency is recovering. We will continue to monitor and post another update in the next 24 hours.</p><p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>12:39</var> PST</small><br><strong>Update</strong> - We are continuing to investigate this issue. We will share another update in two hours.</p><p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>10:23</var> PST</small><br><strong>Update</strong> - We are continuing to investigate this issue. We'll be posting another update in two hours.</p><p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>09:20</var> PST</small><br><strong>Investigating</strong> - We are currently experiencing delays in data being available in the app. You may notice missing data in your reports. Data collection is unaffected, and no data has been lost. Our engineers are currently investigating the issue. We'll be posting another update in 60 mins.</p>tag:status.heap.io,2005:Incident/200428372024-02-27T15:11:35-08:002024-02-27T15:11:37-08:00Initial properties sometimes not visible<p><small>Feb <var data-var='date'>27</var>, <var data-var='time'>15:11</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>14:06</var> PST</small><br><strong>Update</strong> - Initial properties should now appear normally in the app for all incoming new data. We are still working to restore visibility of initial properties for affected historical data. We'll post the next update by 10 AM Monday morning US Pacific.</p><p><small>Feb <var data-var='date'>21</var>, <var data-var='time'>18:04</var> PST</small><br><strong>Update</strong> - A fix has been implemented to make initial properties visible for incoming new data. We are monitoring this fix, and also working to extend it to historical data. We'll post the next update by tomorrow 9 am US Pacific.</p><p><small>Feb <var data-var='date'>21</var>, <var data-var='time'>16:00</var> PST</small><br><strong>Identified</strong> - We have identified that initial properties are sometimes not visible in the app. You may notice missing data in your reports. Data collection is unaffected, and no data has been lost. Our engineers have diagnosed the issue and are working on a fix. We'll be posting another update within 2 hours.</p>tag:status.heap.io,2005:Incident/200768132024-02-27T02:13:20-08:002024-02-27T02:13:20-08:00Experiencing delays in data being available in the app<p><small>Feb <var data-var='date'>27</var>, <var data-var='time'>02:13</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>26</var>, <var data-var='time'>05:18</var> PST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Feb <var data-var='date'>26</var>, <var data-var='time'>05:17</var> PST</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Feb <var data-var='date'>26</var>, <var data-var='time'>01:02</var> PST</small><br><strong>Identified</strong> - We are currently experiencing delays in data being available in the app. Data collection is unaffected, and no data has been lost. Our engineers are currently working on the issue.</p>tag:status.heap.io,2005:Incident/200500352024-02-25T19:00:56-08:002024-02-25T19:00:56-08:00Infrastructure maintenance<p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>19:00</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>17:00</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>09:19</var> PST</small><br><strong>Scheduled</strong> - We will be performing a routine upgrade to our infrastructure. There may be brief interruptions to the App availability and delays in data being available. Collection of data will not be impacted.</p>tag:status.heap.io,2005:Incident/200140892024-02-18T21:00:59-08:002024-02-18T21:00:59-08:00Infrastructure Maintenance<p><small>Feb <var data-var='date'>18</var>, <var data-var='time'>21:00</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'>18</var>, <var data-var='time'>18:00</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>18</var>, <var data-var='time'>09:03</var> PST</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance during this time.</p>tag:status.heap.io,2005:Incident/199940172024-02-18T09:00:56-08:002024-02-18T09:00:56-08:00Infrastructure Maintenance<p><small>Feb <var data-var='date'>18</var>, <var data-var='time'>09:00</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'>18</var>, <var data-var='time'>06:00</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>15</var>, <var data-var='time'>10:43</var> PST</small><br><strong>Scheduled</strong> - We will be performing a routine upgrade to our infrastructure. There may be brief interruptions to the App availability and delays in data being available. Collection of data will not be impacted.</p>tag:status.heap.io,2005:Incident/199763102024-02-13T12:31:26-08:002024-02-13T12:31:26-08:00Data latency in the app<p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>12:31</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>11:26</var> PST</small><br><strong>Monitoring</strong> - A fix has been implemented. Some customers may still experience some latency. We continue to monitor.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>10:12</var> PST</small><br><strong>Update</strong> - We continue to work on fixing this latency. Will update again in an hour.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>09:14</var> PST</small><br><strong>Identified</strong> - The cause of the latency has been identified and we are working on fixing it. We will post another update within the hour.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>08:26</var> PST</small><br><strong>Investigating</strong> - We are currently experiencing delays in data being available in the app. You may notice missing data in your reports. Data collection is unaffected, and no data has been lost. Our engineers are currently investigating the issue. We'll be posting another update in 60 mins.</p>tag:status.heap.io,2005:Incident/199189032024-02-06T00:39:38-08:002024-02-06T00:39:38-08:00BigQuery syncs are failing<p><small>Feb <var data-var='date'> 6</var>, <var data-var='time'>00:39</var> PST</small><br><strong>Resolved</strong> - The incident has been resolved; all environments have recovered from the delays.</p><p><small>Feb <var data-var='date'> 5</var>, <var data-var='time'>22:19</var> PST</small><br><strong>Investigating</strong> - You should not expect to see any new events or users showing up in your BigQuery tables. Data collection is unaffected. No data has been lost.</p>tag:status.heap.io,2005:Incident/198949942024-02-02T22:02:47-08:002024-02-02T22:02:47-08:00Heap Connect Data Latency<p><small>Feb <var data-var='date'> 2</var>, <var data-var='time'>22:02</var> PST</small><br><strong>Resolved</strong> - The incident has been resolved; all environments have recovered from the delays.</p><p><small>Feb <var data-var='date'> 2</var>, <var data-var='time'>22:01</var> PST</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Feb <var data-var='date'> 2</var>, <var data-var='time'>22:00</var> PST</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Feb <var data-var='date'> 2</var>, <var data-var='time'>09:28</var> PST</small><br><strong>Monitoring</strong> - Heap Connect is currently experiencing data latency for all warehouse destinations. Connect syncs are otherwise operational and will continue to sync any newly available data. Our engineering team is currently monitoring the situation and will post another update once the latency recovers.</p>tag:status.heap.io,2005:Incident/198391602024-01-26T10:57:20-08:002024-01-26T10:57:20-08:00Session list queries are currently not working.<p><small>Jan <var data-var='date'>26</var>, <var data-var='time'>10:57</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>26</var>, <var data-var='time'>09:55</var> PST</small><br><strong>Monitoring</strong> - A fix has been implemented and we're continue to monitor.</p><p><small>Jan <var data-var='date'>26</var>, <var data-var='time'>08:49</var> PST</small><br><strong>Identified</strong> - We have diagnosed the issue and are working on a resolution. Data collection is not impacted, and no other query functionality is affected.</p>tag:status.heap.io,2005:Incident/196727662024-01-10T21:14:04-08:002024-01-10T21:14:04-08:00Heap Connect Sync Delays<p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>21:14</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>19:36</var> PST</small><br><strong>Update</strong> - We continue to investigate the delay.</p><p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>16:19</var> PST</small><br><strong>Investigating</strong> - We are currently experiencing delays for Connect syncs. All environments appear to be affected.<br /><br />Our engineers are currently investigating the issue. We'll be posting another update in 60 mins.</p>tag:status.heap.io,2005:Incident/196623172024-01-09T21:53:06-08:002024-01-09T21:53:06-08:00Heap Connect Sync Delays<p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>21:53</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>20:01</var> PST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>17:11</var> PST</small><br><strong>Investigating</strong> - We are currently experiencing delays for Connect Syncs. All environments appear to be affected.<br /><br />Our engineering team is currently working to identify a root cause and implement a solution.<br /><br />We will post an update in 30 minutes.</p>tag:status.heap.io,2005:Incident/193172152023-12-04T10:09:59-08:002023-12-04T10:09:59-08:00Tables are currently not available on dashboards<p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>10:09</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved. Please reach out to support if you continue to have issues with tables loading in dashboards.</p><p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>09:51</var> PST</small><br><strong>Monitoring</strong> - A fix has been implemented. We will continue to monitor to ensure customers are no longer impacted.</p><p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>09:41</var> PST</small><br><strong>Identified</strong> - We have identified the issue and are working on a fix.</p><p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>09:34</var> PST</small><br><strong>Investigating</strong> - We are investigating this issue.</p>tag:status.heap.io,2005:Incident/191290552023-11-15T14:22:44-08:002023-11-15T14:22:44-08:00App Unavailability<p><small>Nov <var data-var='date'>15</var>, <var data-var='time'>14:22</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>15</var>, <var data-var='time'>13:39</var> PST</small><br><strong>Monitoring</strong> - A fix has been implemented and we're monitoring the results. Data latency is still elevated but recovering.</p><p><small>Nov <var data-var='date'>15</var>, <var data-var='time'>12:33</var> PST</small><br><strong>Update</strong> - We are continuing to work on a fix and data latency is still elevated. No data has been lost. We'll post another update in the next hour.</p><p><small>Nov <var data-var='date'>15</var>, <var data-var='time'>11:10</var> PST</small><br><strong>Update</strong> - We are continuing to work on a fix and data latency is still elevated. No data has been lost.</p><p><small>Nov <var data-var='date'>15</var>, <var data-var='time'>09:32</var> PST</small><br><strong>Identified</strong> - The issue has been identified and we're working on a fix. During this time you may observe elevated data latency into the Heap app. Collection is unaffected and no data has been lost.</p><p><small>Nov <var data-var='date'>15</var>, <var data-var='time'>08:51</var> PST</small><br><strong>Investigating</strong> - We're experiencing intermittent unavailability of Heap app queries. Data collection is unaffected. Our engineering team is investigating the issue and we'll post an update in the next 30 minutes.</p>tag:status.heap.io,2005:Incident/190366782023-11-06T21:57:58-08:002023-11-06T21:57:58-08:00Temporary Data Latency<p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>21:57</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>08:48</var> PST</small><br><strong>Monitoring</strong> - We are currently experiencing delays in data being available in the app. You may notice missing data in your reports. Data collection is unaffected, and no data has been lost. Our engineers are currently investigating the issue.</p>tag:status.heap.io,2005:Incident/190146462023-11-05T03:00:02-08:002023-11-05T03:00:02-08:00Session Replay Scheduled Maintenance<p><small>Nov <var data-var='date'> 5</var>, <var data-var='time'>03:00</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'> 4</var>, <var data-var='time'>18:00</var> PDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'> 3</var>, <var data-var='time'>15:19</var> PDT</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance in our session replay pipeline at this time. You will notice delays when accessing the latest sessions. No data will be lost. The previous replays are still accessible. Thanks for your patience.</p>tag:status.heap.io,2005:Incident/190121092023-11-03T18:35:58-07:002023-11-03T18:35:58-07:00Temporary Data Latency<p><small>Nov <var data-var='date'> 3</var>, <var data-var='time'>18:35</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'> 3</var>, <var data-var='time'>09:42</var> PDT</small><br><strong>Identified</strong> - We are currently experiencing delays in data being available in the app. You may notice missing data in your reports. Data collection is unaffected, and no data has been lost. Our engineers are currently investigating the issue.</p>tag:status.heap.io,2005:Incident/190015602023-11-02T22:56:33-07:002023-11-02T22:56:33-07:00Temporary Data Latency<p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>22:56</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>09:04</var> PDT</small><br><strong>Identified</strong> - We are currently experiencing delays in data being available in the app. You may notice missing data in your reports. Data collection is unaffected, and no data has been lost. Our engineers are currently investigating the issue.</p>tag:status.heap.io,2005:Incident/189801412023-10-31T14:24:48-07:002023-10-31T14:24:48-07:00App Unavailability<p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>14:24</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>08:49</var> PDT</small><br><strong>Monitoring</strong> - A fix has been implemented and we're monitoring the results.</p><p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>08:20</var> PDT</small><br><strong>Investigating</strong> - We're experiencing intermittent unavailability of the Heap app. Data collection is unaffected. Our engineering team is investigating the issue and we'll post an update in the next 15 minutes.</p>tag:status.heap.io,2005:Incident/189359452023-10-27T08:02:40-07:002023-10-27T08:02:40-07:00Temporary Data Latency<p><small>Oct <var data-var='date'>27</var>, <var data-var='time'>08:02</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>26</var>, <var data-var='time'>11:34</var> PDT</small><br><strong>Monitoring</strong> - Our engineers have deployed a fix and the latency is trending down. We'll post another update once it fully recovers.</p><p><small>Oct <var data-var='date'>26</var>, <var data-var='time'>09:59</var> PDT</small><br><strong>Identified</strong> - Our engineers have identified the issue and are working on a fix. At this point, we don't have an ETA on recovery. We'll be posting another update in 60 mins.</p><p><small>Oct <var data-var='date'>26</var>, <var data-var='time'>08:43</var> PDT</small><br><strong>Investigating</strong> - We are currently experiencing delays in data being available in the app. You may notice missing data in your reports. Data collection is unaffected, and no data has been lost. Our engineers are currently investigating the issue.</p>tag:status.heap.io,2005:Incident/189318662023-10-26T04:26:14-07:002023-10-26T04:26:14-07:00Temporary Data Latency<p><small>Oct <var data-var='date'>26</var>, <var data-var='time'>04:26</var> PDT</small><br><strong>Resolved</strong> - This issue has been resolved.</p><p><small>Oct <var data-var='date'>26</var>, <var data-var='time'>02:35</var> PDT</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Oct <var data-var='date'>26</var>, <var data-var='time'>01:01</var> PDT</small><br><strong>Investigating</strong> - We are currently experiencing delays in data being available in the app. You may notice missing data in your reports. Data collection is unaffected, and no data has been lost. Our engineers have are currently investigating the issue.</p>