Slow and Failing Queries

Incident Report for Heap

Resolved

This incident has been resolved.

Posted Oct 23, 2015 - 06:20 PDT

Monitoring

Data for most users is up-to-date, however about 20% of users are still delayed. Our systems team is monitoring and will update when the backlog is cleared.

Query speeds should be back to normal.

Posted Oct 23, 2015 - 00:36 PDT

Identified

A few of our servers are experiencing extremely heavy load. We've paused data collection for the time being, so you'll notice no new data appearing in your dashboard. We're still queuing up all the data - nothing will get lost.

Once we fix the issue, we'll re-enable our ingestion pipeline, and your dashboard will return to normal. Thanks for bearing with us!

Posted Oct 22, 2015 - 18:35 PDT

Investigating

For some users, queries from ad-hoc and saved reports are running very slowly, or failing entirely. Our infrastructure team is investigating. Data collection is unaffected.

Posted Oct 22, 2015 - 17:12 PDT