Failing Dashboard Queries

Incident Report for Heap

Resolved

This incident has been resolved.

Posted Feb 28, 2017 - 16:10 PST

Monitoring

All Heap systems are still stable. Our infrastructure team is continuing to monitor as our upstream provider (Amazon AWS) recovers.

There may still be data missing in your dashboard from earlier today, but no data has been lost and we are working to backfill that data.

Posted Feb 28, 2017 - 13:15 PST

Update

Dashboard queries are working again properly. Data collection is unaffected, and no data has been lost.

A small amount of data from the last hour may be missing for some customers. We are working on backfilling the data.

The underlying cause for these issues is an outage at an upstream provider (Amazon AWS; https://status.aws.amazon.com/). Our infrastructure team is all-hands mitigating any fallout from that upstream outage.

Posted Feb 28, 2017 - 10:43 PST

Investigating

Dashboard queries are failing for some customers. Our engineering team is investigating.

Posted Feb 28, 2017 - 10:03 PST