Incident resolved; session processing queue continue to operate in steady state following the fix put in place on Friday.
Posted Feb 07, 2018 - 09:53 EST
Monitoring
Temporary fix to address the session processing queue backlog was put into place on Friday at roughly 22:00 EST, and the queues reached a normal steady state on Saturday around 20:00 EST. We are continuing to monitor the situation to ensure that sessions are processed in a normal timely manner.
Posted Feb 05, 2018 - 09:25 EST
Update
We’re continuing to investigate and address the delays in the processing of recordings. The same symptoms that were present in the original status post from yesterday still apply, namely, recordings may be slow to play, or may not play correctly (e.g. the playback window appears blank). All data is being recorded and will eventually play back correctly once this incident is resolved.
To provide a little more color about what’s going on behind the scenes, we’re noticing persistent, unexpected delays in the session processing pipeline. The root cause has not yet been identified. We do have a temporary workaround to address the session processing backlog more quickly.
We’ll continue to post updates to this incident as we have them. If you have any questions, please feel free to email us at support@fullstory.com.
Posted Feb 02, 2018 - 15:58 EST
Investigating
We are currently investigating a delays in the processing of recordings. Recordings maybe be slow to play, or may not play correctly at all (e.g. the playback screen is blank). At this time we believe that all data IS being recorded correctly and thus will eventually play back correctly.