Observability upload and Agent Simulations failures

Incident Report for LiveKit

Resolved

This incident has been resolved. Between 08:15 and 12:35 UTC, agents were not able to upload agent observability data to LiveKit's servers in all regions. Agent sessions completed normally, but, unfortunately, any Agent Insights data which attempted to upload within that window (traces/transcripts/logs/recordings) is unrecoverable. The ability to download existing Agent Insights data was impaired until 13:15 UTC. Agent Simulations were unavailable due to a upstream dependency and came back online at 13:25 UTC.

Sincere apologies for the impact. We will follow up with a postmortem as soon as possible.
Posted Oct 13, 2026 - 06:44 PDT

Update

Agent Insights uploads are now operational and session data has been storing normally since 12:40 UTC. We are still investigating an issue with Simulations. Simulation runs may complete without a transcript, summary, or verdict. We will post an update shortly.
Posted Oct 13, 2026 - 06:15 PDT

Update

We are continuing to work on a fix for this issue.
Posted Oct 13, 2026 - 04:40 PDT

Identified

We have identified the cause of the Agent Insights issue and are working on a fix.
Posted Oct 13, 2026 - 03:45 PDT

Investigating

We are investigating an issue with Agent Insights where agents are unable to upload their observability data at the end of their sessions. Some recent agent sessions may be missing from the dashboard's sessions list or shown as “In progress”. Agent sessions themselves are not affected. We will post an update shortly.
Posted Oct 13, 2026 - 03:01 PDT
This incident affected: Cloud Dashboard (cloud.livekit.io).