Delays in shipment events processing

Incident Report for Karla

Resolved

On January 16, 2025, between 08:43 UTC and 14:55 UTC a significant portion of shipment updates had delays due to an upper bound limitation in our automatic scaling mechanism when handling an increased amount of traffic.

We mitigated the incident by requesting a bigger quota and improving our logic and metrics to automatically scale during such peaks.

We are improving our automatic scaling and infrastructure resources quota practices to prevent issues like this in the future.
Posted Jan 16, 2025 - 08:30 UTC