Problem Description, Impact, and Resolution

At 19:18 UTC on Nov 17, 2023 we observed networking issues on the Reactors service in the US region, which resulted in intermittent 404 errors on token retrieves. The issue was caused by an internal and private DNS route update that temporarily broke the traffic route for the bt instantiated Basis Theory SDK in Reactors. We immediately updated the DNS record to route all traffic to the correct destination and the issue was fully resolved at 20:00 UTC.

Mitigation Steps and Future Preventative Measures

To mitigate the recurrence of this issue, we have decommissioned the specific route configuration within our reactor services. This action will prevent any potential disruptions in future DNS changes when leveraging the bt property within Reactors.