As software developers, we often insist on using the most cutting edge technologies, building scalable systems, and creating robust infrastructures. However, as a result, when changes have to be made to the running system it may cause unexpected challenges in stability and overall system operational cost.
This is what happened to my team of backend developers at Riskified when we were asked to make a small configuration change to our system, but realized that implementing the requested change will not be a cost-efficient solution. The system's stability will be impacted negatively and result in significantly high operational expenses. We specifically found that the transition from Kafka Streams to Redis will make our lives much easier (and cheaper).
In this session, I’ll demonstrate how simplifying our existing system and reducing its cost can ironically ultimately help scale it in the future, and how this approach can be applied to other use cases as well.