With progressive move towards Cloud Native, Microservices and distributed applications we see that log management and observability is becoming more and more important for debugging applications. In many of these cases, harvesting massive amounts of log data from a number of systems is not an easy task.
In this talk we will take a look at how we wrote a database capable of ingesting 20 TB of data per day while still live searching unstructured data. We will go through many of the trade-offs that can be thought of as controversial in our current industry.
YOU MAY ALSO LIKE: