Scaling Security Insights: how we achieved a 10x increase in global scanning capacity
Cloudflare Blog 2026-06-12 13:00:00
Context: Cloudflare, a leading cloud-based security and performance solutions company, has successfully scaled its Security Insights system to meet the growing demands of its global customer base. The system provides real-time threat intelligence and security insights to help customers protect their online presence. Through a series of optimizations and improvements, Cloudflare has achieved a significant increase in scanning capacity, enabling it to provide more frequent insights to its customers.
Key Facts
- The Cloudflare Security Insights system now processes over 120 scans per second, a 10x increase in global scanning capacity. This improvement was achieved without the need to add any additional hardware, demonstrating the efficiency of the optimizations made to the system. By optimizing Kafka consumers, the system's ability to handle incoming data was significantly enhanced, allowing it to keep pace with the growing volume of security-related data. Additionally, the optimization of Postgres queries improved the system's ability to retrieve and process data, further contributing to the overall increase in scanning capacity. The company's API was also optimized, ensuring that the system could handle the increased demand from customers and provide real-time security insights.