Anomaly Detection Platform

  • Built an anomaly detection platform to detect/predict anomalies in various server-side metrics like CPU, memory usage, traffic in / out, etc.  
  • Completely open-source based, and runs on Spark Clusters.
  • The platform has the following capabilities:
    • Can detect anomalies on more than 10,000 metrics in the given datasets
    • In-built Auto-AI functionality 
    • On detection, raise alerts in dashboards and send notifications.
    • Ability to drill down to identify root causes

Technologies Used: Apache SparkKafkaInfluxDBKapacitorTensorFlow (LSTM), fbProphetDockerKubernetes, Amazon AWS Cloud