Skip to content

Pinot Project module to check CPU utilizations and if threshold breaches recalculates the curve fitting parameters

Notifications You must be signed in to change notification settings

shsahu/FeedBackModule

Repository files navigation

serverCPUUtilization

FEEDBACK MODULE

Prerequisite: Install below library to the main server where the daemon to be set: bc, numpy, pylab

Below files will reside on main server:

feedback

->CPUUtilDaemon.sh
   
->collectCheckCPUUtil.sh
    
->collectCheckCPUUtil.sh 
            
->collectCheckCPUUtil.sh

->checkCPUUtil.py

->calculateCurveParameters.py
   		 
->daemonLog : contains all logs generated by the code
             
->serverLog: contains cpu idle data logs of last “t” secs of different worker servers

All the worker server will have below files

feedback

->extract_cpu_idle.sh

->serverLog:last_interval_cpu_idle.log

CPUUtilDaemon.sh : Script to start/stop the execution of thread that periodically collects cpu data , find the 90th percentile of the cpu utilization, compare it to a given threshold and keeps count of threshold breached. If threshold is breached more than the given breach count than the curve parameters are recalculated.

Command to

start : ./CPUUtilDaemon.sh start "timePeriod" "thresholdValue" "maxBreachCount"

stop:  ./CPUUtilDaemon.sh stop

restart: ./CPUUtilDaemon.sh restart "timePeriod" "thresholdValue" "maxBreachCount"

Log file: feedback/daemonLog/collectCheckCPUUtil.log

About

Pinot Project module to check CPU utilizations and if threshold breaches recalculates the curve fitting parameters

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published