Implement auto-throtle
-
the value Config.update_interval should automatically increase if executor.jobs.waiting is above a threshold (e.g. multiplied by 2)
-
otherwise Config.update_interval should slowly decrease (e.g. decrement by 1 second)
the value Config.update_interval should automatically increase if executor.jobs.waiting is above a threshold (e.g. multiplied by 2)
otherwise Config.update_interval should slowly decrease (e.g. decrement by 1 second)