optimise active checks

[itechdima]

Problem

Problems:

• Active check controller list all slurm jobs even though they could be already completed on the previous reconcilation loop.
• Too noisy logs on big clusters.

Solution

Add extra annotation for unhandled slurm jobs and iterate over it.
Reduce log verbosity.

Testing

Release Notes

Fix: reduce number of slurm api calls in active check controller.