i found out the problem…my worker CPU was always running high…We were not limiting the number of sub processes for the worker due to which they were spawning as much they can, in our case as many cores available in the k8s node thus limiting other worker pods from getting resources
we solved it by providing the -c parameter as 4 thus limiting the number of sub processes allowed