Is there any limit to the number of jobs that can run in parallel? I can't run more than 10 in parallel, though I have 12 total executors (2 on the master and 1 each on 10 separate nodes). 1 master executor is running the coordinator job, the second master executor is running one of the 11 parallel jobs configured in the coordinator, but only 9 of the nodes run along with the master, and when one of the jobs finish the final node runs its job. Any ideas?
Is there any limit to the number of jobs that can run in parallel? I can't run more than 10 in parallel, though I have 12 total executors (2 on the master and 1 each on 10 separate nodes). 1 master executor is running the coordinator job, the second master executor is running one of the 11 parallel jobs configured in the coordinator, but only 9 of the nodes run along with the master, and when one of the jobs finish the final node runs its job. Any ideas?