How can I setup a job to request a specific set of nodes and then if those nodes are not available use other nodes?
One option you can use is NODESETS. The idea here with nodesets is that we search through a ordered list. The first nodeset being the most restrictive leading out to wider and wider groups of resources.
For example if you have 2 groups that have seperate resources but you also what part of those resources to overlap. If you wanted to request both group1 and group2 then you add a feature and nodeset. In this case "overlap" is the name I have chosen.
Tags: NODESETLIST, NODESETS
I tossed in a clusterwide to draw attention to a possibility of adding even more general resource allocation requests.