setting processor affinity for individual parallel toolbox workers

Hi

Just wondering does anyone know if there are any general rules for improving speed by setting processor affinity using the windows task manager? I've got six matlab workers and was wondering if it's worth assigning each one a separate CPU, or whether windows/intel already do something more complicated that I might be disrupting?

Thanks