The GPU memory controllers will do all kinds of swizzling for you, it shouldn't be a surprise as it should be what the XBONE DME's are most likely bassed off.
Setting up and firing off jobs these days is a lot cheaper then it used to be, I think it was around DX10 when they started to try and reduce the number of draw calls to make the strain less on the CPU. PRT stuff should be done from the GPU, as it is the device that reads in the textures.
I honestly don't see a lot of work for the CPU to do
. (I counted the GPU driver in the 2 reserved cores btw) and reserved a entire jaguar core just for SHAPE.
Animation is a good point though.
If we give each job a core of its own we still have 2/3 left over doing nothing.