Don't loop through points unnecessarily in RectangleGeometry

[hpinkos]

Replaces #4781

Moved some if checks outside of the for loops so we can skip the loop instead of looping through all the positions and doing nothing for each iteration

[pjcozzi]

Thanks, please update CHANGES.md in master.