Notice that:

(1) at the aphelion the planet moves slowly, and thus spends relatively more time at that distance;

(2) at the perihelion the planet moves rapidly, but the distance is nearly constant, so it also spends relatively more time at that distance.