Both Poles are relatively cold because they don’t receive direct sunlight. Even during the summer months, the Sun is relatively low on the horizon. In winter months, the Sun doesn’t come up at all for much of the season. These factors are caused by the axial tilt of the Earth.
The reason behind why gravity happens is not solved yet, it is something which is present naturally.