not a bad time to go - but the spanish have an expresson
Hasta el cuarenta de mayo no te quites el sayo
which means, don't put your coat away until the 40th of May - ie around the 10th of June, as even until then the Spanish weather can be unpredicatable and not guaranteed wall to wall sunshine