Some interesting thoughts/comments here...
If we weren't doing DIY short haul holidays (as we have goodness knows how many times now)
we would'nt be as fussy about flight times.
Of course the holiday as a whole would all be taken into consideration and we wouldn't NOT go
on a holiday because the flight times weren't "perfect."
(We've had some nightmare flight times with package holidays in the past - especially when the
children were littlies.

)
But as I said, with our DIY hols, luckily, we've never had to leave our accomodation until we've
been leaving for the airport - so depending on the time of the flight, it's always felt like we have
been gaining another days holiday.
If we had to be out of our accomodation early (like when we used to book through travel
agencies/companies) then I'd opt for an early return flight.
We feel it really does makes a difference when you aren't tied to time in having to get out - it's so
much more relaxing getting sorted for going home - especially when there's four of you to organise.
With long haul, we've never really been bothered either way whether they are day time or night
time flights, but we have always preferred to arrive at our holiday location during the daytime
whenever possible.