When the clouds come out

Ever since I was a child, I have had a particular aversion to clouds covering the sun after a sunny start to the day.  I always felt robbed and sad.  Don't know why.