It was from an old Pagan celebration of the Goddess Eostre who fell in love with a bird, but turned him into a rabbit, but found out he does what rabbits do and banished him to the stars. She felt bad though and let him return to earth once a year to hide his eggs for children