Chocolate eggs are a recent addition; it used to be actual eggs. Without looking it up, I seem to remember that it’s basically pagan spring fertility stuff (both eggs and rabbits).