The origins of innovation

Trying to understand how our innovation capacity works inevitably leads to the question of how that capacity evolved in the first place: Where does innovation come from?