In my country, if you don’t press it, you won’t get green. The intersection will still change, but the pedestrian light won’t. If the button isn’t pressed, the intersection light will change faster, since there won’t be pedestrians holding up traffic.