In a vertical direction.

Roget 212: vertically etc. adj.; up, on end; up on end, right on end; a plomb [Fr.], endwise; one one's legs; at right angles.