The symbol of his office shall be the mace, which shall be borne by him while enforcing order on the floor.

(Oct. 1, 1890, ch. 1256, §2, 26 Stat. 645.)