A coaxial connector includes a housing having a base portion and a tubular portion underneath the base portion. A passageway is defined in both the base portion and the tubular portion. An accommodation space is defined in the base portion and communicates with the passageway. A terminal is received in the passageway and the accommodation space and is connected physically and electrically to an inner conductor of a coaxial cable. A shell includes a sleeve portion accommodating the base portion and the tubular portion of the housing and an outer cover portion. Two arms extend from two sides of an upper portion of the sleeve portion. Each of the arms defines a hook at a tip thereof. The outer cover portion defines two retaining grooves at two sides thereof for holding the two hooks when the shell holds the coaxial cable.