In this letter, a rectangular waveguide with tunable negative group delay (NGD) is proposed. Corrugated tantalum nitride (TaN) slow wave structure is used to generate the NGD response. The NGD value and NGD center frequency can be adjusted continuously by the corrugation width and height. The simulation results show that the NGD values of up to -0.7 ns are potentially available. A prototype of the proposed structure is fabricated and measured. The measured results show the fabricated structure is capable of generating up to -0.115 ns group delay at 19.4 to 19.8 GHz which is consistent with simulation predictions. To our best knowledge, this is the first time that the negative time delay has been realized at Ka-band in rectangular waveguide.