Coworker keeps speaking English to test me

I speak Japanese N1 and have been at this company 3 years. New coworker keeps speaking broken English to me, refusing to use Japanese. I think he wants to practice. It is exhausting. How to politely tell him to stop?