DC Fast Charging, with timer set

I normally charge at home and have the timer set to start at 11 PM and end at 7 PM. When fast charging say at noon, do I have to turn the timer off, or can I push the charge button on the key fob when it says connecting to the car?