you too?

So here are situations I kind of hate it... because i catch myself saying You too... when it clearly makes no sense.

Scenario: I'm on the phone with my client. It is Thursday afternoon. My flight is in about 3 hours and this is the last time I will speak with her until after my flight. End of conversation goes something like this...

Me: yada yada wrap up conversation yada yada
Client: Hope you have a safe flight
Me: You too (thinking wait... she isn't flying... I'm the one that is going to have a safe flight, not her)
Client: Bye bye
Me: Bye

So why did I say you too. My best guess is that i said it out of bad habit because this situation happens a lot to me. Is this just my own personal problem... or does it happen to you too?