Mixed signals??!!!?

All he has to offer you is flakiness and jive. So it's your choice whether to talk to him at all. And yes, I would keep it totally casual since there is literally nothing here.