Would it be weird to say in kreyol "bon apre midi"?

Non.
That's how we say 'Good afternoon' or 'Have a good afternoon'
☺ Bon apremidi!

Haitian Creole ↔ English Reference, Look up Haitian Creole and English Words