Welcome to the forum, Greg! The geometry of the HSc ejection system makes what you say almost impossible. The Ejection Port and Extractor forces a spent casing to the right all the time. So, unless you are not holding the pistol correctly or someone has opened the Ejection Port or changed the Extractor, you will not "some times" be hit in the face with a spent casing.
I look forward to hearing from you after you have inspected your HSc. Hopefully, it is also a .32 caliber like the one shown above and not a .380.