You also haven't been living in the same place all your life, so I think that might have helped you form more memories :)

But, yeah, I do agree that memorable experiences are often connected to events shared with other people.

By the way, I also have some trouble recognizing faces sometimes. In fact, for a while, I suspected I might have prosopagnosia, a.k.a. face blindness. But I made a test and realized that I don't have it. The explanation is actually much simpler:

https://medium.com/@davidbclear/what-the-heck-is-prosopagnosia-2897ec308a60