Mastodon has a feature where you can add a private note to any user’s profile, letting you write reminders to yourself of who that person is, or what your impression of them is, etc. Would be perfect for this, I think.
“Note: ‘Said his dog was cuter than Sarge’”