Possibly too Likeable?

So for context, I feel I interview well. I keep. Making it to the final interview process, before I get told that they went with someone with more experience in that specific field, but I was second p

So for context, I feel I interview well. I keep. Making it to the final interview process, before I get told that they went with someone with more experience in that specific field, but I was second pick. Etc. Anyway, all my interviews tend to go on long, because the interviewers can't stop talking to me and being so open, based on how I answer their questions. Showing an interest and how skills can be transferable etc. Well, my last interview, I recorded it, and I showed it to one of my friends who has training on interviews and a business degree. She said I answered the questions well, and she saw what I meant about how interviewers just seem to talk for quite a bit before they ask me the next question. She said I have a natural charisma, and that might be what is hurting me. That I'm making the interviewer so comfortable with me, and being so likeable in their eyes, that they could see us being friends kind of thing, and then maybe they notice that, and start thinking it's a bias? So basically, they start thinking they want to pick me, only because I'm nice and friendly, and not because I'm qualified. They think they might be thinking I'm qualified, only because they want to pick me so I stay around. And then that in turn, makes them not choose me, because they second guess themselves. I have to ask, is that even a possibility? Being so charismatic and likeable, that the HM just doesn't choose you, because they think they're only choosing you because they liked who you are? My friend said she's seen it before. But I'm just like... If thats the case... What do I do?