Party chat issue - can hear people from past parties

lobstersaurusbla

I was in a party with a player whose name starts with Ly. After finishing a dungeon, I (the party leader) left the party and made a new one. However, I could still hear his speech (not sure if he could hear me) until I muted him.

Picture attached