Probably we misinterpreted one another. This is what I aimed at when I said "If your problem is that sounds are attached to one character but from multiple actors, fine." And yeah, you're right about that. I'll look into those you mentioned.
Also, cool you pointed out the Canderous speaking...