The saber colour thing reflects which stance you are using (Blue = Fast 1, Cyan = Fast 2, Yellow = Medium 1, Silver/Staff = Medium 2, Green/Duals = Medium 2, Red = Strong 1, Purple = Strong 2.
The glow increases when you stack AP, or attack power. Every time you score a body hit you'll gain it...