For example you have tagged outdoorsman, or thief or whatever and on level up you take perk which raises your tagged skill, and i think the if for example that perk raises your thief skill by 10%, then on tagged skill your thief will be raised by 20%. Thats why you tagged that skill after all. So my suggestion is to double up bonuses given from perks on your tagged skills. How do you like that?