What does everyone have against 1 charisma? You already nerfed people with low CHA to hell. Remember we can't talk to traders, can't take quests for easy xp. We can't lead people, we can't get mercs, we can't slave.
What about other attributes at 1?
People with 1 luck should get a -20% to their hitchance modifier, why? because they are so unlucky.
People with 1 endurance shouldn't be able to run since endurance could be compared to stamina, and they don't have much of it.
People with 1 Pe should just get a negative bonus check agains't stealing, simply because they barely can see, feel, hear or smell things.
But those things aren't ingame, yet everyone with 1 cha gets massive negative effects trown at him. Give people with low Cha a break man.
Still not happy? Want a good solution? Here's one:
Add more quests for people with charisma, they need a minimal 4 charisma to do them. However the quests are easier and the rewards are better if the player Charisma is higher. (This is already the case with most quests anyway)
Give people who follow leaders with high charisma a combat bonus doesn't have to be big. This gives people a reason to have a character with 10 charisma.
Give People with a decent charisma AND speech a chance to talk their way out of a raider/bandit ambush, they aren't as tough as a pvper so give them a chance to solve things peacefully. (afcoarse this should give a xp reward)
The higher onces Charisma the cheaper mercs should be for that person.
There's a couple of suggestions that wouldn't be so negative for people with low CHA. And it gives people with higher charisma a good reason to actually have the charisma.