What about timer only starts when someone else attempts to talk to the same trader? Then if you're on your own, or the other people queueing are patient, you can take as long as you like. Someone else wants the same trader, they click, it tells them they are busy at the moment and starts the timer for the current barterer.