Banks walk a tightrope with poorer clients