The issue is probably either flex in the braking system, or poor friction.
To check the flex, pull the levers really hard, and observe what happens to the cable housing, at the cable stop, the brake arms, and the fork arms. If there's something flexing, that's limiting the force at the rim. If...