I found a good solution to this problem, so I am sharing it here in case it's useful for others.
I switched from using 1.6mm brake cable to 2mm brake cable because I prefer it, and the cable end fits properly in the brake lever.
These are the components I used. Mostly from Venhill UK , who...