It is technically a no-biggie to swap them. The current implementation is based on consistency considerations – in other parts of the UI you use the sigle click to command low values and double click to enter high value (as tens, etc.).
Otoh this is a theoretical approach, and practical experience may be different. So I am very open to hear what other users think about this proposal.