Brian and Vincent Wu have spent more than two decades building a fashion store chain that decidedly does not revolve around sales numbers.