Leaders recognize ‘it’s all going to come crashing down’ without fairness in society, says Summers