The whole point of this scene is Don is literally terrified of being replaced and made irrelevant. It’s why he forgot the dudes work in the cab and after exiting the elevator has a look of fear smeared across his face.