Scrambling, distortion, and true inner growth work