Ok but photons don’t change direction either. Treating photon scattering as an individual particle accelerating due to an applied force, well that’s just not a correct description of how perturbative QED models photon interactions.