That’s what I’d prefer and that’s how they (seemingly) handled it with Jimbo Jones. Mo Collins replaced Pamela Hayden, he had a small but significant role in the episode with a handful of lines. Done & done.

Giving the new voice actor a single line as older Milhouse seems weird.

Ultimately it’s going to be fine, but just weird.