>If you modify your algorithm to only generate programs without any infinite loops, you've solved the halting problem, which is impossible.

Nonsense, there is no reason you cannot design an algorithm that uses a halting oracle. Running that algorithm may be difficult though.