PowerToys with WindowWalker ( https://learn.microsoft.com/en-gb/windows/powertoys/run#wind... ) is what I do use a lot to search through windows - I have a lot of terminals open usually, could be like 30-40 spread across virtual desktops and searching one specific based on server name it's connected too saves me some time.
Back in a days when Virtual Desktops were not that handy (technically those available since win2000 if I recall correctly), I've used Blackbox for Windows and my own homemade program to quick search though all PuTTYs (written in VB6 + Winapi). Now I don't need it anymore :)
I can never remember the (easy) shortcuts so this is helpful: https://learn.microsoft.com/da-dk/windows/powertoys/shortcut...
From PowerToys: https://github.com/microsoft/PowerToys
(Which also have the (in this context) useful FancyZones)