Gents, looking for a good rec for a retro gaming console

I believe they all run up to PS1 tech, correct? I just recently destroyed one by just taking out the SD card (I fukked up the controller settings and couldnt get back to it)- it was a Super X console pro or some chit like that.. which is basically now just a paperweight raspberry pi sitting around with some media OS on it.

Do they all come with the janky PS2 controllers? I want something that has all retro games and works decent.. is that too hard to find?
(Final fantasy's, NHL 94+, Madden, Racing games, etc.. You know)

Do they even have PS2 emulators like that? I remember I ran one from my PC but that was it. You'd think todays tech might be able to handle that via a handheld PC stick?

ISO recs