After a bit of testing, I got Goemon's Great Adventure to work. I didn't have to use a save state at all. All I had to do was disable Dynamic Recompilation and it plays fine. You can enable every other setting except Dynamic Recompilation. I updated it on the compatibility list as well.
.:Screenshots:.