As an old game with arcade roots, the oldschool button icons displayed on your screen would not correspond with the actual button layout on your keyboard or controller.
Please use the following controls for the actions below (listed for keyboard and controller, respectively):
Back to main menu: left bumper / ESC
Add credit: right bumper / space
Start: start / enter
Move: Either analog stick, d-pad / arrow keys
Shoot: A / Z