The manual on the download is for an earlier board with no on-board voltage regulator. Your board has one so the 5v supply should be 7.5-9v DC, and I can see its powered up OK because the LEDs are on.
What amperage output is your 12v adapter?
Are you sure your motor wiring is correct one phase to A/A- and the other to B/B- and not cross-wired - its hard to tell from the pics because you used one colour for all wires.
If you're in Europe why not come and visit the UK CNC Community at http://www.mycncuk.com