(1) You can do some debugging via the DBGU serial port. It won't be more than serial data and a path to upload new code.
(2) The USB device port, sadly is not fully supported. The EK boards and almost all boards come with Linux on them and u-boot which does not support the USB device port. At least not yet. The USB Host Port is fully supported though, but not for debugging.
(3) The JTAG interface is the best way to go. You should be able to find a good solution without breaking the bank these days.
