Welcome to the Universe of Open Source
>but I want in parallel to learning ARMs I also learn about linux.
>where should I begin?
You can get ample amount of info. about ARM just by googling ARM and the best way for learning Linux is to install one on the PC and start playing with it. I started learning Linux with Red Hat and it was nice experience (embedded linux is not much different from Desktop Linux).
For linux on ARM you can refer
http://www.arm.linux.org.uk/
For linux on Atmel AT91 controllers
http://www.linux4sam.org/twiki/bin/view/Linux4SAM/WebHome
>I have heard that if I expect full functional linux I have to use a MCU that supports MMU like ARM9.
There is a Linux specifically for MMU less processors like m68k etc.
http://www.uclinux.org/
There is a sofware emulator called Armulator that emulates ARM on your PC
you can even run uClinux on it without the need for any real ARM hardware
Check the uClinux site for it.
Regards,
Devendra