You can study in the UK while on a spousal visa, but until you have lived in the UK for three years, you must pay the international student tuition fees.

When you do have ILR, you are eligible for the UK student loans to cover your tuition, for full and part-time studies.

http://www.ukcisa.org.uk/International-Students/Fees--finance/Home-or-Ov...