Because Microsoft isn't some shitty open source outfit that can't be bothered with things like documentation, tutorials general support etc. there is a wealth of C# learning to be done straight from the source.
http://msdn.microsoft.com/en-us/vcsharp/default.aspx
Look at the left hand column.
You can even download a real IDE for free that has very few practical limitations for a beginner. They leave out shit like source control and remote debugging (local debugging is there still).
Also, if you want to make ASP.Net web apps, you will need to download the express version of that. And then be amazed at how shitty and worthless shit like PHP and Java are.