Hadoop demo not working due to breaking change in Hadoop Nuget for .NET about azure-training-course HOT 3 CLOSED

Another update - check this blog post:
http://blogs.msdn.com/b/data_otaku/archive/2013/11/02/hadoop-for-net-developers-working-with-hdinsight-on-azure-ga.aspx

Apparently we have to use the new NuGet package to support the new HDInsight GA. However, the new NuGet breaks because of missing assemblies and incorrect version checks.

I was able to eventually start the job, but the job fails, probably due to bad dlls in the execution folder.

I would recommend building a non-.NET sample for this demo

from azure-training-course.

I've managed to fix the hadoop sample for the new HDInsight (2.1).
First, you need to make sure you are targeting .NET Framework 4, not 4.5 (no 4.5 on the HDInsight cluster).
Second, you need to first manually install the Microsoft.AspNet.WebApi.Client NuGet from version 4.0.30506.0 (otherwise HDInsight NuGet installs version 5 which breaks the code).
Lastly, you need to manually copy the file Microsoft.WindowsAzure.Management.Framework.Threading.dll from the 0.9 version of the HDInsight NuGet to the MRLib folder and mark it to copy always.

Oh, and you need to remove the :563 port from the management URL (changed in v2.1).

Works well after that.

from azure-training-course.

Closing as ancient

from azure-training-course.