msrconnections / azure-training-course Goto Github PK

currently there is the link on step 4 - but would be good to have link on Step 1.
Same goes for Visual Studio link - http://www.microsoft.com/vstudio

Please change screenshots. (multiple) Text has been changed already.

lab 1 should be demoed, but doing the lab should be optional.

Minor consistency issue.

© 2013 Microsoft Corporation. All rights reserved.
Except where otherwise noted, content on this site is licensed under a Creative Commons Attribution-NonCommercial 3.0 License.

In the Choose a storage account page, we can set the Image Region and Storage Account in image region. You can also create a new storage account or choose an existing one.

add Note below the paragraph.

Deliver a revised agenda for future training

In slide 9 "Pay only for what is used", it should be:

• For Cloud Services and Web Site, pay by the hour
• For Virtual Machines, pay by the minute

(check first paragraph of pricing details here: http://www.windowsazure.com/en-us/pricing/details/virtual-machines)

There are some labs/demos that have the "East Asia" region either in the script itself, in the step text, or in the screenshot. The region should be taken out of any part of the content and replaced with a request to choose the region closest to the location of the training facility (best if the trainer instructs which region to choose).

suggest default client.

Also copy paste files into RDP sessions don't work for Linux & Mac.

Look out for RDP ports being blocked at training site.

FileZilla won’t install on my Server 2012 OS, ( must be connected to the internet error ) – might be a MS internal security issue. I installed a different ftp client instead, http://www.coffeecup.com/free-ftp/

need deck on patterns and scenarios 2nd day.

Update picture in:
Initial Steps
Login to Windows Azure Management Portal

As an instructor ( or student ) there is nothing in the documentation that sets the context of the exercises. That is, why are we using the Django to do this? What is Django?

I personally have 0 knowledge of Django & even though I got through the exercises and everything works I still really don't know what Django brings to the table. What does it actually do? Could this be done easier some other way? ( etc etc )

remove or re-write

I couldn't easily figure out how to get the python sample to work after decomppressing the Django gz & tar file.

I found a decent set of instructions at: http://www.djangoapp.com/blog/2008/11/18/installing-django-on-windows/

This might be useful if people are having trouble installing

Need to add layerscape slides to the excel deck.

Getting kafka deployed with working server.

Current text :
Open the web site Dashboard
page and click the Reset deployment credentials link. Provide a new password and click Ok.

Corrected text:
Open the web site Dashboard
page and click the Set up deployment credentials link. Provide a new password and click Ok.

The "quick glance" image also needs to be updated:

in HPC matlab demoscript, we are running into two issues: env vars that uses _ such as ccp_package_root and file names such as run_sweep.bat These files don't show up properly as underscore actually means emphasis. Need to either rename the files, or escape them using \

WATK:
http://www.windowsazure.com/en-us/develop/net/other-resources/training-kit/ 

Arkady’s kit too:
http://www.facultyresourcecenter.com/curriculum/resourcekits/cloudv3/index.aspx
http://www.microsoft.com/education/facultyconnection/WinAzure.aspx

Pointer to curriculum-building based on the above - encourage this for faculty.

When we execute the R bnames demo, the sweep script runs an R script that installs the plyr and ggplot2 packages. However these packages are not getting installed on the headnode, because it doesn't run any parametric sweep tasks (when you create an HPC VM in Azure, the head node itself is offline, so it doesn't run any tasks).
Therefore, when we run the post processing script that requires plyr and ggplot2, the R script fails.
I think this did not show up during the demo creation because as I see in the screenshots, the head node was online, and therefore probably participated in the sweep job and installed the missing packages.

To resolve this issue we need to add the following line at the top of the post processing R script:
install.packages(c("plyr", "ggplot2"), repos=c("http://cran.wustl.edu", "http://cran.us.r-project.org"))

(under Day 2\3. Windows HPC Server 2012 Cluster\4. hpc-R-sweep-optional)

Please add a few more slides explaining cloud services. Make appropriate changes below. (clarify instructions).

 In case we keep using the existing lab:
• In Exercise 2, step 3, all attendees use the same name format for the job ("TEST ()"). It is very hard to identify which attendee started which job. The step should include an instruction to add the name of the attendee to the string, so they can identify their own jobs.
• In Exercise 3, they are asked to write code that retrieves messages from the queue, and then create two tasks so their code will handle one of them. In reality, the BLAST worker role handles the tasks quite fast, so they usually should create three-five tasks to see their code pull the message from the queue. In addition, the instruction should be more clear, because clicking "New Task" opens a dialog that needs to be filled, so they can't just click it twice.
• Day 2

When you add this kind of script to the startup script:
.\install.bat

The execution will stop after the install.bat completes. If this is the last command in the script that is ok, but if you do the matlab demo and then the python/R demo, then the python and R won't be installed and the demo will fail.

In both demos, the command should be:
call .\install.bat
(when using call, the bat will execute and then the startup script will continue running)

Please get the copyright/license materials for us.

Consider redacting the (apparently) valid Bing Maps key included in: https://github.com/MSRConnections/Azure-training-course/blob/master/Day%201/2.%20HOL%20WindowsAzure%20Web%20Sites/Source/Exercise02/DjangoApplication/DjangoApplication/templates/earthquake.html

1. Fix contents issue for virtual machine.
2. fix command line in virtual machine hol to download files with pscp.
   4, refine the software to install list.
   5, add HDInsight powershell script.

• Rename to "Course agenda" so it doesn't look like we're revising things per se.
• Update numbering of the agenda items to match exactly the numbering of the course module folders - both in table and body.

needs to be added to the demo script in "powermap" with screenshots. and Email me the docx file.

• The GA of HDInsight caused the .NET Map/Reduce demo to stop working. We really need to correct the demo in regards to the NuGet package versions and the correct addressed (I have a working example that I can send).
• I added Hive examples based on Wenming's car stats analysis and the Hive tutorial in the Windows Azure website.
• I added a Mahout example based on Wenming's recommender job demo. However the recommender job takes a lot of time to execute, so it's better to run it ahead of time, and only show the results.
 Lab
• There were a few issues that prevented some attendees from running the lab
o The prerequisites specify you can use Windows 7, but I encountered more than one attendee that couldn't use their Windows 7 because it had PowerShell 2 (Windows 8 has PowerShell 3), and it did not support the HDInsight cmdlets. This should be verified.
o HDInsight is not available on all regions. Attendees that already had two storage accounts in other regions were not able to perform the lab (they didn't want to remove any of the storage accounts, because that would require them to delete some of the VMs)
o The Powershell cmdlets require a Windows machine, and most attendees did not have one. We suggested they use the Windows Server VM from day 1.
o In the WordCount sample, step 5 is incorrect. The "powershell" command should be removed from the beginning of the command text.
o Regarding exercise 4, although it is very useful to try out PowerQuery, you should take into account that most attendees do not have Windows (and therefore no Office). In addition, I suggest placing a link to the PowerQuery download page instead of having people searching for it.

The Django install points to a gz file that contains a tar file. Windows needs a tool to decompress these files. One good tool is 7-zip, http://7-zip.org/ This should be added to the list of tools to install.

I know the immediate answer is - they already have a Windows VM they created in the previous lab, but it would be nice to give them another option of accessing azure storage from their own machines.
I've looked around and haven't found any desktop app for Linux. However, I did find this nice website (https://zud.io/) which provides storage access with a cool looking UI.
Only downside is that it's a 30-day trial, but for the course, that should be enough.

Maybe we should add this as an option in the lab for Linux users.

Complete demo script including:

word count sample:
http://www.windowsazure.com/en-us/manage/services/hdinsight/interactive-javascript-and-hive-consoles/

Hive Sample:
https://github.com/wenming/BigDataSamples/tree/master/carstatsanalysis

Machine learning Mahout:
http://www.windowsazure.com/en-us/manage/services/hdinsight/recommendation-engine-using-mahout/
https://github.com/wenming/BigDataSamples/tree/master/mahout

Ref: Azure still lives in the dual world of supporting liveId and OrgId. So whenever I am at home, I have to run Azure portal in InPrivate window otherwise my personal Azure login and my company Azure login always gets confused.

remove the bandwidth information add A6,A7 machine.

need to fix deck

Tried to run today the Hadoop demo with the countries console app, as specified in the demo steps, but the client crashes saying its missing an assembly.
The information is described here (similar case):
http://social.msdn.microsoft.com/Forums/windowsazure/en-US/09009f0e-aa57-4860-a563-f5d736b11f09/error-when-running-c-map-reduce-code-for-hdinsight-standalone?forum=hdinsight

There is an issue with the current version of the NuGet package. The demo instruction should be changed to use a specific version.

[Ignore the bizarre formatting shown in Git]

Ref email for details/context: Sent Wed 11/20/2013 5:39 AM

For general release we will move over completely to Apache 2.0 for consistency with WATK.

Global change requested:

From:

© 2013 Microsoft Corporation. Except where otherwise noted, content on this site is licensed under a Creative Commons Attribution-NonCommercial 3.0 License.

To:

Copyright 2013 Microsoft Corporation. All rights reserved.
Except where otherwise noted, these materials are licensed under the terms of the Apache License, Version 2.0. You may use it according to the license as is most appropriate for your project on a case-by-case basis. The terms of this license can be found in http://www.apache.org/licenses/LICENSE-2.0.

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS per the terms of the Apache 2.0 License. See the License for the specific language governing permissions and limitations under the License.

Note: the second paragraph “Unless required…” can be omitted if the item is not software – so PPTs, DOCs, etc. don’t really need it, but sample code does. If it is easier to do a global replace though, then it is fine to include it at the small expense of the longer amount of text even in documents.

please test today :)

IPython IpEngine may not be installed/started when more than a couple of nodes are deployed. work around: run python main.py deploy again.

Got some errors configuring this lab. Not sure whether the errors are fatal or even consequential, but they were surprising. The image created from quick create using Ubuntu Server 13.10:

azureuser@pycluster0:/azure-sdk-for-python$ cat /etc/lsb-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=13.10
DISTRIB_CODENAME=saucy
DISTRIB_DESCRIPTION="Ubuntu 13.10"
azureuser@pycluster0:/azure-sdk-for-python$

Here is trace of session in ubuntu:

login as: azureuser
[email protected]'s password:

The programs included with the Ubuntu system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Ubuntu comes with ABSOLUTELY NO WARRANTY, to the extent permitted by
applicable law.

azureuser@pycluster0:$ pwd
/home/azureuser
azureuser@pycluster0:$ ls -a
. .. .bash_logout .bashrc .cache .profile .ssh

azureuser@pycluster0:~$ sudo apt-get install git
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following extra packages will be installed:
git-man liberror-perl
Suggested packages:
git-daemon-run git-daemon-sysvinit git-doc git-el git-email git-gui gitk
gitweb git-arch git-bzr git-cvs git-svn
The following NEW packages will be installed:
git git-man liberror-perl
0 upgraded, 3 newly installed, 0 to remove and 0 not upgraded.
Need to get 8,729 kB of archives.
After this operation, 19.7 MB of additional disk space will be used.
Do you want to continue [Y/n]?
Get:1 http://azure.archive.ubuntu.com/ubuntu/ saucy/main liberror-perl all 0.17-1 [23.8 kB]
Get:2 http://azure.archive.ubuntu.com/ubuntu/ saucy/main git-man all 1:1.8.3.2-1 [670 kB]
Get:3 http://azure.archive.ubuntu.com/ubuntu/ saucy/main git amd64 1:1.8.3.2-1 [8,035 kB]
Fetched 8,729 kB in 6s (1,402 kB/s)
Selecting previously unselected package liberror-perl.
(Reading database ... 58206 files and directories currently installed.)
Unpacking liberror-perl (from .../liberror-perl_0.17-1_all.deb) ...
Selecting previously unselected package git-man.
Unpacking git-man (from .../git-man_1%3a1.8.3.2-1_all.deb) ...
Selecting previously unselected package git.
Unpacking git (from .../git_1%3a1.8.3.2-1_amd64.deb) ...
Processing triggers for man-db ...
Setting up liberror-perl (0.17-1) ...
Setting up git-man (1:1.8.3.2-1) ...
Setting up git (1:1.8.3.2-1) ...

azureuser@pycluster0:~$ sudo apt-get install python-setuptools
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following NEW packages will be installed:
python-setuptools
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 455 kB of archives.
After this operation, 1,147 kB of additional disk space will be used.
Get:1 http://azure.archive.ubuntu.com/ubuntu/ saucy/main python-setuptools all 0.6.37-1ubuntu1 [455 kB]
Fetched 455 kB in 1s (336 kB/s)
Selecting previously unselected package python-setuptools.
(Reading database ... 58973 files and directories currently installed.)
Unpacking python-setuptools (from .../python-setuptools_0.6.37-1ubuntu1_all.deb) ...
Setting up python-setuptools (0.6.37-1ubuntu1) ...

azureuser@pycluster0:$ git clone https://github.com/WindowsAzure/azure-sdk-for-python.git
Cloning into 'azure-sdk-for-python'...
remote: Reusing existing pack: 963, done.
remote: Total 963 (delta 0), reused 0 (delta 0)
Receiving objects: 100% (963/963), 3.56 MiB | 5.64 MiB/s, done.
Resolving deltas: 100% (568/568), done.
Checking connectivity... done
azureuser@pycluster0:$ ls
azure-sdk-for-python
azureuser@pycluster0:$ cd
azureuser@pycluster0:$ cd ./azure-sdk-for-python/
azureuser@pycluster0:/azure-sdk-for-python$ cd src
-bash: cd: src: No such file or directory
azureuser@pycluster0:/azure-sdk-for-python$ ls
azure azure.sln ChangeLog.txt LICENSE.txt README.md setup.py tests
azureuser@pycluster0:/azure-sdk-for-python$ cd azure
azureuser@pycluster0:/azure-sdk-for-python/azure$ ls
azure.pyproj http init.py servicebus servicemanagement storage
azureuser@pycluster0:/azure-sdk-for-python/azure$ cd ..
azureuser@pycluster0:/azure-sdk-for-python$ ls
azure azure.sln ChangeLog.txt LICENSE.txt README.md setup.py tests

azureuser@pycluster0:~/azure-sdk-for-python$ sudo python setup.py install
running install
running build
running build_py
creating build
creating build/lib.linux-x86_64-2.7
creating build/lib.linux-x86_64-2.7/azure
copying azure/init.py -> build/lib.linux-x86_64-2.7/azure
creating build/lib.linux-x86_64-2.7/azure/http
copying azure/http/winhttp.py -> build/lib.linux-x86_64-2.7/azure/http
copying azure/http/httpclient.py -> build/lib.linux-x86_64-2.7/azure/http
copying azure/http/batchclient.py -> build/lib.linux-x86_64-2.7/azure/http
copying azure/http/init.py -> build/lib.linux-x86_64-2.7/azure/http
creating build/lib.linux-x86_64-2.7/azure/servicebus
copying azure/servicebus/servicebusservice.py -> build/lib.linux-x86_64-2.7/azure/servicebus
copying azure/servicebus/init.py -> build/lib.linux-x86_64-2.7/azure/servicebus
creating build/lib.linux-x86_64-2.7/azure/storage
copying azure/storage/sharedaccesssignature.py -> build/lib.linux-x86_64-2.7/azure/storage
copying azure/storage/storageclient.py -> build/lib.linux-x86_64-2.7/azure/storage
copying azure/storage/cloudstorageaccount.py -> build/lib.linux-x86_64-2.7/azure/storage
copying azure/storage/blobservice.py -> build/lib.linux-x86_64-2.7/azure/storage
copying azure/storage/queueservice.py -> build/lib.linux-x86_64-2.7/azure/storage
copying azure/storage/tableservice.py -> build/lib.linux-x86_64-2.7/azure/storage
copying azure/storage/init.py -> build/lib.linux-x86_64-2.7/azure/storage
creating build/lib.linux-x86_64-2.7/azure/servicemanagement
copying azure/servicemanagement/servicemanagementservice.py -> build/lib.linux-x86_64-2.7/azure/servicemanagement
copying azure/servicemanagement/init.py -> build/lib.linux-x86_64-2.7/azure/servicemanagement
copying azure/servicemanagement/servicemanagementclient.py -> build/lib.linux-x86_64-2.7/azure/servicemanagement
copying azure/servicemanagement/servicebusmanagementservice.py -> build/lib.linux-x86_64-2.7/azure/servicemanagement
running install_lib
creating /usr/local/lib/python2.7/dist-packages/azure
creating /usr/local/lib/python2.7/dist-packages/azure/http
copying build/lib.linux-x86_64-2.7/azure/http/winhttp.py -> /usr/local/lib/python2.7/dist-packages/azure/http
copying build/lib.linux-x86_64-2.7/azure/http/httpclient.py -> /usr/local/lib/python2.7/dist-packages/azure/http
copying build/lib.linux-x86_64-2.7/azure/http/batchclient.py -> /usr/local/lib/python2.7/dist-packages/azure/http
copying build/lib.linux-x86_64-2.7/azure/http/init.py -> /usr/local/lib/python2.7/dist-packages/azure/http
creating /usr/local/lib/python2.7/dist-packages/azure/servicemanagement
copying build/lib.linux-x86_64-2.7/azure/servicemanagement/servicemanagementservice.py -> /usr/local/lib/python2.7/dist-packages/azure/servicemanagement
copying build/lib.linux-x86_64-2.7/azure/servicemanagement/init.py -> /usr/local/lib/python2.7/dist-packages/azure/servicemanagement
copying build/lib.linux-x86_64-2.7/azure/servicemanagement/servicemanagementclient.py -> /usr/local/lib/python2.7/dist-packages/azure/servicemanagement
copying build/lib.linux-x86_64-2.7/azure/servicemanagement/servicebusmanagementservice.py -> /usr/local/lib/python2.7/dist-packages/azure/servicemanagement
creating /usr/local/lib/python2.7/dist-packages/azure/servicebus
copying build/lib.linux-x86_64-2.7/azure/servicebus/servicebusservice.py -> /usr/local/lib/python2.7/dist-packages/azure/servicebus
copying build/lib.linux-x86_64-2.7/azure/servicebus/init.py -> /usr/local/lib/python2.7/dist-packages/azure/servicebus
copying build/lib.linux-x86_64-2.7/azure/init.py -> /usr/local/lib/python2.7/dist-packages/azure
creating /usr/local/lib/python2.7/dist-packages/azure/storage
copying build/lib.linux-x86_64-2.7/azure/storage/sharedaccesssignature.py -> /usr/local/lib/python2.7/dist-packages/azure/storage
copying build/lib.linux-x86_64-2.7/azure/storage/storageclient.py -> /usr/local/lib/python2.7/dist-packages/azure/storage
copying build/lib.linux-x86_64-2.7/azure/storage/cloudstorageaccount.py -> /usr/local/lib/python2.7/dist-packages/azure/storage
copying build/lib.linux-x86_64-2.7/azure/storage/blobservice.py -> /usr/local/lib/python2.7/dist-packages/azure/storage
copying build/lib.linux-x86_64-2.7/azure/storage/queueservice.py -> /usr/local/lib/python2.7/dist-packages/azure/storage
copying build/lib.linux-x86_64-2.7/azure/storage/tableservice.py -> /usr/local/lib/python2.7/dist-packages/azure/storage
copying build/lib.linux-x86_64-2.7/azure/storage/init.py -> /usr/local/lib/python2.7/dist-packages/azure/storage
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/http/winhttp.py to winhttp.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/http/httpclient.py to httpclient.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/http/batchclient.py to batchclient.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/http/init.py to init.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/servicemanagement/servicemanagementservice.py to servicemanagementservice.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/servicemanagement/init.py to init.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/servicemanagement/servicemanagementclient.py to servicemanagementclient.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/servicemanagement/servicebusmanagementservice.py to servicebusmanagementservice.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/servicebus/servicebusservice.py to servicebusservice.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/servicebus/init.py to init.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/init.py to init.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/storage/sharedaccesssignature.py to sharedaccesssignature.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/storage/storageclient.py to storageclient.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/storage/cloudstorageaccount.py to cloudstorageaccount.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/storage/blobservice.py to blobservice.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/storage/queueservice.py to queueservice.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/storage/tableservice.py to tableservice.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/azure/storage/init.py to init.pyc
running install_egg_info
Writing /usr/local/lib/python2.7/dist-packages/azure-0.8.0pr2.egg-info

azureuser@pycluster0:~/azure-sdk-for-python$ sudo easy_install workerpool
Searching for workerpool
Reading http://pypi.python.org/simple/workerpool/
Best match: workerpool 0.9.2
Downloading https://pypi.python.org/packages/source/w/workerpool/workerpool-0.9.2.tar.gz#md5=42904070f1a58f2a7b7276b22134375b
Processing workerpool-0.9.2.tar.gz
Writing /tmp/easy_install-Uv71Ar/workerpool-0.9.2/setup.cfg
Running workerpool-0.9.2/setup.py -q bdist_egg --dist-dir /tmp/easy_install-Uv71Ar/workerpool-0.9.2/egg-dist-tmp-kfIVIU
Adding workerpool 0.9.2 to easy-install.pth file

Installed /usr/local/lib/python2.7/dist-packages/workerpool-0.9.2-py2.7.egg
Processing dependencies for workerpool
Finished processing dependencies for workerpool

azureuser@pycluster0:~/azure-sdk-for-python$ sudo easy_install paramiko
Searching for paramiko
Reading http://pypi.python.org/simple/paramiko/
Best match: paramiko 1.13.0
Downloading https://pypi.python.org/packages/source/p/paramiko/paramiko-1.13.0.tar.gz#md5=acc53ee396dd907220a4141e118a845d
Processing paramiko-1.13.0.tar.gz
Writing /tmp/easy_install-LCvQSZ/paramiko-1.13.0/setup.cfg
Running paramiko-1.13.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-LCvQSZ/paramiko-1.13.0/egg-dist-tmp-3Xh7YB
zip_safe flag not set; analyzing archive contents...
Adding paramiko 1.13.0 to easy-install.pth file

Installed /usr/local/lib/python2.7/dist-packages/paramiko-1.13.0-py2.7.egg
Processing dependencies for paramiko
Searching for ecdsa
Reading http://pypi.python.org/simple/ecdsa/
Best match: ecdsa 0.11
Downloading https://pypi.python.org/packages/source/e/ecdsa/ecdsa-0.11.tar.gz#md5=8ef586fe4dbb156697d756900cb41d7c
Processing ecdsa-0.11.tar.gz
Writing /tmp/easy_install-At4nYo/ecdsa-0.11/setup.cfg
Running ecdsa-0.11/setup.py -q bdist_egg --dist-dir /tmp/easy_install-At4nYo/ecdsa-0.11/egg-dist-tmp-km_GF7
zip_safe flag not set; analyzing archive contents...
Adding ecdsa 0.11 to easy-install.pth file

Installed /usr/local/lib/python2.7/dist-packages/ecdsa-0.11-py2.7.egg
Searching for pycrypto>=2.1,!=2.4
Reading http://pypi.python.org/simple/pycrypto/
Best match: pycrypto 2.6.1
Downloading https://pypi.python.org/packages/source/p/pycrypto/pycrypto-2.6.1.tar.gz#md5=55a61a054aa66812daf5161a0d5d7eda
Processing pycrypto-2.6.1.tar.gz
Writing /tmp/easy_install-cQrrqE/pycrypto-2.6.1/setup.cfg
Running pycrypto-2.6.1/setup.py -q bdist_egg --dist-dir /tmp/easy_install-cQrrqE/pycrypto-2.6.1/egg-dist-tmp-IuDGsx
configure: error: in /tmp/easy_install-cQrrqE/pycrypto-2.6.1': configure: error: no acceptable C compiler found in $PATH Seeconfig.log' for more details
Traceback (most recent call last):
File "/usr/bin/easy_install", line 9, in
load_entry_point('distribute==0.6.37', 'console_scripts', 'easy_install')()
File "/usr/lib/python2.7/dist-packages/setuptools/command/easy_install.py", line 2002, in main
with_ei_usage(lambda:
File "/usr/lib/python2.7/dist-packages/setuptools/command/easy_install.py", line 1983, in with_ei_usage
return f()
File "/usr/lib/python2.7/dist-packages/setuptools/command/easy_install.py", line 2006, in
distclass=DistributionWithoutHelpCommands, **kw
File "/usr/lib/python2.7/distutils/core.py", line 152, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/usr/lib/python2.7/dist-packages/setuptools/command/easy_install.py", line 378, in run
self.easy_install(spec, not self.no_deps)
File "/usr/lib/python2.7/dist-packages/setuptools/command/easy_install.py", line 622, in easy_install
return self.install_item(spec, dist.location, tmpdir, deps)
File "/usr/lib/python2.7/dist-packages/setuptools/command/easy_install.py", line 654, in install_item
self.process_distribution(spec, dist, deps)
File "/usr/lib/python2.7/dist-packages/setuptools/command/easy_install.py", line 706, in process_distribution
[requirement], self.local_index, self.easy_install
File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 586, in resolve
dist = best[req.key] = env.best_match(req, self, installer)
File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 831, in best_match
return self.obtain(req, installer) # try and download/install
File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 843, in obtain
return installer(requirement)
File "/usr/lib/python2.7/dist-packages/setuptools/command/easy_install.py", line 622, in easy_install
return self.install_item(spec, dist.location, tmpdir, deps)
File "/usr/lib/python2.7/dist-packages/setuptools/command/easy_install.py", line 652, in install_item
dists = self.install_eggs(spec, download, tmpdir)
File "/usr/lib/python2.7/dist-packages/setuptools/command/easy_install.py", line 847, in install_eggs
return self.build_and_install(setup_script, setup_base)
File "/usr/lib/python2.7/dist-packages/setuptools/command/easy_install.py", line 1127, in build_and_install
self.run_setup(setup_script, setup_base, args)
File "/usr/lib/python2.7/dist-packages/setuptools/command/easy_install.py", line 1113, in run_setup
run_setup(setup_script, args)
File "/usr/lib/python2.7/dist-packages/setuptools/sandbox.py", line 33, in run_setup
lambda: execfile(
File "/usr/lib/python2.7/dist-packages/setuptools/sandbox.py", line 81, in run
return func()
File "/usr/lib/python2.7/dist-packages/setuptools/sandbox.py", line 35, in
{'file':setup_script, 'name':'main'}
File "setup.py", line 456, in

File "/usr/lib/python2.7/distutils/core.py", line 152, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/usr/lib/python2.7/dist-packages/setuptools/command/bdist_egg.py", line 179, in run
cmd = self.call_command('install_lib', warn_dir=0)
File "/usr/lib/python2.7/dist-packages/setuptools/command/bdist_egg.py", line 166, in call_command
self.run_command(cmdname)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/usr/lib/python2.7/dist-packages/setuptools/command/install_lib.py", line 20, in run
self.build()
File "/usr/lib/python2.7/distutils/command/install_lib.py", line 111, in build
self.run_command('build_ext')
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "setup.py", line 251, in run

File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "setup.py", line 278, in run

RuntimeError: autoconf error
azureuser@pycluster0:~/azure-sdk-for-python$

Additional Demos:

word count sample: http://www.windowsazure.com/en-us/manage/services/hdinsight/interactive-javascript-and-hive-consoles/

Hive Sample: https://github.com/wenming/BigDataSamples/tree/master/carstatsanalysis

Machine learning Mahout: http://www.windowsazure.com/en-us/manage/services/hdinsight/recommendation-engine-using-mahout/

https://github.com/wenming/BigDataSamples/tree/master/mahout