azure / ace_azure_ml Goto Github PK

I am getting error while running cmd 15 in 05_structured_streaming Notebook

I failed to access the storage that data was stored.
Does anyone please confirm that SAS of Azure Blob storage is still working?

%fs ls /mnt/data/telemetry
[error msg]
shaded.databricks.org.apache.hadoop.fs.azure.AzureException: com.microsoft.azure.storage.StorageException: Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature.

Most of the links under Proposed three-day agenda are broken and giving 404 error

day 1
Machine Learning on Azure - Solution Brief (PPTX Presentation)
Introduction to Azure Databricks (Hands On)
Feature Engineering (Hands On)
Sentiment Analysis (Hands On)
Hyperparameter Tuning w/ Azure Databricks (Hands On)
Streaming on Azure Databricks (Hands On)
day 2
Logistic Regression w/ Spark ML (Hands On)
Random Forests w/ Spark ML (Hands On)
Integration of ADB and AML (PPTX Presentation)
Getting Started w/ AML service (Hands On)
AML Model Management and ML Experimentation (Hands On)
Automated ML (Hands On)
Real-time scoring w/ AKS, CI/CD and DevOps (PPTX Presentation)
day 3
Real-time scoring w/ AKS, CI/CD and DevOps (Hands On)
CI/CD and DevOps (Hands On)
Then continue with 5h on video anomaly detection

Link on bottom of this page: https://azure.github.io/LearnAI-CustomAI-Airlift/

"Part 1: Azure Databricks and its integration with Azure Machine Learning Services" is broken.

existing check for existing mount not the best and fails first time, something like this?
(ignoring the Exception and not reporting also particularly nasty to debug)

if os.path.exists('/dbfs/mnt/data/'):
print("Already mounted.")
else:
dbutils.fs.mount(
source = source,
mount_point = mount_point,
extra_configs = extra_configs)
print("Mounted: %s at %s" % (source, mount_point))

There are important files that Microsoft projects should all have that are not present in this repository. A pull request has been opened to add the missing file(s). When the pr is merged this issue will be closed automatically.

Microsoft teams can learn more about this effort and share feedback within the open source guidance available internally.

Merge this pull request

this col() code depends on an import that was not available yet, it should be instead:

from pyspark.sql.functions import col
display(telemetryDF.filter(col("volt") > 250).limit(10))

alternatively, DF column can also be referenced without pyspark using:

display(telemetryDF.filter(telemetryDF.volt > 250).limit(10))

would prefer to submit a pull request, but these notebooks are somehow baked inside a binary file we imported at the beginning of the lab
/presenter/notebooks.dbc

Pls guide me from where I can get the Data Files needed to complete the labs. Immediately looking for Day 1 data files.

This repository is currently missing a LICENSE.MD file outlining its license. A license helps users understand how to use your project in a compliant manner. You can find the standard MIT license text at the Microsoft repo templates LICENSE file: https://github.com/microsoft/repo-templates/blob/main/shared/LICENSE.
If you would like to learn more about open source licenses, please visit the document at https://aka.ms/license.

the mnt notebook runs successfully, from teh intor notebook, however when you det to the "%fs ls /mnt/data/telemetry" command it fails with the following error.

shaded.databricks.org.apache.hadoop.fs.azure.AzureException: com.microsoft.azure.storage.StorageException: Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature.