gbrueckl / azure.datafactory.localenvironment Goto Github PK

This code allows you to load any existing Azure Data Factory project file (*.dfproj) and perform further actions like "Export to ARM Template" or to debug custom C# activities

License: MIT License

C# 90.00% PowerShell 9.92% Batchfile 0.08%

azure-data-factory azure-arm arm-templates adf

azure.datafactory.localenvironment's Introduction

About Me

Gerhard has been implementing traditional BI and data warehouse solutions based on the Microsoft Data Platform for over 15 years with the personal focus on analytical databases. With the rise of "Cloud" and "Big Data" over the last years he also shifted his interests towards Microsoft Azure and Hadoop/Spark. A lot of his experience in BI and DWH he can still apply in this "new world" and use it to fight the masses of data he frequently encounters at his customers. Ever since he was working very close with the community for which he was got his MVP award in July 2016.

I am working at paiqo GmbH where we dedicated our efforts on building Analticaly Platforms and AI solutions on the Microsoft Azure Platform for and together with our customers all around the world. Whenever I encounter interesting stuff I usually blog about it at blog.gbrueckl.at.

My current focus here on github is building VSCode extensions for the tools I use an a daily basis which are foremost Microsoft Fabric and Power BI but also Databricks.

Power BI & Fabric for VSCode

A VSCode extension for managing your Power BI tenant using the Power BI REST API and modify Power BI datasets using TMDL (Tabular Model Definition Language) from within VSCode.

Databricks Power Tools for VSCode

This is a Visual Studio Code extension that allows you to work with Databricks locally from VSCode in an efficient way, having everything you need integrated into VS Code - see Features. It allows you to execute your notebooks, start/stop clusters, run jobs and much more!

How to reach Me

I do not want to share all my contact details here but if you are really interested in getting in touch with me, I am sure you will figure out how ;)

azure.datafactory.localenvironment's People

Contributors

Stargazers

Watchers

Forkers

slunyakin-zz xiaoyinglj-zz tameemansari spelluru almin-halilovic prashkdbg karthick9500 satheesh2k7 nk-gears kgoel89 bhanush3 fly2nadeem karthikmakam hpmarcaida bily1987 hero827

azure.datafactory.localenvironment's Issues

Cannot reference the dll

I downloaded the dll in Azure.DataFactory.LocalEnvironment/ADFLocalEnvironment/Download/gbrueckl.Azure.DataFactory.ADFLocalEnvironment.dll

But when I try to reference it from VS 2015 I get "A reference to the dll could not be added".

I also tried regsvr32 and dependency walker but both told me that is something wrong with the dll.

Publish as nuGet-Package

Publish the DLL as nuGet-Package for easier deployment

UnauthorizedAccessException when deleting dependencies

Receiving UnauthorizedAccessException on line 510 of ADFLocalEnvironment.cs when attempting to delete dependencies after executing the .NET activity

Putting a break point on the delete and attempting to delete the files manually from Windows shows that they are in use

Make Config-Files work with all Values

currently, values coming from a Config file only overwrite properties which have a value of "". This is not consistent with how ADF works.
ADFLocalEnvironment should replace all values defined in config files regardless of their original value

V2 support

Hello!

It seems the custom activity interface has changed substantially in data factory:
https://github.com/Azure/Azure-DataFactory/tree/main/SamplesV1/ADFv2CustomActivitySample

Do I still need this library?
Or is there something else we devs can use to debug?

Thanks!

Consider less restrictive license

Is the choice of GPLv3 intentional?
This license is too restrictive for consuming in some corporate environments (such as Microsoft).
A less restrictive license such as MIT License, Microsoft Public License or Apache License 2.0 will considerably simplify legal implications associated with GPLv3 and enable using this project (especially it only exists in source form and a nuget package is not yet available).

This then returns the correct path when stepping in via VS Test.