Update build-data-pipeline.md to remove unavailable extension#14240
Update build-data-pipeline.md to remove unavailable extension#14240akoppanur wants to merge 2 commits intoMicrosoftDocs:mainfrom
Conversation
DevOps for Azure Databricks extension is no longer available. Here is the pipeline yml file that refers to the unavailable extension: https://github.com/MicrosoftDocs/azure-devops-docs-samples/blob/main/azure-data-pipeline/data_pipeline_ci_cd.yml Customers have reported this issue and requested alternate methods. See here: microsoft/azdo-databricks#43 This documentation needs to be updated to provide our own custom script for deployment to Azure Databricks and ADF or documentation to be removed. There is an alternate third-party extension: https://marketplace.visualstudio.com/items?itemName=DataThirstLtd.databricksDeployScriptsTasks
|
@akoppanur : Thanks for your contribution! The author(s) have been notified to review your proposed change. |
|
Can you review the proposed changes? IMPORTANT: When the changes are ready for publication, adding a #label:"aq-pr-triaged" |
|
@juliakm - Could you review this proposed update to your article and enter Thanks! |
|
#assign-reviewer:ramiMSFT |
|
#reassign:ramiMSFT |
|
@akoppanur : Thanks for your contribution! The author(s) and reviewer(s) have been notified to review your proposed change. |
|
@ramiMSFT Can you review this old PR and determine whether it needs to be closed or merged? IMPORTANT: When the changes are ready for publication, add a @MicrosoftDocs/public-repo-pr-review-team |
There was a problem hiding this comment.
Pull request overview
This PR updates the “Build a data pipeline” documentation to address that the referenced “DevOps for Azure Databricks” Azure DevOps marketplace extension is no longer available, and points readers to related context/alternatives.
Changes:
- Added a note in the prerequisites section calling out that the Databricks DevOps extension is unavailable.
- Added links to the sample pipeline YAML that references the extension and to a third-party alternative.
| - Access to the [data pipeline solution](https://github.com/MicrosoftDocs/azure-devops-docs-samples/tree/main/azure-data-pipeline) in GitHub. | ||
| - [DevOps for Azure Databricks](https://marketplace.visualstudio.com/items?itemName=riserrad.azdo-databricks). | ||
|
|
||
| > DevOps for Azure Databricks extension is no longer available. Here is the pipeline yml file that referes to the unavailable extension: | ||
| > https://github.com/MicrosoftDocs/azure-devops-docs-samples/blob/main/azure-data-pipeline/data_pipeline_ci_cd.yml | ||
| > Customer's have reported this issue and requested alternate methods. See here: https://github.com/microsoft/azdo-databricks/pull/43 |
There was a problem hiding this comment.
The prerequisites still list the “DevOps for Azure Databricks” marketplace extension as required, but the new note says it’s no longer available. This is contradictory for readers; please either remove this prerequisite entirely or replace it with supported steps (and update the rest of the article/pipeline guidance accordingly).
| > DevOps for Azure Databricks extension is no longer available. Here is the pipeline yml file that referes to the unavailable extension: | ||
| > https://github.com/MicrosoftDocs/azure-devops-docs-samples/blob/main/azure-data-pipeline/data_pipeline_ci_cd.yml | ||
| > Customer's have reported this issue and requested alternate methods. See here: https://github.com/microsoft/azdo-databricks/pull/43 | ||
| > This documentation needs to be updated to provide our own custom script for deployment to Azure Databricks and ADF or documentation to be removed. | ||
| > There is an alternate third-party extension: | ||
| > https://marketplace.visualstudio.com/items?itemName=DataThirstLtd.databricksDeployScriptsTasks |
There was a problem hiding this comment.
This blockquote reads like internal PR/triage notes (“customers have reported…”, “this documentation needs to be updated…”). For published docs, please rewrite this as a user-facing admonition (for example, a [!NOTE]/[!IMPORTANT] callout) that clearly states what readers should do now (supported alternative) rather than describing what maintainers need to do.
| > DevOps for Azure Databricks extension is no longer available. Here is the pipeline yml file that referes to the unavailable extension: | |
| > https://github.com/MicrosoftDocs/azure-devops-docs-samples/blob/main/azure-data-pipeline/data_pipeline_ci_cd.yml | |
| > Customer's have reported this issue and requested alternate methods. See here: https://github.com/microsoft/azdo-databricks/pull/43 | |
| > This documentation needs to be updated to provide our own custom script for deployment to Azure Databricks and ADF or documentation to be removed. | |
| > There is an alternate third-party extension: | |
| > https://marketplace.visualstudio.com/items?itemName=DataThirstLtd.databricksDeployScriptsTasks | |
| > [!IMPORTANT] | |
| > The DevOps for Azure Databricks extension is no longer available. The sample pipeline YAML file, [data_pipeline_ci_cd.yml](https://github.com/MicrosoftDocs/azure-devops-docs-samples/blob/main/azure-data-pipeline/data_pipeline_ci_cd.yml), still references this extension and won't work as written. | |
| > | |
| > To use this sample, update the pipeline to deploy Azure Databricks and Azure Data Factory by using your own scripts or tasks instead of the unavailable extension. You can also evaluate a third-party alternative, such as [Databricks Deploy Scripts Tasks](https://marketplace.visualstudio.com/items?itemName=DataThirstLtd.databricksDeployScriptsTasks), if it meets your requirements. |
| > https://github.com/MicrosoftDocs/azure-devops-docs-samples/blob/main/azure-data-pipeline/data_pipeline_ci_cd.yml | ||
| > Customer's have reported this issue and requested alternate methods. See here: https://github.com/microsoft/azdo-databricks/pull/43 | ||
| > This documentation needs to be updated to provide our own custom script for deployment to Azure Databricks and ADF or documentation to be removed. | ||
| > There is an alternate third-party extension: |
There was a problem hiding this comment.
This introduces a third-party extension link without the disclaimer used elsewhere in this repo when recommending external tools. Consider adding an [!IMPORTANT] disclaimer that Microsoft doesn’t endorse/support third-party extensions (see docs/repos/git/import-from-TFVC.md:69-71 for the standard wording).
| > There is an alternate third-party extension: | |
| > | |
| > [!IMPORTANT] | |
| > Microsoft does not support or endorse third-party extensions. There is an alternate third-party extension: |
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
DevOps for Azure Databricks extension is no longer available. Here is the pipeline yml file that refers to the unavailable extension:
https://github.com/MicrosoftDocs/azure-devops-docs-samples/blob/main/azure-data-pipeline/data_pipeline_ci_cd.yml
Customers have reported this issue and requested alternate methods. See here: microsoft/azdo-databricks#43 This documentation needs to be updated to provide our own custom script for deployment to Azure Databricks and ADF or documentation to be removed.
There is an alternate third-party extension:
https://marketplace.visualstudio.com/items?itemName=DataThirstLtd.databricksDeployScriptsTasks