Unable to run LightIngest in Azure DevOps PowerShell@2, AzureCLI@2 or script tasks

[miguelcrpinto]

Describe the bug I've been trying to run LightIngest in Azure DevOps to automate the reingestion of some data into ADX but for some reason, LightIngest doesn't seem to be able to execute in PowerShell@2, AzureCLI@2 or script tasks. Whenever I try to execute LightIngest, the only output that I get is "LightIngest invoked with the following arguments: ..." and nothing more. Eventually the DevOps task times out and nothing was ingested into ADX.

LightIngest runs fine in my powershell and command prompt terminals on my laptop with the same exact parameters.

Example of LightIngest usage that I've been trying: LightIngest "https://ingest-{ADXclusterName}.{AzureRegion}.kusto.windows.net/" -database:"{DatabaseName}" -table:"{TableName}" -source:"https://{storageAccountName}.blob.core.windows.net/{BlobContainerName}?{SASTokenWithListAndReadPermissions}" -format:"parquet" -prefix:"Samples/2024/06/06" -pattern:"*.parquet" -ingestionMappingRef:"Samples_mapping" -tag:"b43992aa-6b30-4149-832e-8c5c8e28dc5c" -creationTimePattern:"Samples/'yyyy/MM/dd'/sample-" -interactive:false -dontWait:true

A few more notes:

• If I run just LightIngest with no parameters I'm able to see the LightIngest "help".
• If I run LightIngest without the -interactive:false parameter, it doesn't show the "Please review the run parameters:" text (this could be explained by the fact that the Console.IsInputRedirected is true)
• I looked into the LightIngest source code and it seems that nothing is executed after the line "s_instance = new Program(args);" in Program.cs

Exception or Stack Trace N/A

To Reproduce Create a Pipeline in Azure DevOps with the following tasks:

` - task: UseDotNet@2 displayName: Install dotnet 6 SDK inputs: version: 6.x includePreviewVersions: false

• task: DotNetCoreCLI@2 displayName: 'Install LightIngest' inputs: command: custom custom: tool arguments: 'install -g Microsoft.Azure.Kusto.LightIngest'

• task: PowerShell@2 inputs: targetType: 'inline' script: | LightIngest "https://ingest-{ADXclusterName}.{AzureRegion}.kusto.windows.net/" -database:"{DatabaseName}" -table:"{TableName}" -source:"https://{storageAccountName}.blob.core.windows.net/{BlobContainerName}?{SASTokenWithListAndReadPermissions}" -format:"parquet" -prefix:"Samples/2024/06/06" -pattern:"*.parquet" -ingestionMappingRef:"Samples_mapping" -tag:"b43992aa-6b30-4149-832e-8c5c8e28dc5c" -creationTimePattern:"Samples/'yyyy/MM/dd'/sample-" -interactive:false -dontWait:true`

I tried this using both vmImage: ubuntu-latest and vmImage: windows-latest and the behavior is the same.

Expected behavior I'd expect LightIngest to behave and run normally in DevOps just like it does in a terminal

Screenshots Example of the output when running LightIngest as a script task. This is the output after the DevOps task timesout (after 60min). The same command took a few seconds to run in my terminal

Setup (please complete the following information):

• Azure DevOps
• LightIngest Version: 12.2.6
• Tool source: dotnet tool install

Additional context Add any other context about the problem here.

Information Checklist Kindly make sure that you have added all the following information above and checkoff the required fields otherwise we will treat the issuer as an incomplete report

• [x] Bug Description Added
• [x] Repro Steps Added
• [x] Setup Information Added

[miguelcrpinto]

I was able to reproduce this behavior in a VM. I'll investigate further and I'll update here.