question

VictorFragoso-6349 avatar image
1 Vote"
VictorFragoso-6349 asked AbdulRahimAmjad-7260 answered

AzureML Error on Linux: "Unable to retrieve .NET dependencies. Please make sure you are connected ..."

I am getting this error on a Linux box (Gentoo w/ .NET via Mono properly installed)

"Unable to retrieve .NET dependencies. Please make sure you are connected to the Internet and have a stable network connection."

The error is triggered when creating a dataset from a directory using

"dataset = Dataset.File.from_files(path=(datastore, path_to_dataset_in_datastore))"

Some system info:
Python: 3.8.8.
azureml-automl-core 1.26.0
azureml-core 1.26.0
azureml-dataprep 2.13.2
azureml-dataprep-native 32.0.0
azureml-dataprep-rslex 1.11.2
azureml-dataset-runtime 1.26.0
azureml-pipeline 1.26.0
azureml-pipeline-core 1.26.0
azureml-pipeline-steps 1.26.0
azureml-sdk 1.26.0
azureml-telemetry 1.26.0
azureml-train 1.26.0
azureml-train-automl-client 1.26.0
azureml-train-core 1.26.0
azureml-train-restclients-hyperdrive 1.26.0

.NET Info:
Mono JIT compiler version 6.6.0.161 (tarball Sat Apr 10 16:41:12 PDT 2021)
Copyright (C) 2002-2014 Novell, Inc, Xamarin Inc and Contributors. www.mono-project.com
TLS: __thread
SIGSEGV: altstack
Notifications: epoll
Architecture: amd64
Disabled: none
Misc: softdebug
Interpreter: yes
LLVM: supported, not enabled.
Suspend: hybrid
GC: sgen (concurrent by default)

azure-machine-learning
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@VictorFragoso-6349 Thanks for the question. Can you please add more details about the steps that you performed and storage options that you are trying. Please make sure you are connected to the Internet and have a stable network connection. Meanwhile we are checking internally with the product team to check on this.

0 Votes 0 ·

I just have a container w/ the cifar10 dataset in Blob Storage. The dataset has two folders: 1) train/; and 2) test/. Each folder has a folder per class and each class-folder has jpg images inside them. As suggested in the documentation, I created a Dataset indicating that it has a directory structure:

dataset = Dataset.File.from_files(path=(datastore, './cifar10'))

The line above is the one crashing according to the stack trace I got from python.

Network connection is up and running on this machine w/o any issue.

Final note: The exact same code works on WSL2 using Ubuntu 18.10. It is quite strange that on a native Linux installation (Gentoo), the same code triggers this error.

0 Votes 0 ·
ramr-msft avatar image
0 Votes"
ramr-msft answered ramr-msft commented

@VictorFragoso-6349 Thanks for the details. Gentoo is not a 'natively' supported distribution of linux for Datasets. The Exception message doesn't link to a .NET docs page with instructions on installing the system dependencies required for .NET to work. Though it seems a different one is being thrown related to not being able to connect to out blob storage which has pre-prepared dependency sets for some linux distros (not gentoo).

This page Install .NET on Linux Distributions | Microsoft Docs does not detail support for .NET on gentoo.
You can get the names of the missing dependencies themselves by running:


 from dotnetcore2 import runtime
 runtime._enable_debug_logging()
 runtime.ensure_dependencies()

This code snippet should print the libraies missing required by .NET core 2.1.
If the above does not print anything, other than the Exception, then instead this should:

 from dotnetcore2 import runtime
 print(runtime._gather_dependencies(runtime._get_bin_folder()))




· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Linux distributions (e.g., Ubuntu, Gentoo, etc.) are pretty much interchangeable. Nevertheless, I was able to run the last to lines in your answer as the first three lines indeed threw an exception. What the last two python lines of code printed was this:

In [4]: print(runtime._gather_dependencies(runtime._get_bin_folder()))
{'liblttng-ust.so.0'}


Does this mean I am missing the liblttng-ust?

0 Votes 0 ·

I installed the liblttng-ust and all works now. Thanks for the help!

1 Vote 1 ·

@VictorFragoso-6349 Great, Thanks for the update.

0 Votes 0 ·
AbdulRahimAmjad-7260 avatar image
0 Votes"
AbdulRahimAmjad-7260 answered

Hi @ramr-msft I am facing the same issue while read my data from Datalake. Can you please help me out to resolve this issue. 98368-ml-issue.png

@VictorFragoso-6349 I try to install this package not the issue is still the same.



ml-issue.png (195.8 KiB)
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.