question

OlivierLeflere-8000 avatar image
0 Votes"
OlivierLeflere-8000 asked OlivierLeflere-8000 commented

great_expectations package

Hi,

I am trying to run great_expectations on an azure machine learning environment, but when I do so it tells me that great_expectations is not a package. My environment is defined by the following code :

creating an environment

from azureml.core.runconfig import RunConfiguration
from azureml.core.conda_dependencies import CondaDependencies
aml_run_config = RunConfiguration()
aml_run_config.target = compute_target

aml_run_config.environment.docker.enabled = True

aml_run_config.environment.docker.base_image = "mcr.microsoft.com/azureml/base:latest"

aml_run_config.environment.python.user_managed_dependencies = False
conda_dep = CondaDependencies()
conda_dep.add_conda_package("python=3.8")
conda_dep.add_conda_package("pandas")
conda_dep.add_conda_package("packaging")
conda_dep.add_conda_package('pip')

conda_dep.add_pip_package("azureml-defaults")

conda_dep.add_pip_package("great_expectations")
aml_run_config.environment.python.conda_dependencies = conda_dep

In the logs I can see that the package is being downloaded, but it is not being installed, which is kind of strange. Is there somebody who has experience with great_expectations on Azure Machine Learning?

Kind regards,

Olivier Leflere

azure-machine-learningazure-container-instances
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@OlivierLeflere-8000 Thanks for the question. We have forwarded to the product team to check on this and will update on the same.

0 Votes 0 ·

Any update from ramr-Msft? I saw some kinds of incompatible issue caused by some of the packages has been update by you.

0 Votes 0 ·

Hi, so far no update from update from ramr-Msft. Can you elaborate a bit regarding these incompatibilities?

0 Votes 0 ·

0 Answers