Hi,
I am trying to run great_expectations on an azure machine learning environment, but when I do so it tells me that great_expectations is not a package. My environment is defined by the following code :
creating an environment
from azureml.core.runconfig import RunConfiguration
from azureml.core.conda_dependencies import CondaDependencies
aml_run_config = RunConfiguration()
aml_run_config.target = compute_target
aml_run_config.environment.docker.enabled = True
aml_run_config.environment.docker.base_image = "mcr.microsoft.com/azureml/base:latest"
aml_run_config.environment.python.user_managed_dependencies = False
conda_dep = CondaDependencies()
conda_dep.add_conda_package("python=3.8")
conda_dep.add_conda_package("pandas")
conda_dep.add_conda_package("packaging")
conda_dep.add_conda_package('pip')
conda_dep.add_pip_package("azureml-defaults")
conda_dep.add_pip_package("great_expectations")
aml_run_config.environment.python.conda_dependencies = conda_dep
In the logs I can see that the package is being downloaded, but it is not being installed, which is kind of strange. Is there somebody who has experience with great_expectations on Azure Machine Learning?
Kind regards,
Olivier Leflere