System Python installation for use in OpendTect

It is possible to use a system Python installation in OpendTect. In this scope such a Python installation is not a miniconda or anaconda installation.
Note that this is more complicated than the Internal Python installation. If you have your own custom miniconda3 or anaconda3 environment then this may also work for you when running the pip install commands in your Python environment.

In order for OpendTect to use a system Python installation the following things need to be done:

• Several packages need to be installed with pip, the requirements are listed below

• Non Python libraries CUDA, cuDNN and HDF5 needs to be installed

• Make sure that the PATH is set correctly for Python and the non Python libraries

Currently OpendTect and the Machine Learning plugin support:

• Python 3.9 and 3.10

• CUDA Toolkit 11.3

• cuDNN v8.2.1

• HDF5 1.12.2

• To check whether Python has been installed open the Command Prompt and run:
  where.exe python
  If it has been installed it will give the path to python.exe

• To find out which Python version is installed open the Command Prompt and run:
  python --version

• We recommend to install Python with the Python 3.10 full 64 bits installer from Python.org Downloads page for Windows. The other options to install Python are from the Microsoft Store and via the Windows Subsystem for Linux (WSL). The reason for not recommending the Microsoft Store package is that it has limitations that make it not suited for a professional development environment.
  
  To make it easier it is recommended to toggle on Add Python 3.10 to PATH before clicking Install Now

The paths to the Python and Python Scripts directory should have been set in environment variable Path, e.g:

• C:\Users\your_username\AppData\Local\Programs\Python\Python310

• C:\Users\your_username\AppData\Local\Programs\Python\Python310\Scripts

The following paths should be listed in the System Environment Path variable:

• C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.3\bin

• C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.3\extras\CUPTI\lib64
  Please note that this path the CUDA Toolkit installer will not set. It is recommended to set this one manually so that Python can use CUPTI.

• C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.3\libnvvp

• C:\Program Files\HDF_Group\HDF5\1.12.2\bin

• Optionally a manual path has to be set to the cuDNN libraries if these have not been unzipped into C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.3

In the OpendTect 7.0.0\data\Python directory are several requirements.txt files that pip can use to install the required Python packages.
Please note that not all requirements.txt files might be present in your installation. As example: for the machine_learning_requirements.txt to be present the Machine Learning plugin needs to be installed.

The pip installations have to be done via the Command Prompt, Windows PowerShell or Terminal.

Note that some of the packages may need to be build by a compiler on your system. If pip can not find the required compiler pip will give an error.

First make sure to update pip and install wheel to make your life easier:

python -m pip install --upgrade pip
pip install wheel

Then run to install the basic packages:
pip install -r path_to_OpendTect\7.0.0\data\Python\basic_requirements.txt

To install the Python libraries that are required for OpendTect Pro run:
pip install -r path_to_OpendTect\7.0.0\data\Python\dgbpro_requirements.txt

To install the Python libraries that are required for the presentation maker run:
pip install -r path_to_OpendTect\7.0.0\data\Python\presentation_maker_requirements.txt

To install the Python libraries that are required the Machine Learning plugin run:
pip install -r path_to_OpendTect\7.0.0\data\Python\machine_learning_requirements.txt

To install the Python libraries that are optional for the Machine Learning plugin run:
pip install -r path_to_OpendTect\7.0.0\data\Python\machine_learning_requirements_optional.txt

To install Python libraries that provide Spyder, Jupyter notebook and related libraries run:
pip install -r path_to_OpendTect\7.0.0\data\Python\notebooks_requirements.txt

To install Python libraries for odpybind run:
pip install -r path_to_OpendTect\7.0.0\data\Python\odpybind_requirements.txt

CUDA Toolkit can be downloaded from the CUDA Toolkit download page. Our advise is to download and install CUDA Toolkit 11.3.

cuDNN can be downloaded from the cuDNN Archive. Our advise is to download cuDNN v8.2.1 (June 7th, 2021), for CUDA 11.x.
An easy way to install is to unzip the downloaded zip-file's CUDA folder content into the path C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.3
When unzipping into another folder an extra step will need to be done by adding PATH to the cuDNN libraries.

HDF5 can be downloaded from the hdfgroup.org downloads page. Our advise is to download and install HDF5 1.12.2.

To use the system Python environment select System as Python environment in the Set Python settings window. When the system Python has been successfully installed the Test button should give the list of Python packages that are available in the system Python environment.