Machine Learning artifacts management.ipynb

Kernel: watsonx-ai-samples-py-312

Machine Learning artifacts management

This notebook contains steps and code to demonstrate how to manage and clean up watsonx.ai instance. This notebook contains steps and code to work with ibm-watsonx-ai library available in PyPI repository. This notebook introduces commands for listing artifacts, getting artifacts details and deleting them.

Some familiarity with Python is helpful. This notebook uses Python 3.12.

Learning goals

The learning goals of this notebook are:

• List watsonx.ai artifacts.

• Get artifacts details.

• Delete artifacts.

Contents

This notebook contains the following parts:

1. Setup

2. Manage pipelines

3. Manage model definitions

4. Manage models

5. Manage functions

6. Manage experiments

7. Manage trainings

8. Manage deployments

9. Summary and next steps

1. Set up the environment

Before you use the sample code in this notebook, you must perform the following setup tasks:

• Contact with your Cloud Pak for Data administrator and ask them for your account credentials

Install dependencies

Note: ibm-watsonx-ai documentation can be found here.

%pip install -U ibm-watsonx-ai | tail -n 1

Successfully installed anyio-4.9.0 certifi-2025.4.26 charset-normalizer-3.4.2 h11-0.16.0 httpcore-1.0.9 httpx-0.28.1 ibm-cos-sdk-2.14.1 ibm-cos-sdk-core-2.14.1 ibm-cos-sdk-s3transfer-2.14.1 ibm-watsonx-ai-1.3.20 idna-3.10 jmespath-1.0.1 lomond-0.3.3 numpy-2.2.6 pandas-2.2.3 pytz-2025.2 requests-2.32.2 sniffio-1.3.1 tabulate-0.9.0 typing_extensions-4.13.2 tzdata-2025.2 urllib3-2.4.0

Define credentials

Authenticate the watsonx.ai Runtime service on IBM Cloud Pak for Data. You need to provide the admin's username and the platform url.

username = "PASTE YOUR USERNAME HERE"
url = "PASTE THE PLATFORM URL HERE"

Use the admin's api_key to authenticate watsonx.ai Runtime services:

import getpass
from ibm_watsonx_ai import Credentials

credentials = Credentials(
    username=username,
    api_key=getpass.getpass("Enter your watsonx.ai API key and hit enter: "),
    url=url,
    instance_id="openshift",
    version="5.2",
)

Alternatively you can use the admin's password:

import getpass
from ibm_watsonx_ai import Credentials

if "credentials" not in locals() or not credentials.api_key:
    credentials = Credentials(
        username=username,
        password=getpass.getpass("Enter your watsonx.ai password and hit enter: "),
        url=url,
        instance_id="openshift",
        version="5.2",
    )

Create APIClient instance

from ibm_watsonx_ai import APIClient

client = APIClient(credentials)

Working with spaces

First of all, you need to create a space that will be used for your work. If you do not have space already created, you can use {PLATFORM_URL}/ml-runtime/spaces?context=icp4data to create one.

• Click New Deployment Space

• Create an empty space

• Go to space Settings tab

• Copy space_id and paste it below

Tip: You can also use SDK to prepare the space for your work. More information can be found here.

Action: Assign space ID below

space_id = "PASTE YOUR SPACE ID HERE"

You can use list method to print all existing spaces.

client.spaces.list(limit=10)

To be able to interact with all resources available in watsonx.ai, you need to set space which you will be using.

client.set.default_space(space_id)

'SUCCESS'

2. Manage pipelines

List existing pipelines. If you want to list only part of pipelines use client.pipelines.list(limit=n_pipelines).

client.pipelines.list(limit=10)

Get pipelines details. If you want to get only part of pipelines details use client.pipelines.get_details(limit=n_pipelines).

You can get each pipeline details by calling client.pipelines.get_details() and providing pipeline id from listed pipelines.

pipelines_details = client.pipelines.get_details(limit=10)
print(pipelines_details)

Delete all pipelines. You can delete one pipeline by calling client.pipelines.delete() and providing pipeline id from listed pipelines.

for pipeline in pipelines_details["resources"]:
    client.pipelines.delete(pipeline["metadata"]["id"])

3. Manage model definitions

List existing model definitions. If you want to list only part of model definitions use client.model_definitions.list(limit=n_model_definitions).

client.model_definitions.list(limit=10)

Get model definiton details by copying model definition id from above cell and running client.model_definitions.get_details(model_definition_id).

model_definition_id = "PUT_YOUR_MODEL_DEFINITION_ID"
model_definitions_details = client.model_definitions.get_details(model_definition_id)
print(model_definitions_details)

Delete model definitions by calling client.model_definitions.delete(model_definition_id).

client.model_definitions.delete(model_definition_id)

4. Manage models

List existing models. If you want to list only part of models use client.repository.list_models(limit=n_models).

client.repository.list_models(limit=10)

Get model details by copying model id from above cell and running client.repository.get_details(model_id).

model_id = "PUT_YOUR_MODEL_ID"
model_details = client.repository.get_details(model_id)
print(model_details)

To download selected model from repository use:

client.repository.download(model_id, <path_to_model>)
# To obtain serialized model first decompress it
!tar xzvf <path_to_model>

client.repository.download(model_id)

Instead of downloading model can be also loaded directly to runtime using:

model = client.repository.load(model_id)
# Loaded model can be used to perform prediction locally
# If loaded model was a scikit-learn pipeline we can use 'predict' method
model.predict(<test_data>)

client.repository.load(model_id)

Delete model from repository by calling client.repository.delete(model_id).

client.repository.delete(model_id)

5. Manage functions

List existing functions. If you want to list only part of functions use client.repository.list_functions(limit=n_functions).

client.repository.list_functions(limit=10)

Get function details by copying function id from above cell and running client.repository.get_details(function_id).

function_id = "PUT_YOUR_FUNCTION_ID"
function_details = client.repository.get_details(function_id)
print(function_details)

Delete function from repository by calling client.repository.delete(function_id).

client.repository.delete(function_id)

6. Manage experiments

List existing experiments. If you want to list only part of experiments use client.pipelines.list(limit=n_experiments).

client.experiments.list(limit=10)

Get experiments details. If you want to get only part of experiments details use client.experiments.get_details(limit=n_experiments).

You can get each experiment details by calling client.experiments.get_details() and providing experiment id from listed experiments.

experiments_details = client.experiments.get_details()
print(experiments_details)

Delete all experiments. You can delete one experiment by calling client.experiments.delete() and providing experiment id from listed experiments.

for experiment in experiments_details["resources"]:
    client.experiments.delete(experiment["metadata"]["id"])

7. Manage trainings

List existing trainings. If you want to list only part of trainings use client.training.list(limit=n_trainings).

client.training.list(limit=10)

Get trainings details. If you want to get only part of trainings details use client.training.get_details(limit=n_trainings).

You can get each training details by calling client.training.get_details() and providing training id from listed trainings.

trainings_details = client.training.get_details(limit=10)
print(trainings_details)

Delete all trainings. You can delete one training by calling client.training.cancel() and providing training id from listed trainings.

Note The client.training.cancel() method has hard_delete parameter. Please change it to:

• True - to delete the completed or canceled training runs.

• False - to cancel the currently running training run.

Default value is False.

for training in trainings_details["resources"]:
    client.training.cancel(training["metadata"]["id"])

8. Manage deployments

List existing deployments. If you want to list only part of deployments use client.deployments.list(limit=n_deployments).

client.deployments.list(limit=10)

Get deployments details. If you want to get only part of deployments details use client.deployments.get_details(limit=n_deployments).

You can get each deployment details by calling client.deployments.get_details() and providing deployment id from listed deployments.

deployments_details = client.deployments.get_details()
print(deployments_details)

Delete all deployments. You can delete one deployment by calling client.deployments.delete() and providing deployment id from listed deployments.

for deployment in deployments_details["resources"]:
    client.deployments.delete(deployment["metadata"]["id"])

9. Summary and next steps

You successfully completed this notebook! You learned how to use ibm-watsonx-ai client for watsonx.ai instance management and clean up.

Check out our Online Documentation for more samples, tutorials, documentation, how-tos, and blog posts.

Authors

Szymon Kucharczyk, Software Engineer at IBM.

Rafał Chrzanowski, Software Engineer Intern at watsonx.ai.

Copyright © 2020-2025 IBM. This notebook and its source code are released under the terms of the MIT License.