> For the complete documentation index, see [llms.txt](https://sealights-docs.tricentis.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://sealights-docs.tricentis.com/setup-and-configuration/command-line-interface/configure-test-repositories.md). # Configure Test Repositories A Test Repository is an external test management tool (such as Tosca, qTest, or Excel) that the ABAP Agent queries to find test cases that cover your ABAP changes. Each test repository is linked to a Pipeline and carries adapter-specific connection settings. ## Create or Update a Test Repository ### `slabapcli testrepo set` Creates or updates a test repository adapter entry in `config.toml`. After saving the configuration, the command runs an automatic connection test if the ABAP Agent server is running and ready. If the server is not ready, the configuration is still saved, the CLI warns that the connection test was not run, and the command exits successfully. Start the server, then verify connectivity with `testrepo test`. {% hint style="info" %} **Configuration reload:** `[[testrepo]]` settings are **hot** — a successful save is picked up on the next server configuration access without restarting the service. Restart an already-running scheduled task only if it may have cached prior credentials or context. If a connection test reports that the server is using a stale configuration, restart the server (`slabapcli server stop`, then `slabapcli server start`) and run the test again. See [Live reload and restart-required fields](broken://pages/DZM4uWEu5r51kMDWCmDB#live-reload-and-restart-required-fields). {% endhint %} {% hint style="info" %} **Prerequisites:** Create a Pipeline (`slabapcli pipeline set`) before running `testrepo set`. The `--pipeline` value must match an existing `[[pipeline]].name` in `config.toml`. The automatic connection test also requires the **SeaLights ABAP Server** Windows service to be running (`slabapcli server start` / `server status`) — see [Start the ABAP Agent Server](broken://pages/jjXJbDJ9CnFBYzl2NDMP). {% endhint %} {% tabs %} {% tab title="Command Prompt" %} {% code title="Syntax" overflow="wrap" %} ```batch slabapcli.exe testrepo set --name --type --pipeline [--setting key=value ...] [--servicebinding] [--test-stage ] ``` {% endcode %} {% endtab %} {% tab title="PowerShell" %} {% code title="Syntax" overflow="wrap" %} ```powershell .\slabapcli.exe testrepo set --name --type --pipeline [--setting key=value ...] [--servicebinding] [--test-stage ] ``` {% endcode %} {% endtab %} {% endtabs %} | Parameter | Short flag | Required | Description | | ------------------ | ---------- | ---------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | `--name` | `-n` | Yes | A unique name for this test repository entry (stored as `[[testrepo]].name`). | | `--type` | `-t` | Yes | The adapter type. Supported values: `ado`, `tosca`, `toscacloud`, `excel`, `xray`, `qtest`, `certify`, `ssm`, `alm`, `octane`, `calm`. | | `--pipeline` | `-p` | Yes | The pipeline name this test repository belongs to (must match a `[[pipeline]].name` value in `config.toml`). | | `--setting` | — | See per-adapter tables | A non-secret adapter setting in `key=value` form. Repeat this flag for each key. **Secrets are not accepted via `--setting`** — they are entered interactively (see below). | | `--servicebinding` | — | No | **`calm` only.** Paste the SAP Cloud ALM (SAP BTP) service binding JSON when prompted, instead of passing `tokenUrl` and `apiBase` with `--setting` and entering `clientId` and `clientSecret` separately. See [calm](#calm). | | `--test-stage` | — | No | Optional SeaLights test stage for this test repository (stored as top-level `[[testrepo]].teststage`). This is a dedicated option — do **not** pass it as `--setting`. When omitted on `testrepo set`, any previously stored `teststage` is **cleared**. When never set or cleared, the effective default is `"{type} Tests"` (for example `qtest Tests` or `ado Tests`). See [Configuration settings](broken://pages/DZM4uWEu5r51kMDWCmDB) for the TOML key. | ### How `testrepo set` replaces settings {% hint style="warning" %} **Full replacement on every call:** `testrepo set` replaces the **entire** `[testrepo.settings]` block, `searchpaths`, and `teststage` on every invocation. Any optional key you omit is cleared — omitting `--test-stage` clears a previously stored `teststage`. To make a partial change — for example, to update a single setting without re-entering all others — edit `config.toml` directly. See [Configuration settings](broken://pages/DZM4uWEu5r51kMDWCmDB) for the full `[[testrepo]]` schema. {% endhint %} {% hint style="info" %} **Duplicate test stages:** If another test repository on the same pipeline already uses the same effective test stage, `testrepo set` emits a warning but still saves successfully. The warning asks you to confirm intent — a shared stage can be valid when multiple repositories intentionally contribute regression tests for the same RFC or pipeline context. {% endhint %} ### How secrets are entered Secret keys (credentials) are never accepted via `--setting`. After the non-secret settings are validated, the command prompts you interactively for each secret field. Each character you type is shown as `*`, and you must confirm each entry. If you skip an optional secret (for example, one half of a two-pair credential), press **Enter** at the prompt. To change a secret, re-run `testrepo set` with the full set of settings and enter the new secret at the prompt, or edit the value directly in `config.toml` when it is stored as plaintext (`key` and `iv` in `[settings]` are empty). If a scheduled task may already hold the prior credentials, stop and start that **task** as needed. *** ### Per-adapter setting keys The `--setting` flag accepts only non-secret keys. The table for each adapter type lists all accepted keys, whether they are required, and the expected format. {% hint style="info" %} `searchPaths` (optional for all types that accept it) scopes the search to a comma-separated list of repository or filesystem paths. When omitted, the adapter searches the entire test repository. `confidenceThreshold` (optional, integer 0–100) sets the minimum match confidence for a test case to be considered a match. When omitted, the adapter uses its default. **Exception:** `ado` does not accept `confidenceThreshold`. {% endhint %} #### qtest | Setting key | Required | Format | Description | | --------------------- | -------- | -------------------- | ------------------------------------------------------------------- | | `url` | Yes | URL string | The qTest Manager base URL (e.g. `https://mycompany.qtestnet.com`). | | `project` | Yes | String | The qTest project name or ID. | | `searchPaths` | No | Comma-separated list | Scopes the search to specific qTest modules or paths. | | `confidenceThreshold` | No | Integer 0–100 | Minimum confidence for a match. | **Secrets (entered interactively):** | Secret key | Required | Description | | ---------- | -------- | -------------------------------- | | `username` | Yes | The qTest user account name. | | `password` | Yes | The qTest user account password. | #### tosca | Setting key | Required | Format | Description | | ------------------------- | -------- | ------------------------ | ------------------------------------------------------------------------------------------------------------- | | `url` | Yes | URL string | The Tosca server URL. | | `project` | Yes | String | The Tosca project name. | | `workstates` | No | Comma-separated list | Test case workflow states to include in the search. | | `searchTransaction` | No | `true` / `false` | Whether to search Tosca Transactions. | | `searchTestConfiguration` | No | `true` / `false` | Whether to search Tosca Test Configurations. | | `searchTile` | No | `true` / `false` | Whether to search Tosca Tiles. | | `searchApiTypeSapModule` | No | `true` / `false` | Whether to search API-type SAP module test cases. | | `bufferPatterns` | No | Semicolon-separated list | Buffer patterns to search for. When non-empty, the Buffer search method is enabled. | | `parameterPatterns` | No | Semicolon-separated list | Parameter patterns to search for. When non-empty, the Parameter search method is enabled. | | `searchPaths` | No | Comma-separated list | Scopes the search to specific Tosca paths. | | `confidenceThreshold` | No | Integer 0–100 | Minimum confidence for a match. | | `skipCollect` | No | `true` / `false` | When `true`, the adapter skips the ranking step and returns the matching test cases without rank information. | | `configurationPatterns` | No | Semicolon-separated list | Regex patterns for Test Configuration parameter names, used by the Test Configuration search method. | **Secrets (entered interactively — provide exactly one credential pair):** | Secret key | Required | Description | | ----------- | -------------------------------------------------------- | ----------------- | | `username` | One of `username`+`password` **or** `apikey`+`apisecret` | Tosca username. | | `password` | One of `username`+`password` **or** `apikey`+`apisecret` | Tosca password. | | `apikey` | One of `username`+`password` **or** `apikey`+`apisecret` | Tosca API key. | | `apisecret` | One of `username`+`password` **or** `apikey`+`apisecret` | Tosca API secret. | #### toscacloud | Setting key | Required | Format | Description | | --------------------- | -------- | -------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------- | | `url` | Yes | URL string | The Tosca Cloud base URL. | | `spaceId` | Yes | String | The Tosca Cloud **workspace name**, exactly as it appears in Tosca Cloud. The search fails if no workspace with this name is visible to the configured client. | | `scope` | Yes | String | The OAuth scope the agent requests when it obtains an access token (for example `tta`). | | `workstates` | No | Comma-separated list | Test case workflow states to include in the search. | | `searchPaths` | No | Comma-separated list | Scopes the search to specific paths. | | `confidenceThreshold` | No | Integer 0–100 | Minimum confidence for a match. | **Secrets (entered interactively):** | Secret key | Required | Description | | -------------- | -------- | ------------------------------ | | `clientId` | Yes | The Tosca Cloud client ID. | | `clientSecret` | Yes | The Tosca Cloud client secret. | #### excel | Setting key | Required | Format | Description | | --------------------- | -------- | --------------------------------------- | ----------------------------------------------------------------------------------------------- | | `filePath` | Yes | File path (`.xlsx`, `.xlsm`, or `.xls`) | Absolute path to the Excel workbook on the agent host. | | `sheetName` | Yes | String | The worksheet name that contains the test case data. The name is case-sensitive. | | `testCaseIdColumn` | Yes | String | Column address for the test case ID (for example `A`). | | `testCaseNameColumn` | Yes | String | Column address for the test case name (for example `B`). | | `searchColumns` | Yes | Comma-separated list | One or more column addresses to search for ABAP object matches. At least one entry is required. | | `testCasePathColumn` | No | String | Column address for the test case path. | | `searchPaths` | No | Comma-separated list | Scopes the search to specific paths. | | `confidenceThreshold` | No | Integer 0–100 | Minimum confidence for a match. | Excel has no secrets. #### xray | Setting key | Required | Format | Description | | --------------------- | -------- | --------------------------------------- | -------------------------------------------------------------------------------- | | `filePath` | Yes | File path (`.xlsx`, `.xlsm`, or `.xls`) | Absolute path to the Xray export file on the agent host. | | `sheetName` | Yes | String | The worksheet name that contains the test case data. The name is case-sensitive. | | `testCaseIdColumn` | Yes | String | Column address for the test case ID (for example `A`). | | `testCaseNameColumn` | Yes | String | Column address for the test case name. | | `testStepsColumn` | Yes | String | Column address for the JSON test-steps payload. | | `testCasePathColumn` | No | String | Column address for the test case path. | | `searchPaths` | No | Comma-separated list | Scopes the search to specific paths. | | `confidenceThreshold` | No | Integer 0–100 | Minimum confidence for a match. | Xray has no secrets. #### ado | Setting key | Required | Format | Description | | ------------- | -------- | -------------------- | -------------------------------------------------------------------------------------------------------------- | | `url` | Yes | URL string | The Azure DevOps organization or collection URL (e.g. `https://dev.azure.com/MyOrg`). | | `project` | Yes | String | The Azure DevOps project name. | | `timeout` | No | Integer (seconds) | Per-repository request timeout. Default: `100`. A value that is not a positive integer is replaced with `100`. | | `searchPaths` | No | Comma-separated list | Scopes the search to specific paths. | `ado` does **not** accept `confidenceThreshold`. **Secrets (entered interactively):** | Secret key | Required | Description | | ---------- | -------- | ----------------------------------------- | | `password` | Yes | Azure DevOps Personal Access Token (PAT). | #### certify | Setting key | Required | Format | Description | | --------------------- | -------- | ---------------------------- | -------------------------------------------------------------------------------------------------------------------------------- | | `project` | Yes | String | The Certify project name. | | `connectionString` | Yes | OLE DB connection string | Must include `Provider=...`. Must **not** embed credentials (`user id`, `uid`, `password`, `pwd`). | | `uidProp` | No | `User ID` / `Uid` / `Userid` | Property name used when appending the username (default `User ID`). Values are not case-sensitive; any other value is rejected. | | `pwdProp` | No | `Password` / `Pwd` | Property name used when appending the password (default `Password`). Values are not case-sensitive; any other value is rejected. | | `searchPaths` | No | Comma-separated list | Scopes the search to specific paths. | | `confidenceThreshold` | No | Integer 0–100 | Minimum confidence for a match. | **Secrets (entered interactively — optional):** | Secret key | Required | Description | | ---------- | -------- | ----------------------------------------------------------------- | | `username` | No | Database user. Leave blank for Windows Integrated Authentication. | | `password` | No | Database password. Leave blank when `username` is blank. | #### ssm | Setting key | Required | Format | Description | | --------------------- | -------- | -------------------- | ------------------------------------------------------- | | `url` | Yes | URL string | The Solution Manager OData base URL. | | `client` | Yes | String | The `sap-client` query parameter (e.g. `100`). | | `solution` | Yes | String | Solution title as shown in Solution Manager. | | `branch` | Yes | String | Branch title as shown in Solution Manager. | | `rfcDest` | No | String | An existing `[[rfc]].name` for optional RFC enrichment. | | `searchPaths` | No | Comma-separated list | Scopes the search to specific paths. | | `confidenceThreshold` | No | Integer 0–100 | Minimum confidence for a match. | **Secrets (entered interactively):** | Secret key | Required | Description | | ---------- | -------- | --------------------------------------- | | `username` | Yes | Solution Manager user account name. | | `password` | Yes | Solution Manager user account password. | #### alm | Setting key | Required | Format | Description | | --------------------- | -------- | -------------------- | -------------------------------------------------------------------------------------------------------------------------- | | `url` | Yes | URL string | The OpenText ALM server URL (e.g. `https://alm.example.com/qcbin`). | | `domain` | Yes | String | The OpenText ALM domain. | | `project` | Yes | String | The OpenText ALM project name. | | `clientDirectory` | Yes | Absolute path | Absolute customer folder containing `OTAClient.dll` and `WebClient.dll` (the agent copies these two DLLs for its own use). | | `requirementType` | No | String | Currently unused. | | `requirementAuthor` | No | String | Currently unused. | | `searchPaths` | No | Comma-separated list | Scopes the search to specific paths. | | `confidenceThreshold` | No | Integer 0–100 | Minimum confidence for a match. | **Secrets (entered interactively — provide exactly one credential pair):** | Secret key | Required | Description | | ----------- | -------------------------------------------------------- | ------------------------------ | | `username` | One of `username`+`password` **or** `apikey`+`apisecret` | OpenText ALM account username. | | `password` | One of `username`+`password` **or** `apikey`+`apisecret` | OpenText ALM account password. | | `apikey` | One of `username`+`password` **or** `apikey`+`apisecret` | OpenText ALM 15+ API key. | | `apisecret` | One of `username`+`password` **or** `apikey`+`apisecret` | OpenText ALM 15+ API secret. | #### octane | Setting key | Required | Format | Description | | --------------------- | -------- | -------------------- | -------------------------------------------------------------------- | | `url` | Yes | URL string | Octane REST base URL (for example `http://octane.example.com:8080`). | | `sharedSpace` | Yes | String | Octane shared space name. | | `project` | Yes | String | Octane workspace name. | | `searchPaths` | No | Comma-separated list | Scopes the search to specific Octane application module names. | | `confidenceThreshold` | No | Integer 0–100 | Minimum confidence for a match. When omitted, the adapter uses `0`. | **Secrets (entered interactively):** | Secret key | Required | Description | | ----------- | -------- | ----------------------------------------- | | `apikey` | Yes | Octane OAuth client id (`apikey`). | | `apisecret` | Yes | Octane OAuth client secret (`apisecret`). | #### calm | Setting key | Required | Format | Description | | --------------------- | -------- | -------------------- | ------------------------------------------------------------------------------------ | | `tokenUrl` | Yes\* | URL string | UAA base URL from service binding `uaa.url` (`/oauth/token` appended when missing). | | `apiBase` | Yes\* | URL string | API gateway URL from service binding `endpoints.Api` (`/api` appended when missing). | | `searchPaths` | No | Comma-separated list | Scopes the search to specific paths. | | `confidenceThreshold` | No | Integer 0–100 | Minimum confidence for a match. When omitted, the adapter uses `0`. | \*Omit these settings when you use `--servicebinding` (CALM only); the CLI parses them from pasted SAP BTP service binding JSON. **Secrets (entered interactively — or supplied via `--servicebinding`):** | Secret key | Required | Description | | -------------- | -------- | ------------------------------------------------------ | | `clientId` | Yes\* | OAuth `client_id` for the client-credentials flow. | | `clientSecret` | Yes\* | OAuth `client_secret` for the client-credentials flow. | Use `--servicebinding` instead of manual `--setting` / secret prompts to paste SAP Cloud ALM BTP service binding JSON interactively. Do not combine `--servicebinding` with `--setting tokenUrl`, `apiBase`, `clientId`, or `clientSecret`. *** **Examples for other types** — each Test Tool Integrations page has a matching Command Prompt / PowerShell example: * [Azure DevOps (ado)](broken://pages/jaDYz7fLtP15myYkgPuL) * [Tosca Commander](broken://pages/AD78Sh9p33IsyXh4cjaA) * [Tosca Cloud](broken://pages/KWz17kExfX3vexGN20xZ) * [Excel](broken://pages/jeh44M2koPsD40Ie9JTr) * [Xray](broken://pages/l0dRY9Po3IYw1YzANqRX) * [qTest](broken://pages/gHBxqJkkbPefVxu9V3RK) * [Certify](broken://pages/2Fo3SIuYOOnL4JxVdUmT) * [SAP Solution Manager (SSM)](broken://pages/Wm5uastLy6VrpwVlLOxz) * [OpenText ALM](broken://pages/NSGOrSVHL32pkSx0f9vR) * [OpenText Octane](broken://pages/5p9tfpQ6QUDDh7eGyJEc) * [SAP Cloud ALM](broken://pages/YqgNK81CxPbBgmGxbRxU) *** ## Test a Test Repository Connection ### `slabapcli testrepo test` Runs a live connection test for a configured test repository adapter by dispatching a task to the ABAP Agent server. {% tabs %} {% tab title="Command Prompt" %} {% code title="Syntax" overflow="wrap" %} ```batch slabapcli.exe testrepo test --pipeline --testrepo ``` {% endcode %} {% endtab %} {% tab title="PowerShell" %} {% code title="Syntax" overflow="wrap" %} ```powershell .\slabapcli.exe testrepo test --pipeline --testrepo ``` {% endcode %} {% endtab %} {% endtabs %} | Parameter | Short flag | Required | Description | | ------------ | ---------- | -------- | ------------------------------------------------------------------------------------------ | | `--pipeline` | `-p` | Yes | The pipeline name (must match a `[[pipeline]].name` value in `config.toml`). | | `--testrepo` | — | Yes | The test repository name (must match a `[[testrepo]].name` value linked to this pipeline). | #### Example {% tabs %} {% tab title="Command Prompt" %} {% code title="Command" overflow="wrap" %} ```batch slabapcli.exe testrepo test --pipeline "ALM_Demo-S21" --testrepo "ALM_Demo-qtest" ``` {% endcode %} {% endtab %} {% tab title="PowerShell" %} {% code title="Command" overflow="wrap" %} ```powershell .\slabapcli.exe testrepo test --pipeline 'ALM_Demo-S21' --testrepo 'ALM_Demo-qtest' ``` {% endcode %} {% endtab %} {% endtabs %} {% code title="Expected output (PowerShell)" overflow="wrap" lineNumbers="true" %} ```log .\slabapcli.exe testrepo test --pipeline 'ALM_Demo-S21' --testrepo 'ALM_Demo-qtest' [2026-03-08 10:47:12.456+02:00] [info] Config pathname: C:\ProgramData\Tricentis\SeaLights\ABAP Agent\config\config.toml Connection test passed for 'ALM_Demo-qtest' (pipeline: 'ALM_Demo-S21'). ``` {% endcode %} {% hint style="info" %} If the CLI prints `Connection test could not use the server's stale configuration.` followed by `Restart the ABAP Agent server, then run:`, the server has not picked up the saved `[[testrepo]]` entry. Restart the server (`slabapcli server stop`, then `slabapcli server start`), then re-run the printed `slabapcli testrepo test` command. When this occurs after `testrepo set`, the configuration remains saved. Also verify the `[[testrepo]]` entry and its pipeline association in the active `config.toml`. See [Configuration settings](broken://pages/DZM4uWEu5r51kMDWCmDB#live-reload-and-restart-required-fields) for which changes need a restart. {% endhint %} If the test fails, the command exits with a non-zero code and prints one of the following: * `Connection test FAILED for '' (pipeline: ''): ` — the adapter could not connect. The reason is the message reported by the server. * `Connection test could not run: ABAP Agent server is not reachable.` — start the server with `slabapcli server start`. * `Connection test timed out for ''.` *** ## List Test Repositories ### `slabapcli testrepo list` Lists all test repository adapter entries defined in your `config.toml` file. {% tabs %} {% tab title="Command Prompt" %} {% code title="Syntax" overflow="wrap" %} ```batch slabapcli.exe testrepo list ``` {% endcode %} {% endtab %} {% tab title="PowerShell" %} {% code title="Syntax" overflow="wrap" %} ```powershell .\slabapcli.exe testrepo list ``` {% endcode %} {% endtab %} {% endtabs %} This command takes no parameters. #### Example {% code title="Expected output (PowerShell)" overflow="wrap" lineNumbers="true" %} ```log .\slabapcli.exe testrepo list [2026-03-08 10:50:00.789+02:00] [info] Config pathname: C:\ProgramData\Tricentis\SeaLights\ABAP Agent\config\config.toml Name : ALM_Demo-qtest Type : qtest Pipeline : ALM_Demo-S21 TestStage : qtest Tests Setting : url=https://mycompany.qtestnet.com Setting : project=MyProject Setting : username=****** (Encrypted) Setting : password=****** (Encrypted) Listed 1 configured test-repository adapter. ``` {% endcode %} {% hint style="info" %} Secret settings (`username`, `password`, `apikey`, `apisecret`, `clientId`, `clientSecret`) are always shown as `****** (Encrypted)`, never as their actual values. A `SearchPaths` line is printed only for test repositories that define search paths, and a blank line separates consecutive entries. When no test repositories are configured, the command prints `No test-repository adapters are configured.` {% endhint %}