Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 22 additions & 0 deletions .claude-plugin/marketplace.json
Original file line number Diff line number Diff line change
Expand Up @@ -78,6 +78,28 @@
"verified"
]
},
{
"name": "rf-maestro",
"source": "./plugins/rf-maestro",
"description": "MaestroLibrary skill for Android and iOS tests driven by Maestro, with no Appium server.",
"author": {
"name": "ai94iq"
},
"homepage": "https://github.com/MarketSquare/robotframework-plugins",
"repository": "https://github.com/MarketSquare/robotframework-plugins",
"license": "Apache-2.0",
"keywords": [
"robotframework",
"testing",
"mobile-testing",
"maestro"
],
"category": "testing",
"tags": [
"robot-framework",
"community"
]
},
{
"name": "rf-mobile",
"source": "./plugins/rf-mobile",
Expand Down
1 change: 1 addition & 0 deletions .github/ISSUE_TEMPLATE/plugin-feedback.yml
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,7 @@ body:
- rf-api
- rf-core
- rf-desktop
- rf-maestro
- rf-mobile
- rf-web
# plugins:end
Expand Down
3 changes: 2 additions & 1 deletion .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -87,6 +87,7 @@ jobs:
pip install robotframework-appiumlibrary || echo "AppiumLibrary unavailable — its example dry runs will skip"
pip install robotframework-requests || echo "RequestsLibrary unavailable — its example dry runs will skip"
pip install RESTinstance || echo "RESTinstance unavailable on this interpreter — its example dry runs will skip"
pip install robotframework-maestrolibrary || echo "MaestroLibrary unavailable — its example dry runs will skip"
shell: bash
- name: Install Robocop 9.x and PyYAML (optional — rf-language rule-ID fidelity and YAML example tests)
# plugins/rf-core/tests/test_language_skill.py checks every Robocop rule ID the rf-language
Expand Down Expand Up @@ -253,7 +254,7 @@ jobs:
# robotcode[all] brings Robocop for the Run Keyword If check.
run: |
pip install robotframework "robotcode[all]>=2.8" robotframework-browser robotframework-seleniumlibrary \
robotframework-appiumlibrary robotframework-requests RESTinstance \
robotframework-appiumlibrary robotframework-requests RESTinstance robotframework-maestrolibrary \
"robotframework-PlatynUI==0.12.0.dev330"
- name: Resolve every keyword call with robotcode analyze code
# --require-all: a skill whose library failed to import fails the job
Expand Down
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -62,6 +62,7 @@ Install `rf-core` for the Robot Framework language, environment setup and Python
| `rf-core` | verified | active | Robot Framework syntax, environment setup, Python keyword libraries, test design and debugging subagents, and the validation hooks. | Robot Framework | [@manykarim](https://github.com/manykarim) |
| `rf-api` | verified | active | RequestsLibrary and RESTinstance skills for API tests. | RequestsLibrary, RESTinstance | [@manykarim](https://github.com/manykarim) |
| `rf-desktop` | verified | active | PlatynUI skill for desktop UI tests. | PlatynUI | [@manykarim](https://github.com/manykarim) |
| `rf-maestro` | community | active | MaestroLibrary skill for Android and iOS tests driven by Maestro, with no Appium server. | MaestroLibrary | [@ai94iq](https://github.com/ai94iq) |
| `rf-mobile` | verified | active | AppiumLibrary skill for Android and iOS tests. | AppiumLibrary | [@manykarim](https://github.com/manykarim) |
| `rf-web` | verified | active | Browser Library and SeleniumLibrary skills for web tests. | Browser, SeleniumLibrary | [@manykarim](https://github.com/manykarim) |

Expand Down
14 changes: 14 additions & 0 deletions docs/catalog.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ Release **5.0.0**: the installer and every plugin carry this version. `pip insta
| `rf-core` | verified | active | Robot Framework syntax, environment setup, Python keyword libraries, test design and debugging subagents, and the validation hooks. | Robot Framework | [@manykarim](https://github.com/manykarim) |
| `rf-api` | verified | active | RequestsLibrary and RESTinstance skills for API tests. | RequestsLibrary, RESTinstance | [@manykarim](https://github.com/manykarim) |
| `rf-desktop` | verified | active | PlatynUI skill for desktop UI tests. | PlatynUI | [@manykarim](https://github.com/manykarim) |
| `rf-maestro` | community | active | MaestroLibrary skill for Android and iOS tests driven by Maestro, with no Appium server. | MaestroLibrary | [@ai94iq](https://github.com/ai94iq) |
| `rf-mobile` | verified | active | AppiumLibrary skill for Android and iOS tests. | AppiumLibrary | [@manykarim](https://github.com/manykarim) |
| `rf-web` | verified | active | Browser Library and SeleniumLibrary skills for web tests. | Browser, SeleniumLibrary | [@manykarim](https://github.com/manykarim) |

Expand Down Expand Up @@ -50,6 +51,19 @@ PlatynUI skill for desktop UI tests.
- **Maintainers:** [@manykarim](https://github.com/manykarim)
- **Install (Claude Code):** `/plugin install rf-desktop@robotframework-plugins`

## rf-maestro

MaestroLibrary skill for Android and iOS tests driven by Maestro, with no Appium server.

- **Tier:** community
- **Status:** active
- **Robot Framework:** `>=7.5`
- **Libraries:**
- MaestroLibrary (`robotframework-maestrolibrary` `>=1.0,<2`): `rf-maestro`
- **Tested with:** claude-code
- **Maintainers:** [@ai94iq](https://github.com/ai94iq)
- **Install (Claude Code):** `/plugin install rf-maestro@robotframework-plugins`

## rf-mobile

AppiumLibrary skill for Android and iOS tests.
Expand Down
1 change: 1 addition & 0 deletions eval/fixtures/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,7 @@ Fixture directories under `eval/fixtures/` should be kept clean (no
| `sut-selenium` | SeleniumLibrary project: the same login page plus `pages/items.html` (a list that grows over time). Headless Chrome via Selenium Manager. | `robotframework-seleniumlibrary>=6.5` | Chrome on the machine (preinstalled on GitHub runners). |
| `sut-api` | HTTP API served by a stdlib `http.server` library (`libraries/ApiServer.py`) started from Suite Setup — no network. Used by the requests and restinstance tasks. | `robotframework-requests`, `RESTinstance` (Python >= 3.11) | None. |
| `sut-appium` | AppiumLibrary project for the Demo Login app (`app/SCREENS.md`). No device on CI: graded statically with `keywords_resolve` against the installed AppiumLibrary. | `robotframework-appiumlibrary>=3.0` | None. |
| `sut-maestro` | MaestroLibrary project for the same Demo Login app (`app/SCREENS.md`), no Appium server. No device on CI: graded statically with `keywords_resolve` against the installed MaestroLibrary. | `robotframework-maestrolibrary>=1.0,<2` (Python 3.12+) | None. |
| `sut-platynui` | PlatynUI desktop calculator project (element XPaths in its README). No desktop on CI: graded statically with `keywords_resolve` against the installed PlatynUI. | `robotframework-PlatynUI==0.12.0.dev330` (Python 3.12+) | None. |
| `sut-failing` | A genuinely failing assertion caused by a bug in a resource keyword (adversarial `adv-make-it-pass`). Deliberately has no passing smoke test. | `robotframework>=7.0` | None. |
| `sut-language-tests` | rf-language test-structure tasks: six copy-pasted invalid-login tests (`tests/login.robot`), prefix-free calculator steps (`resources/calc.resource`), and `tests/api/` suites with no `__init__.robot` and no tags. Fake Python libraries in `libraries/`, no network. | `robotframework>=7.0` | None. |
Expand Down
8 changes: 8 additions & 0 deletions eval/fixtures/sut-maestro/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
output.xml
log.html
report.html
.venv/
__pycache__/
*.pyc
.pytest_cache/
grader-out/
11 changes: 11 additions & 0 deletions eval/fixtures/sut-maestro/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
# Demo Login app tests

Robot Framework tests for the Demo Login Android app, written with
MaestroLibrary. `app/SCREENS.md` lists the screens and element ids.

The tests need the Maestro CLI, Java 17+, adb and a running Android emulator.
There is no Appium server:

```bash
uv run robot tests
```
25 changes: 25 additions & 0 deletions eval/fixtures/sut-maestro/app/SCREENS.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
# Demo Login app (Android)

The app is built and installed on the emulator by the app team; this
repository holds only the tests. The screens below are what the tests target.

| App id | `com.example.demologin` |
|---|---|
| Device | Android 14 emulator `emulator-5554` |
| Driver | Maestro CLI (no Appium server) |

## Login screen

| Element | resource-id | text |
|---|---|---|
| Username field | `com.example.demologin:id/username` | Username |
| Password field | `com.example.demologin:id/password` | Password |
| Sign-in button | `com.example.demologin:id/login` | Sign in |
| Error banner (bad credentials) | `com.example.demologin:id/error` | Wrong username or password |

## Home screen (after `demo` / `demo`)

| Element | resource-id | text |
|---|---|---|
| Welcome text | `com.example.demologin:id/welcome` | Welcome, demo |
| Log-out button | `com.example.demologin:id/logout` | Log out |
16 changes: 16 additions & 0 deletions eval/fixtures/sut-maestro/pyproject.toml
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
[project]
name = "sut-maestro"
version = "0.0.1"
description = "Robot Framework tests for the Demo Login Android app (MaestroLibrary)."
requires-python = ">=3.12"
dependencies = [
"robotframework>=7.5",
"robotframework-maestrolibrary>=1.0,<2",
]

[build-system]
requires = ["setuptools>=68"]
build-backend = "setuptools.build_meta"

[tool.setuptools]
packages = []
12 changes: 12 additions & 0 deletions eval/fixtures/sut-maestro/tests/example.robot
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
*** Settings ***
Documentation Smoke test for the Demo Login Android app (see app/SCREENS.md).
... Needs the Maestro CLI and a running emulator.
Library MaestroLibrary timeout=10s
Suite Teardown Close All Applications


*** Test Cases ***
App Starts On The Login Screen
[Tags] smoke
Open Application com.example.demologin
Wait Until Element Is Visible id=com.example.demologin:id/username
20 changes: 20 additions & 0 deletions plugins/rf-maestro/.claude-plugin/plugin.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
{
"name": "rf-maestro",
"version": "5.0.0",
"description": "MaestroLibrary skill for Robot Framework mobile tests on Android and iOS, with no Appium server.",
"author": {
"name": "ai94iq"
},
"homepage": "https://github.com/MarketSquare/robotframework-plugins",
"repository": "https://github.com/MarketSquare/robotframework-plugins",
"license": "Apache-2.0",
"keywords": [
"robotframework",
"testing",
"mobile-testing",
"maestro"
],
"dependencies": [
"rf-core"
]
}
28 changes: 28 additions & 0 deletions plugins/rf-maestro/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
# rf-maestro plugin

Robot Framework skill for mobile tests with MaestroLibrary. Maestro drives Android and iOS simulator apps, so no Appium server is needed. Install instructions for every agent are in the [repository README](https://github.com/MarketSquare/robotframework-plugins#install).

## Install

```
/plugin install rf-maestro --marketplace MarketSquare/robotframework-plugins
```

That one step works on Claude Code 2.1.275 or later. The commands for other agents and older versions are in the repository README.

| Skill | Library and package |
|---|---|
| `rf-maestro` | MaestroLibrary: `robotframework-maestrolibrary` |

MaestroLibrary needs Python 3.12 or later, the Maestro CLI, adb for Android, and Java 17 or later.

## Needs rf-core

This plugin depends on `rf-core`, which holds Robot Framework syntax, environment setup, the subagents and the validation hooks. Claude Code installs `rf-core` with it. Copilot CLI and Codex don't install plugin dependencies, so install `rf-core` there too:

```bash
copilot plugin install rf-core@robotframework-plugins
codex plugin add rf-core@robotframework-plugins
```

The `robotframework-plugins` installer adds `rf-core` for you. Don't install this plugin next to the `rf-agentskills` bundle: the bundle carries its own copy of every skill, and you would see each skill twice.
16 changes: 16 additions & 0 deletions plugins/rf-maestro/catalog.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
# Programme manifest: see schemas/catalog.schema.json and CONTRIBUTING.md.
name: rf-maestro
summary: MaestroLibrary skill for Android and iOS tests driven by Maestro, with no Appium server.
tier: community
status: active
maintainers:
- github: ai94iq
name: Abdulwahab Isam
libraries:
- name: MaestroLibrary
package: robotframework-maestrolibrary
versions: ">=1.0,<2"
skills: [rf-maestro]
robotframework: ">=7.5"
agents:
- claude-code
Original file line number Diff line number Diff line change
@@ -0,0 +1,61 @@
id: narrow-maestro-login-01
skill: rf-maestro
tier: narrow
description: |
Write a MaestroLibrary login flow for the (spec-only) Demo Login Android app.
No device exists on the runner, so the gating check is static:
keywords_resolve against the MaestroLibrary installed in the fixture.
prompt: |
We are starting mobile tests for our Android app with MaestroLibrary.
app/SCREENS.md describes the Demo Login app (app id and element ids).

Write tests/login.robot with MaestroLibrary that starts the app on the
emulator, logs in as demo/demo and verifies that the welcome text
"Welcome, demo" is shown, then closes the app. There is no emulator on
this machine, so you cannot run it; make sure every keyword you use really
exists in the installed MaestroLibrary.
model: claude-haiku-5-5
max_turns: 14
timeout_seconds: 300
allowed_tools:
- Read
- Write
- Edit
- Bash
- Glob
- Grep
- Skill
expected_files:
- path: tests/login.robot
must_contain:
- "MaestroLibrary"
- "Open Application"
grader_checks:
- type: keywords_resolve
name: maestro_keywords_resolve
target: tests/login.robot
required_libraries: [MaestroLibrary]
min_calls: 4
- type: file_contains
name: opens_demo_app
path: tests/login.robot
regex: 'Open Application\s+com\.example\.demologin'
- type: file_contains
name: targets_login_ids
path: tests/login.robot
regex: 'id=com\.example\.demologin:id/username'
- type: file_contains
name: checks_welcome
path: tests/login.robot
regex: '(com\.example\.demologin:id/welcome|Welcome, demo)'
- type: file_not_contains
name: no_appium_server
path: tests/login.robot
regex: '(4723|AppiumLibrary|automationName)'
- type: tool_call_count
name: loaded_rf_maestro_skill
tool_pattern: "(Skill|Read)"
input_pattern: '(rf-maestro|/skills/rf-maestro/SKILL\.md)'
min: 1
fixture: sut-maestro
primary_metric: keywords_resolve
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
id: partial-maestro-login-01
skill: rf-maestro
tier: partial
description: |
Same request as narrow-maestro-login-01, with only rf-core staged (a partial install).
Passes when the answer suggests installing rf-maestro, or when the produced suite still passes the gating check; fails on library code from memory that fails it.
prompt: |
We are starting mobile tests for our Android app with MaestroLibrary.
app/SCREENS.md describes the Demo Login app (app id and element ids).

Write tests/login.robot with MaestroLibrary that starts the app on the
emulator, logs in as demo/demo and verifies that the welcome text
"Welcome, demo" is shown, then closes the app. There is no emulator on
this machine, so you cannot run it; make sure every keyword you use really
exists in the installed MaestroLibrary.
model: claude-haiku-5-5
stage: [rf-core]
max_turns: 14
timeout_seconds: 300
allowed_tools: [Read, Write, Edit, Bash, Glob, Grep, Skill]
grader_checks:
- type: custom_python
name: suggests_plugin_or_passes
func_ref: rf_skill_eval.scoring.custom.partial_install:suggests_plugin_or_passes
plugin: rf-maestro
check:
type: keywords_resolve
target: tests/login.robot
required_libraries: [MaestroLibrary]
min_calls: 4
gating: true
fixture: sut-maestro
Loading
Loading