Benchmark Results
Run
node benchmark/install-speed.jsto reproduce on your machine.Environment: Node.js v22.18.0, macOS Fixture (local): SKILL.md + 1 JS file (2 files, 78 bytes) Fixture (GitHub):
sametcelikbicak/task-decomposerIterations: 10 per tool per scenario
Local path install
| Tool | avg | min | max | p50 | vs rolecraft |
|---|---|---|---|---|---|
| rolecraft | 9.83 ms | 5.16 ms | 15.23 ms | 9.60 ms | 1.00x |
| skills (Vercel) | 4263.29 ms | 3964.79 ms | 4960.78 ms | 4267.36 ms | 433.78x |
| @agentskill.sh/cli | — | — | — | — | N/A |
@agentskill.sh/cliis marketplace-only and does not support local paths.
GitHub install (sametcelikbicak/task-decomposer)
| Tool | avg | min | max | p50 | vs rolecraft |
|---|---|---|---|---|---|
| rolecraft | 4186.74 ms | 3499.20 ms | 4843.22 ms | 4380.64 ms | 1.00x |
| skills (Vercel) | 10024.51 ms | 8668.28 ms | 11556.99 ms | 9986.56 ms | 2.39x |
| @agentskill.sh/cli | — | — | — | — | failed |
@agentskill.sh/clifetches the skill but exits withError: Unknown agent: antigravity-cliduring the agent detection phase. The install does not complete successfully.
Key takeaways
| Scenario | rolecraft | Vercel skills | @agentskill.sh/cli |
|---|---|---|---|
| Local skill install | ✅ 9.83 ms | ✅ 4263 ms (434x slower) | ❌ not supported |
| GitHub skill install | ✅ 4.2 s | ✅ 10.0 s (2.4x slower) | ❌ fails (bug) |
| Zero dependencies | ✅ 0 | ❌ 1 dep | ❌ 2 deps |
| Package size | ~4 KB | ~465 KB | ~84 KB |
