CB orca-lp
Full-stack Orca Whirlpool agent — read-only pool analytics (discovery, ranking, 6-month stability, range sizing, Monte Carlo projection, retrospective yield, rebalance planning, exit planning) plus on-chain liquidity management (open, increase, decrease, collect fees, close, swap). Wallet only required for intentional writes.
As a process B 66/100 · Nearly there — weak spots: result and completion, consistency, execution cost
How to improve
- Say in the description WHEN to use the skill ("use when…", example requests): that is the agent's main cue.
- The SKILL.md body is over 5,000 tokens: move reference detail into references/ and load it when needed.
- Your own cases (evals/evals.json, 4–6 real requests with expected answers): the full check would then run those instead of a model-drafted suite.
- A spec.yaml with trigger phrases and assertions — a behaviour contract for CI; `skilltest init` writes a template.
Guard findings · 26
✓ No critical or high findings
Medium and low: 26
-
low Secrets in code
secret-high-entropy-tokenexamples/lp-range-analysis.md:11High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file)npx tsx lp-range-analysis.ts Czfq…4zE
fixture -
low Secrets in code
secret-high-entropy-tokenexamples/lp-range-analysis.md:205High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file)Analyzing SOL/USDC (0.04% fee, tickSpacing=4) — Czfq…4zE
fixture -
low Secrets in code
secret-high-entropy-tokenexamples/monitor-pool.md:11High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file)npx tsx monitor-pool.ts Czfq…4zE 15 40
fixture -
low Secrets in code
secret-high-entropy-tokenexamples/monitor-pool.md:152High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file)Monitoring pool Czfq…4zE
fixture -
low Secrets in code
secret-high-entropy-tokenexamples/open-position.md:31High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file; quoted — discussed, not commanded)const SOL_USDC_POOL = new PublicKey("Czfq…4zE");fixturequoted -
low Secrets in code
secret-high-entropy-tokenexamples/open-position.md:201High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file)Pool: Czfq…4zE
fixture -
low Secrets in code
secret-high-entropy-tokenexamples/pair-discovery.md:199High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file; quoted — discussed, not commanded)const BONK_MINT = "DezX…263";
fixturequoted -
low Secrets in code
secret-high-entropy-tokenexamples/pool-detail.md:11High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file)npx tsx pool-detail.ts Czfq…4zE
fixture -
low Secrets in code
secret-high-entropy-tokenexamples/pool-detail.md:128High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file)Address: Czfq…4zE
fixture -
low Secrets in code
secret-high-entropy-tokenexamples/price-range-history.md:192High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file)Address: Czfq…4zE
fixture -
low Secrets in code
secret-high-entropy-tokenexamples/quote.md:24High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file; quoted — discussed, not commanded)SOL: { address: "So11…112", decimals: 9 },fixturequoted -
low Secrets in code
secret-high-entropy-tokenexamples/quote.md:25High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file; quoted — discussed, not commanded)USDC: { address: "EPjF…t1v", decimals: 6 },fixturequoted -
low Secrets in code
secret-high-entropy-tokenexamples/quote.md:26High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file; quoted — discussed, not commanded)USDT: { address: "Es9v…NYB", decimals: 6 },fixturequoted -
low Secrets in code
secret-high-entropy-tokenexamples/quote.md:27High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file; quoted — discussed, not commanded)ORCA: { address: "orca…tZE", decimals: 6 },fixturequoted -
low Secrets in code
secret-high-entropy-tokenexamples/quote.md:28High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file; quoted — discussed, not commanded)BONK: { address: "DezX…263", decimals: 5 },fixturequoted -
low Secrets in code
secret-high-entropy-tokenexamples/range-projection.md:171High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file)Address: Czfq…4zE
fixture -
low Secrets in code
secret-high-entropy-tokenexamples/swap.md:37High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file; quoted — discussed, not commanded)const SOL_USDC_POOL = new PublicKey("Czfq…4zE");fixturequoted -
low Secrets in code
secret-high-entropy-tokenexamples/swap.md:38High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file; quoted — discussed, not commanded)const SOL_MINT = new PublicKey("So11…112");fixturequoted -
low Secrets in code
secret-high-entropy-tokenexamples/swap.md:98High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file; quoted — discussed, not commanded)const usdcMint = new PublicKey("EPjF…t1v");fixturequoted -
low Secrets in code
secret-high-entropy-tokenexamples/swap.md:123High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file)Wallet: 69Hb…X4v
fixture -
low Secrets in code
secret-high-entropy-tokenexamples/yield-projection.md:238High-entropy token-like string (may be an id, hash or a credential) (test fixture / example file)SOL/USDC (0.04% fee) — Czfq…4zE
fixture -
low Secrets in code
secret-high-entropy-tokenSKILL.md:350High-entropy token-like string (may be an id, hash or a credential) (quoted — discussed, not commanded)const SOL_MINT = new PublicKey("So11…112");quoted -
low Secrets in code
secret-high-entropy-tokenSKILL.md:633High-entropy token-like string (may be an id, hash or a credential) (quoted — discussed, not commanded)**Whirlpool program ID**: `whir…yCc` (same on mainnet + devnet).
quoted -
low Secrets in code
secret-high-entropy-tokenSKILL.md:793High-entropy token-like string (may be an id, hash or a credential) (documentation table row)| SOL/USDC | 0.04% | `Czfq…4zE` |
table -
low Secrets in code
secret-high-entropy-tokenSKILL.md:794High-entropy token-like string (may be an id, hash or a credential) (documentation table row)| USDC/USDT | 0.01% | `4fuU…4T4` |
table -
low Secrets in code
secret-high-entropy-tokenSKILL.md:795High-entropy token-like string (may be an id, hash or a credential) (documentation table row)| SOL/JitoSOL | 0.01% | `Hp53…QKp` |
table
Files scanned: 18. Evidence is masked. Grey chips explain why severity was lowered.
Against the Agent Skills spec
- warning
description-no-whendescription does not say WHEN to use the skill (no "use when") - warning
body-longSKILL.md body ≈ 13790 tokens (recommended < 5000); move details to references/
Process rating: all ten parameters 66/100
- 0Result and completion. Does not say what the result is
- 30Running it twice. 21 mutating operations with no state check
- 40Consistency. Frontmatter name (orca-lp) differs from the folder (orca-lp-analytics)
- 40Execution cost. Instruction body is 13790 tokens: crowds the task out of the window
- 50When it triggers. No condition that starts the skill
- 70Inputs and preconditions. Inputs and preconditions are listed
- 100Tools and files. Tools declared in frontmatter
- 100Steps. 192 steps
- 100Failures and branches. 9 branches, has a failure section
- 100Progress reporting. Reports progress
- medium Safety rules and hard prohibitions inside a skill: they belong in the system prompt, here they protect nothing
- low 19 top-level sections: this looks like several domains in one skill
- low The response is described with custom markup (10 tags): a typed call is more reliable
Everything here is measured from the skill text rather than judged by a model, so the numbers are checkable. A parameter weighs more when it is a more common reason for the process to stall.
Quality signals
- +5Description has no quoted example phrases that should trigger the skill
- +4Description does not say when NOT to use the skill (false activations)
- +3Output format is not stated: the model decides each time
- +2Single-language instructions
- +3Description length 327: enough signal without eating the budget
- +4Structure: 57 headings
- +3Step-by-step instructions: 192 items
- +4Has examples (21 code blocks)
- +1License stated
Quality base 70; lint remarks subtract, signals add up to 100. Result: 63.