Method Audit
Can your backtest stand up to scrutiny? We check the method behind a strategy backtest or performance claim using pre-registration, multiple-testing correction, placebo controls and in-sample/out-of-sample consistency.
What you receive
- A PDF report with a one-line conclusion, methods, results including failures and non-significant findings, and limitations.
- A reproducibility package with scripts, a data inventory and hashes.
- An itemized PASS / FAIL / UNKNOWN checklist with the numbers supporting each finding. Missing evidence remains UNKNOWN.
What you provide
- A strategy description with explicit rules, the backtest period and a trade or return series, which may be de-identified.
- The number of parameters or versions you have tried, needed for multiple-testing correction.
- Start with a short description. Do not email account credentials, account statements or personal identifiers. Data transfer and confidentiality arrangements must be agreed before you send a dataset.
Who this is for
- Quantitative traders, small teams and creators who have a strategy claim to examine.
- We do not review personal holdings or personal profit and loss, provide trading or allocation advice, or manage accounts, and we do not guarantee performance.
Process and timing
- 1. Email a short description of the strategy claim.
- 2. We confirm the scope and provide a quote within 1 business day.
- 3. Work starts after you agree to the scope and pay an invoice issued by the founder. This is separate from the research subscription.
- 4. Delivery is planned for 5 business days after the agreed scope, required data and payment are in place.
- 5. One clarification exchange follows delivery.
- No price is listed here. Email us about scope; payment is not available on this page.
Limits and disclosure
- This service checks methodology; it does not establish future returns. Findings depend on the data you provide.
- General research information, not personalized and not investment advice. No account management.
- The service terms and privacy policy are linked below.
Method Audit FAQ
Does PASS establish future profitability?
No. PASS applies to the stated method check and supplied data. It does not establish future returns.
What if the evidence is incomplete?
The checklist marks the unresolved item UNKNOWN and explains what evidence is missing.
Is this included in a research subscription?
No. Method Audit is a separate scoped service. A quote and your agreement come before work begins; invoicing is handled by the founder.
How will my data be handled?
Data is handled confidentially, kept out of public repositories and not used to train models. We delete it 30 days after delivery unless the agreed data arrangement sets a different period. Agree the data arrangements before sharing a dataset.
Can I pay on this page?
No. Email us or book a demo to talk about scope. Please do not attach a dataset yet.
Read the service terms and privacy policy before sharing data.