Skip to main content
New research note:Parameter Sensitivity: Look for Plateaus, Not Peaks
Validraft
Research & backtests from $79

You have a trading We validate it.

A backtest that looks good isn’t one you can trust yet. Send us your hypothesis — we scope the data, assumptions and checks it needs, then deliver an independent report with the evidence and its limits. Research and final validation are scoped separately, before you commit.

Report deliveredT+46h

PDF reportTrade evidence book

The PDF report and the trade evidence book are posted to your workspace. Every number traces back to the frozen declaration. Optional desk monitoring can start from here.

Stage 7 / 7Workspace: Report uploadedIllustrative workflow · timing confirmed with scope

01of 8: Strategies

Start with a research question

Explore strategy families

Discretionary, systematic and hybrid hypotheses all start the same way: a brief in plain English.

Backtesting is how a trading idea earns trust: replaying a strategy over decades of historical market data to measure how it would have behaved — before any capital is at risk. Validraft is built for rigorous, reproducible quantitative research. You don’t need a fully coded algo: discretionary, systematic, and hybrid hypotheses all start the same way — a brief in plain English.

We first check whether the required data and execution model support the question. We then agree on research, candidate development or final validation. Protected out-of-sample testing applies to a frozen candidate in a supported validation scope. Strategies are grouped by the type of edge they claim — pick a group to see example research questions, or describe your own idea and we’ll scope it.

research-questions.md
[ .MD ]
  1. # Price behavior
  2. - 12-month time-series momentum across CME futures, vol-scaled
  3. - Dual moving-average crossover on ES (50/200)
  4. - Intraday VWAP z-score reversion on ES
  5. - Overnight gap reversion on S&P 500 stocks
  6. - Opening-range breakout on NQ with session filters
  7. - 30-minute ORB on ES with volume confirmation
  8. - Small-cap gap-and-go momentum continuation
  9. - Intraday gap-fill on S&P 500 stocks
  10. # 100 example questions in this group

Example research questions, not results. Each one is scoped against the data on disk before anything runs.

Don’t see your exact approach? Discretionary playbooks and partial rules are exactly what the brief is for — we scope what can be tested honestly before any compute runs.

Browse all strategy families

02of 8: How it works

How it works

Inside the validation engine

Every brief travels the same eight-stage architecture — five layers from immutable, point-in-time data to a signed-off report, held together by a lineage spine that tracks every asset and check.

Your brief
Validation engine
Report

Stage 01 / 08

Brief & scope

Your hypothesis, captured and scoped before any compute runs.

You describe the asset, timeframe, rules, and what success looks like — in plain English. We translate it into a precise, testable specification and confirm data coverage and feasibility, so the engagement is scoped to what the data lake can genuinely support.

  • Hypothesis intake
  • Feasibility review
  • Tier scoping

Touring the stages.

03of 8: Validation report

Validation framework

Frozen, then tested. Never tuned to pass.

Your candidate is frozen before validation starts. It then runs through a fixed sequence of gates in six phases — from data integrity to a named reviewer’s sign-off. Each gate records what it observed against its threshold, and the report renders one verdict.

Principle 01

Scope before compute. Missing material data stops the run at preflight, not in the report.

Principle 02

Freeze before out-of-sample. Parameters, costs and data window are locked before protected evidence opens.

Principle 03

Only what applies. The strategy family decides which gates are required, diagnostic or not applicable.

Principle 04

One decision source. The report renders the pipeline verdict. It cannot recompute or soften it.

validation/checklist.log
[ Illustrative run ]

20-day false-breakout reversal — US equities · Validation · Frozen candidate

Not client data

  1. # Preflight & data integrity

    1. Data qualityNaN 0.02% · duplicates 0 · gaps 0.1%Pass
    2. Corporate actionssplits adjusted · price-only basis · 0 unadjusted gapsPass
    3. Event leakageprice-only rule · no event inputsNot applicable
  2. # Feature & signal diagnostics

    1. Feature redundancy (PCA)single-signal ruleNot applicable
  3. # Performance, benchmark & implementation

    1. Performance thresholdsSharpe 1.31 ≥ 1.20 · max DD 8.4% ≤ 15%Pass
    2. Execution-cost reconciliationspread + commission applied per fillPass
    3. Capacityparticipation 0.4% · headroom 12× ≥ 10×Pass
    4. Benchmark alpha / betainformation ratio 0.42 ≥ 0 · beta 0.08 ≤ 2Pass
  4. # Statistical validation

    1. Multiple-testing-adjusted Sharpe12 trials · adjusted 0.92 ≥ 0.50Pass
    2. Walk-forwardmean test Sharpe 0.84 ≥ 0.70 · 7 of 8 folds positive ≥ 60%Pass
    3. PnL permutationp = 0.012 ≤ 0.05 · 2,000 null pathsPass
    4. Deflated Sharpe / PBODSR 0.98 ≥ 0.97 · PBO 0.07 ≤ 0.10Pass
  5. # Stress & regime robustness

    1. Regime stressstressed-regime Sharpe 0.71 ≥ 0Pass
    2. Historical crises2 windows in the sealed period · no loss in eitherPass
    3. Monte Carlo path riskp95 max DD 13.2% ≤ 30% · expected 9.1% ≤ 20%Pass
  6. # Governance & approval

    1. Reviewer approvalnamed sign-off recordedPass
GO

Decision rendered by the pipeline

14 gates run · 2 not applicable

The verdict

Three outcomes. All three are deliverables.

A GO means every blocking gate passed within the declared scope and a named reviewer signed off. It is not a recommendation to trade, a profitability guarantee, a safety claim or approval for live trading.

  • GO

    Every blocking gate passed and a named reviewer signed off the result.

  • Conditional GO

    Gates passed, but a documented, ticketed threshold override is on record and must be read with the result.

  • NO GO

    At least one blocking gate failed. You still receive the report — which gate, which value, and why.

04of 8: Monitoring

Post-validation monitoring

Keep the accepted baseline in view

A delivered strategy can drift. On the cadence you choose, the desk compares new observations with the baseline in your report and posts a descriptive snapshot to your workspace: health state, rolling Sharpe, drawdown against the stress envelope, and a short note on what changed.

Health

Three health states. Healthy, Watch or Signal decay — always read against the validation baseline in your report.

Cadence

Your cadence. Weekly, monthly or quarterly desk updates, depending on the monitoring plan.

Notes

Descriptive flags. Notes describe drift; they are never trading instructions. No paper or live trading.

validraft.net/dashboard/monitoring

Monitoring

Desk-updated snapshots

Monitored strategies

Select a strategy to open its latest snapshot.

HealthyActive

Opening-range breakout — NQ

Breakout & opening range · Monitor Standard · Weekly

Last update
Next update
2026-05-28
2026-06-04
Sharpe 30d
1.98
+0.33 since 2026-05-21
Sharpe full
1.25
Whole posted window
Max drawdown
-6.9%
Peak to trough
Window return
+9.0%
120 observations
Equity, indexed to 1002026-05-28109.0
Drawdown from peak2026-05-28-0.3%
Rolling Sharpe, 30 observationsFull period 1.252026-05-281.98
The Monitoring page of the client workspace, rendered with sample data. Your workspace shows your own delivered engagements.

05of 8: Data

Data

What the research lake holds

Every brief is tested against the datasets your hypothesis actually needs — price, fundamentals, macro, sentiment and alternative signals, on the same immutable, point-in-time lake our research desk runs. Coverage shows the historical depth held in the lake. When a scope needs a newer window, it is sourced, checked and documented before the engagement is accepted.

3.9TB

of raw market, fundamental, macro and alternative data

260B

records across six providers

36,000

US equity tickers, 23,000 of them delisted

36years

of history, from 1990 to 2026

Rounded figures, counted on 4 November 2026.

Available on request

Listed in provider catalogs, sourced, verified and documented for the scopes that need it.

CME, CBOT, NYMEX and COMEX symbols · Databento
650,000+
US stock quotes, from 2003 · Massive
NBBO
FRED series from 127 sources · FRED / ECB
853,000
more alternative datasets · Quiver
13

Historical depth by provider

[ 1990 → 2026 ]

19902000201020202026
  • Databento1.4 B futures trades
    2012
  • Massive240 B trades
    2003
  • FMP2.5 M files
    1990
  • FRED / ECB230 macro series
    2000
  • FMP News4.2 M news articles
    2015
  • Quiver100,000+ trades
    2023
  • Databento
  • Massive
  • FMP
  • FRED / ECB
  • FMP News
  • Quiver
Databento
Price

Databento

since 2012

CME futures

CME futures data across continuous rolls: minute bars, ticks, L2/L3 order book, and contract metadata.

futures trades
1.4 B
order-book events, ES and NQ
3.2 B
minute bars
92 M
raw data
87 GB

On requestThe full CME Group order book history: L1, L2 and L3 for 650,000+ symbols since 2010.

ESNQCLGCSINGRTYYMZBZNZTMESMNQ
  • OHLCV 1-minute bars · ES/NQ/CL complete; other symbols partial2012
  • Trades · tick data, v.0 and legacy c.0 rolls2025
  • MBP-10 / MBO · ES and NQ order book2026
  • Definitions, statistics, status · contract metadata snapshots2026
Open provider inventory
Massive
Price

Massive

since 2003

US equities

US equity cross-section with trades, minute aggregates, adjusted bars, reference, corporate actions, and processed daily bars.

trades
240 B
minute bars, raw and adjusted
15 B
tickers, 23,000 delisted
36,000
raw data
3.7 TB

On requestNBBO quotes since 2003, US listed options since 2014, forex and crypto since 2009.

  • Trades — daily cross-section · US equities2003
  • Minute aggregates · raw and adjusted2003
  • Corporate actions · splits, dividends, IPOs
  • Fundamentals · ratios, float, short interest, statements
Open provider inventory
Financial Modeling Prep
FXCryptoFundamentals

Financial Modeling Prep

since 1990

Fundamentals & multi-asset markets

The broadest dataset family in the lake: fundamentals, events, ownership, index membership, ETF holdings, FX, crypto, and COT.

files
2.5 M
fundamentals, events and ownership
72 GB
dataset families
14

On requestEarnings call transcripts, SEC filings, intraday bars and ESG ratings.

  • Company fundamentals · annual, quarterly, TTM statements2003
  • Analyst coverage · estimates, grades, price targets
  • Earnings · calendar and surprises
  • Ownership · 13F, institutional, insider trades
  • Index and ETF data · constituents, delisted, holdings, weightings
  • FX, crypto, macro, COT · multi-asset and derivatives context1990
Open provider inventory
FRED, ALFRED, and ECB
Macro

ALFRED / FRED / ECB

since 2000

Macroeconomic indicators

Vintage-aware macro data: 230 FRED/ECB series with point-in-time layouts for regime and macro overlays.

macro series
230
vintage observations
12 M

On requestAny of FRED's 853,000 series from 127 sources, with vintages where ALFRED keeps them.

  • Vintage macro series · 230 FRED/ECB series2000
  • Treasury and policy rates · FRED / ALFRED
  • ECB macro series · European macro context
  • Derived macro regimes · processed features where materialized
Open provider inventory
Financial Modeling PrepFinBERT
Sentiment

FMP News

since 2015

News & sentiment

FMP news streams across equities, press releases, forex, macro, and crypto, then locally classified with FinBERT sentiment scoring.

news articles
4.2 M
news streams
5
  • Stock news2015
  • Press releases2019
  • Forex news2018
  • General news2020
Open provider inventory
Quiver Quantitative
Alternative

Quiver Quantitative

since 2023

Congressional trading

Congressional trading exports preserved as snapshots and normalized into event ledgers for alternative-data tests.

trades
100,000+

On request13 more datasets, from insider trades and corporate lobbying to government contracts and patents.

  • Congressional trades · normalized event ledger2023
  • Workbook snapshots · immutable XLSX source snapshots
Open provider inventory

Need data we don’t hold yet?

Tell us what the hypothesis needs. If the feed is available and licensable, we source it, ingest it into the research lake, and document the data assumptions before validation starts.

See full data terms

Planned, not yet in the lake

Next provider integrations

These feeds are not part of the active lake yet. They are the next provider candidates we plan to evaluate, license where required, normalize, and document before they can be used in validation.

  • Benzinga
    News

    Benzinga

    News stream · Analyst and ratings events · Earnings calendar

  • ORATS
    Options

    ORATS

    Options chains · IV history · Greeks and surfaces

  • OANDA
    FX

    OANDA

    Spot FX · Historical rates · Currency metadata

  • CoinAPICoinAPI
    Crypto

    CoinAPI

    Trades · OHLCV · Exchange reference

  • PolymarketKalshi
    Validraft dataset

    Prediction Markets

    Market metadata · Odds history · Resolution history

Provider names and marks are shown for identification only. Validraft is independent and not affiliated with or endorsed by the listed providers. Coverage shown reflects the current research lake; some feeds refresh on demand for scoped engagements.

06of 8: Confidentiality

Privacy & confidentiality

Your edge is not training data, marketing copy, or a shared benchmark.

A trading hypothesis can be the most sensitive thing you send us. Validraft separates two ideas clearly: personal data is handled under the privacy notice, and strategy materials are treated as confidential engagement materials by default.

Scope

Strategy materials stay scoped. Briefs, parameters, files, reports, and monitoring notes stay tied to the engagement they came from.

Reuse

No public reuse of your logic. Client hypotheses are not added to a public template library, marketing example, or cross-client benchmark.

Delivery

Private report delivery. Reports and workspace updates are delivered through authenticated access or agreed private channels.

NDA

NDA path for sensitive work. Standard briefs stay lightweight; sensitive business, Tier C, or institutional scopes can move under NDA before details are shared.

Data surfaces we design around

  • Brief intake and feasibility notes
  • Submitted files, parameters, and assumptions
  • Generated reports, run metadata, and messages
  • Workspace access, support, billing, and security logs

Operational practices

  • TLS in transit for website, brief intake, workspace access, and report delivery
  • Least-privilege internal access to engagement materials
  • Per-engagement separation for briefs, runs, reports, and monitoring context
  • No sale of client personal data or submitted strategy materials
  • Published privacy notice and optional analytics controls

07of 8: Positioning

Positioning

Between a self-service tool and a blank-check consulting project.

Validraft is built for the moment when a backtest looks promising, but you need an independent desk to test whether the evidence survives proper validation.

Self-serviceDone-for-youBespoke

Validraft position. Human judgment where it matters, standardized validation where it must be repeatable.

DIY backtest tools

You operate everything

Flexible if you already own the pipeline, but every data bug, look-ahead issue, and overfit parameter choice is yours to catch.

  • You build and maintain the validation stack
  • Robustness checks depend on what you remember to run
  • Fast iteration, but no independent read on the result

Validraft

Our approach

Independent validation desk

Human-scoped validation, institutional gates, and a descriptive report without turning the engagement into open-ended consulting.

  • Feasibility review before compute starts
  • 72+ scoped controls across data, stats, stress, risk, and lineage
  • Confidential by default; no public reuse of your logic
  • Research-only language, never trade recommendations

Generic quant consultants

Custom research project

Useful for bespoke build-outs, but often heavier, slower, and harder to compare because methodology changes engagement by engagement.

  • Long scoping cycles before evidence appears
  • Opaque or inconsistent gate coverage
  • Can drift into advisory language if boundaries are unclear
Validraft compared with DIY tools and consultants
Best fitDIY tools:Builders who want full controlValidraft:Founders, traders, and managers who need an external validation readConsultants:Bespoke research or platform build-outs
Client effortDIY tools:HighValidraft:Brief-drivenConsultants:High-touch
Validation gatesDIY tools:Whatever you implementValidraft:Standardized control stackConsultants:Variable by engagement
Delivery modelDIY tools:Self-service toolValidraft:Scoped reportConsultants:Open-ended project

08of 8: Research notes

Research notes · Latest field notes

The machinery behind a defensible backtest.

Field notes on evidence quality: from point-in-time data and execution realism to statistical gates, immutable reporting, and post-validation monitoring.

View all notes

Next step

Your hypothesis. Independently validated.

Start with a sample, then ask whether your question is feasible. We agree on the analysis, data, price and delivery before any work starts.

72

Public controls

Documented on the methodology page

6

Validation phases

From data integrity to sign-off

3

Possible outcomes

Each one is a deliverable

$79

Starting price

Research and backtests, scoped first