Skip to content
TVIJO / RESEARCH ATLAS 2.0.0-candidate

Hotido.com

Choose a testable configuration for a task. Connect projects, acceptance criteria, benchmarks, and a plan for your own evaluation.

3 projects8 evaluation lenses0 own snapshotsCatalog: 2026-11-09

Evidence-backed OSINT, company links, tender records and bid preparation.

Tasks and decision criteria

Project × evaluation lens

Select a cell: task → acceptance → metric → configuration.

Candidate · plannedUnverifiedReady to testMeasurement existsColor denotes readiness, not a quality score.
Project tasks by evaluation lens. Buttons open details below.
Project / lensProbability & calibrationHow uncertain is the decision, and what is the cost of an error?Numerics & optimizationAre the formulas, constraints and numerical answers correct?Data science & evidenceAre the data and conclusions supported by traceable evidence?Marketing & causal experimentsDoes the product improve qualified conversion and customer value?Unit economics & macro scenariosWhat are contribution, cash flow and sensitivity to external conditions?Management & deliveryAre tasks accepted on time with clear ownership and dependencies?Bounded autonomyWhich authorized actions can finish without intervention?Controlled self-improvementDoes a versioned candidate improve results on protected evidence?
Hotido.com

Matching relationships: 8. On narrow screens, scroll the matrix horizontally.

Hotido.com / Probability & calibration

Calibrated entity and tender decisions

Candidate · planned

Concrete task

Separate link, no-link and review decisions using checked evidence. Minimize false merges under an explicit loss model and evaluate precision with coverage.

Acceptance rule

Proposed gates, to freeze before running: Entity-link precision lower_one_sided_95 ≥ 0.99; Entity-link recall point ≥ 0.8; Upper bound of the paired 95% confidence interval for ΔBrier (Binary event Brier; candidate − FROZEN baseline) ≤ 0. Freeze the baseline identity, version/hash and comparison protocol before any run; without them the comparative gate is not assessed. Insufficient data: not assessed.

What to measure

  • Entity-link precisionfraction · higher is better
  • Entity-link recallfraction · higher is better
  • Binary event Briersquared_probability · lower is better
  • Reliability diagrambin_probabilities · descriptive metric
  • Claim support precisionfraction · higher is better
Expected project impact — hypothesis

Hypothesis: improve accepted tender packs per review hour while monitoring false entity merges. No measured impact yet.

Proposed pilot scope: Isolated evaluation environment

Planned, not an executed run: 200 independent procurement/company · 3 repetitions per unit. Repetitions do not increase independent n.

Proposed pilot: 200 independent units × 3 repetitions. A design starting point, not a power claim or completed work. No measured model winner; scope sandbox_only.

Prepare an experiment
Evidence status matters.

A documented feature, a test candidate, and a measured result are different states. Session cost does not measure success, and coding-agent performance does not establish trading profitability.