Public Review
Candidate reviews research lanes, program summaries, and boundaries.
A selective applied research environment for capable AI systems researchers, benchmark operators, quant researchers, research assistants, technical builders, and advanced operators who can help test, document, benchmark, and improve the systems Source is building.
Source Research Lab is the applied research and benchmark layer behind Source’s AI systems, Source University, market systems research, technical infrastructure, and operator workflows. Its purpose is to test whether the systems actually work: whether AI tutors improve learning, whether agent harnesses improve execution, whether RAG systems retrieve accurate source material, whether dashboards expose useful state, whether premium data workflows improve research quality, whether backtests are honest, and whether telemetry reveals failures early.
Test AI tutors, agents, RAG, model workflows, local inference, hallucination mitigation, and dashboards.
Test data feeds, backtesting, simulations, broker/exchange maps, risk dashboards, and telemetry.
Turn vague capability into measurable reports, scorecards, audits, and reproducible experiments.
Work with controlled access to custom harnesses, local inference, servers, dashboards, and configurations.
Produce structured reports, research memos, QA artifacts, benchmark datasets, and dashboards.
Access is scoped, project-based, monitored, permissioned, and strictly tied to useful research outputs.
Understand the distinction: Source University is built for capability development, while the Research Lab focuses on rigorous system evaluation, benchmarking, and failure testing.
Focuses on teaching, training, and building the operational competence of candidates within defined tracks.
Focuses on testing, auditing, validating, and documenting the boundaries, limits, and failures of active systems.
Source University asks: Can this person learn the system? • Source Research Lab asks: Can this person help prove whether the system works?
The Source Research Lab parent page routes qualified candidates into two major research lanes. Each lane has its own deeper page, research programs, infrastructure layer, application questions, and proof-of-work expectations.
Evaluate Source’s AI tutors, agent harnesses, RAG corpora, model workflows, dashboards, local inference labs, and proprietary AI systems.
Built for AI systems researchers, research assistants, technical builders, LLMOps/MLOps operators, agent testers, and benchmark operators.
Evaluate premium data workflows, market data pipelines, backtesting integrity, simulations, broker/exchange maps, AI market research agents, and risk dashboards.
Built for quant researchers, market systems researchers, data scientists, AI-assisted research builders, risk analysts, and benchmark operators.
*Note: These pages represent research lanes and will be deployed as separate deep-dive pages after parent qualification.
Source Research Lab organizes work into research programs. Below is a preview of the program map across the two lanes. Detailed dashboards are located inside each lane page.
Tests whether AI tutors, founder guidance, structured assignments, and review loops improve real operator capability.
Tests whether custom Pi harnesses, Codex workflows, Claude Code, Hermes multi-terminal setups, and OpenClaw automation improve pipeline reliability.
Tests retrieval precision, recall, citation faithfulness, hallucination behavior, chunking, embeddings, and rerankers.
Tests whether vertical corpora power useful specialist AI consultants, diagnostics, and assessments.
Tests QA gates, validation scripts, human review queues, and failure taxonomies.
Tests whether consoles expose state, queue bottlenecks, costs, and next actions clearly.
Tests lead lifecycle systems, approval gates, reply classification, and source attribution.
Tests branch variants, layer-locking, multi-agent critique loops, and convergence telemetry.
Tests which models handle which tasks, comparing cost, latency, quality, and routing policies.
Tests whether SOPs, mistake logs, and decision logs improve AI/human execution consistency.
Tests Bloomberg-style, LSEG-style, alternative, and alternative on-chain data workflows.
Tests lookahead bias, survivorship bias, leakage, overfitting, slippage, and false robustness.
Tests how hypotheses become documented research, backtests, simulations, and review loops.
Tests whether AI agents can summarize markets, review strategies, and detect assumptions.
Tests drawdowns, limits, leverage exposure, kill switches, and operator visibility controls.
Tests broker disconnects, order rejections, partial fills, slippage, and readiness thresholds.
Maps broker APIs, exchange APIs, FIX endpoints, order states, fills, and reconciliation.
Tests Sharpe, Sortino, drawdown expectancy, win rate, slippage, and strategy degradation.
Tests journaling, rule adherence, override logs, review loops, and behavior drift metrics.
Tests logs, metrics, traces, data-feed health dashboards, and incident reviews.
The appeal of Source Research Lab is the environment: controlled, qualification-based access to serious tools, custom systems, compute resources, and data workflows.
Selected researchers may work with proprietary Source configurations, confidential research workflows, custom harness environments, internal evaluation templates, private corpora, and experimental systems developed by the Source research team. Access is qualification-based and scoped by project.
Access to premium data, terminals, paid datasets, or institutional systems is not guaranteed and may depend on project scope, licensing, availability, qualification, and approval.
Researchers may work with local inference labs and private model deployments rather than only using consumer chat interfaces.
Selected researchers may work with frontier and open-source model workflows, custom routing setups, local inference systems, coding agents, and evaluation protocols. Access is controlled, project-scoped, and subject to availability, cost, licensing, and approval.
Researchers may help evaluate whether custom-tuned, retrieval-grounded, or domain-specialized models outperform generic frontier models on Source-specific tasks.
Source is interested in neuron-level hallucination mitigation research, including hallucination-associated neuron detection, activation steering, local model intervention experiments, groundedness evaluation, and reliability benchmarking.
Researchers may work inside custom Pi-style harness environments where AI agents are assigned, observed, logged, benchmarked, corrected, and compared across controlled execution runs.
Market systems research is simulation-first and paper-trading-first. This is not investment advice, a signals service, a profit guarantee, a funding guarantee, or a live-trading promise.
The most valuable research environment is not any single tool. It is the composition of proprietary Source configurations, premium data, local inference, frontier models, custom harnesses, RAG corpora, telemetry, dashboards, and human review into controlled experimental systems.
“The most valuable research environment is not any single model, terminal, tool, server, or dashboard. It is the composition of proprietary Source configurations, local inference, frontier models, custom harnesses, premium data workflows, RAG corpora, telemetry, dashboards, benchmark protocols, and human review into controlled experimental systems.”
Not all Source Research Lab infrastructure is publicly described. Certain technologies, configurations, internal benchmarks, private datasets, custom harnesses, model workflows, dashboard concepts, research templates, and experimental systems are intentionally held back from the public page. Selected researchers may be introduced to additional systems only after qualification, project assignment, confidentiality review, and access approval.
This is not passive reading. Selected researchers are assigned targeted testing tasks designed to validate the reliability, cost, and efficiency of Source's stack.
Compare models, custom tool setups, workflows, data feeds, and RAG architectures under identical benchmark criteria.
Document hallucinations, retrieval failures, broken assumptions, data feed gaps, and strategy drawdowns.
Write structured research memos, scorecard evaluations, and audit logs detailing system limits.
Assess whether dashboards communicate real-time system state, exposure levels, and failure alerts clearly.
Monitor tutor explanation metrics, agent automation pass rates, and human verification queues.
Map broker WebSocket streams, test exchange order latency, and verify data-feed alignment.
Identify gaps in SOPs, mistake logs, and runbooks, organizing them into retrieval-ready formats.
Compile verified code sandboxes, benchmark datasets, and visual systems maps.
We measure value strictly by output. Researchers demonstrate progress by delivering clear, reproducible reports and data scorecards that improve the Source codebase.
Evaluation matrices comparing AI mentor explanation accuracy.
Logs detailing trace paths, API cost thresholds, and loop failures.
Metrics testing chunking methods, vector lookups, and recall gaps.
Verifications of pipeline logs against authoritative market datasets.
Assessments targeting survivorship bias, leakage, and slippage fees.
Every formal research memo submitted to the lab is structured to include:
Not every researcher receives access to every system. Source Research Lab access is qualification-based, project-scoped, permissioned, staged, revocable, and confidentiality-bound.
Candidate reviews research lanes, program summaries, and boundaries.
Candidate submits background details, desired lane, and proof-of-work.
Source evaluates technical fit, logical clarity, and confidentiality readiness.
Candidate matched to specific, scoped RAG, model, or database projects.
Researcher receives scoped access keys for target compute tools.
Researcher submits structured memos, code runs, and scorecards.
Strong candidates evaluated for paid collaboration or deeper tasks.
Access Bounds Rationale: Selected researchers may receive controlled, qualification-based access to Source research environments, configurations, custom harnesses, private corpora, model workflows, and dashboards depending on project fit, approval, licensing, confidentiality, and availability.
Certain technologies, internal benchmarks, and experimental setups are held back from public visibility and may only be discussed with qualified candidates after review. Access to compute, terminals, paid APIs, local inference setups, or frontier models is not guaranteed.
Source Research Lab requires rigorous research discipline and structured reports. Read the requirements below to verify if your background matches our fit parameters.
Candidates who demonstrate technical curiosity, systematic documentation habits, and a willingness to verify assumptions.
We screen out candidates looking for quick solutions, passive tutorials, or signals trading systems.
Source Research Lab maintains rigorous compliance gates to ensure data security, legal safety, and realistic outcome targets.
This is an applied research layer. Participating in benchmark testing or submitting memos does not guarantee employment, paid fellowships, or contract engagements.
Compute resources, alternative data feeds, and frontier API access are project-scoped and qualification-gated. We do not provide free compute for general use.
We provide no introductory tutorials on python syntax or prompting basics. Researchers must have prior technical context or high capacity to self-learn.
Trading involves substantial risk. AI does not remove risk. Machine learning does not guarantee performance. Backtesting does not guarantee live results. Simulation does not guarantee execution quality. Premium data does not guarantee profitable decisions. No strategy is guaranteed to work.
The market systems research lane is research-focused, benchmark-focused, simulation-focused, paper-trading-first, and systems-focused. It is not investment advice, not a signals service, not a guaranteed-profit program, not a funding guarantee, and not a live-trading promise.
We evaluate candidates based on structured technical parameters. Prepare your responses for these core questions before submitting an application.
Clarifying operational details, access stages, and researcher guidelines for Source Research Lab.
If you are serious about helping test, benchmark, document, and improve advanced AI systems, agent harnesses, RAG corpora, model workflows, dashboards, market data pipelines, premium data workflows, backtesting systems, simulations, risk dashboards, and telemetry systems, you may apply for Source Research Lab review.