26-data-wise-scholar-skills-research-cross-disciplinary-ideation

brycewang-stanford/Auto-Empirical-Research-SkillsResearchAudit pendingSnapshot 0436376d4bfe

Summary

This source did not publish a separate summary. Review SKILL.md before using the skill.

SKILL.md

Cross-Disciplinary Ideation

Systematic framework for discovering statistical innovations through cross-field connections

Use this skill when: brainstorming new methods, seeking novel approaches to statistical problems, looking for inspiration from other fields (physics, CS, biology, economics), or wanting to apply techniques from one domain to another.

The Cross-Disciplinary Innovation Framework

Why Cross-Disciplinary?

Many statistical breakthroughs originated elsewhere:

Statistical Method	Origin Field	Transfer
MCMC	Physics (Metropolis)	Statistical computation
Boosting	Machine learning	Ensemble methods
Lasso	Signal processing	Sparse regression
Optimal transport	Mathematics	Distribution comparison
Neural networks	Neuroscience/CS	Flexible function estimation
Causal graphs	Philosophy/AI	Causal inference

The Innovation Cycle

Problem in Statistics → Abstract Structure → Search Other Fields
         ↑                                           ↓
    Validate/Adapt ←── Identify Analogues ←── Find Connections

Machine Learning Connections

Deep Learning for Causal Mediation

ML Method	Statistical Application	Transfer Opportunity
Double ML	Debiased mediation effects	Nuisance parameter estimation
Causal Forests	Heterogeneous mediation

# Double ML for mediation effect estimation
library(DoubleML)

# Estimate nuisance parameters with ML
estimate_dml_mediation <- function(Y, A, M, X) {
  # First stage: E[M|A,X]
  mediator_model <- cv.glmnet(cbind(A, X), M)
  M_hat <- predict(mediator_model, cbind(A, X))

  # Second stage: E[Y|A,M,X]
  outcome_model <- cv.glmnet(cbind(A, M, X), Y)

  # Debiased estimation
  residuals_M <- M - M_hat

  list(
    direct = coef(outcome_model)["A"],
    indirect_component = residuals_M
  )
}

Statistical Concept	Physics Analogue	Insight
Log-likelihood	Energy	MLE = minimum energy state
Posterior	Boltzmann distribution	Temperature = uncertainty
Regularization	Physical constraints	Penalties as forces
Entropy	Thermodynamic entropy	Information = disorder
Diffusion models	Brownian motion	Noise as generative process
MCMC	Molecular dynamics	Sampling as physical simulation

Algorithm Class	Statistical Application	Key Insight
Dynamic Programming	Sequential mediation	Bellman equation for path effects
Graph Algorithms	DAG analysis	d-separation via path finding
Approximation Algs	High-dim inference	Trade exactness for scalability
Online Learning	Sequential testing	Adaptive experiment design
Randomized Algs	Monte Carlo methods	Probabilistic computation

# Dynamic programming for sequential mediation paths
compute_path_effects <- function(effect_matrix, n_mediators) {
  # effect_matrix[i,j] = effect from node i to node j
  n <- nrow(effect_matrix)

  # Initialize path effects (like shortest path, but products)
  path_effects <- matrix(0, n, n)
  diag(path_effects) <- 1

  # DP recurrence: path[i,j] = sum over k of path[i,k] * edge[k,j]
  for (len in 1:n_mediators) {
    for (i in 1:n) {
      for (j in 1:n) {
        for (k in 1:n) {
          if (effect_matrix[k, j] != 0) {
            path_effects[i, j] <- path_effects[i, j] +
              path_effects[i, k] * effect_matrix[k, j]
          }
        }
      }
    }
  }

  path_effects
}

Statistical Concept	CS Analogue	Insight
Estimation	Optimization	Different objectives, shared algorithms
Hypothesis testing	Decision theory	Error rates as costs
Model selection	Algorithm selection	Bias-variance as time-space
Bayesian updating	Online learning	Sequential information
Sufficient statistics	Data compression	Minimal representation
Concentration inequalities	PAC bounds	Finite-sample guarantees

Statistical Concept	Economics Analogue	Insight
Utility	Loss function	Preferences over outcomes
Equilibrium	MLE/Bayes	Optimal response
Game theory	Robust statistics	Adversarial settings
Mechanism design	Experimental design	Incentive-compatible elicitation
Instrumental variables	Market instruments	Exogenous variation
Regression discontinuity	Policy thresholds	Quasi-experiments

Biological System	Statistical Method	Research Opportunity
Gene regulatory networks	Causal DAGs	Network mediation methods
Mendelian randomization	Instrumental variables	Genetic instruments for mediators
Population genetics	Drift models	Selection effects on mediators
Systems biology	Structural equations	Multi-level mediation
Phylogenetics	Hierarchical models	Evolutionary mediation

# Mendelian randomization for mediation
# Using genetic variants as instruments
mr_mediation <- function(snp, exposure, mediator, outcome) {
  # Stage 1: SNP -> Exposure
  gamma_A <- coef(lm(exposure ~ snp))["snp"]

  # Stage 2: SNP -> Mediator (genetic effect on M)
  gamma_M <- coef(lm(mediator ~ snp + exposure))["snp"]

  # Stage 3: Instrument-based mediation
  # Indirect via genetic pathway
  iv_model <- ivreg(outcome ~ mediator + exposure | snp + exposure)

  list(
    genetic_effect_exposure = gamma_A,
    genetic_effect_mediator = gamma_M,
    iv_mediation_estimate = coef(iv_model)["mediator"] * gamma_M
  )
}

Statistical Concept	Biology Analogue	Insight
Genetic algorithms	Evolution	Optimization by selection
Phylogenetics	Hierarchical models	Tree-structured dependence
Gene networks	Graphical models	Conditional independence
Population dynamics	Time series	Growth and interaction
Mendelian randomization	Instrumental variables	Genetic instruments
Selection bias	Survivorship	Conditioning on survival

Statistical Concept	Math Analogue	Insight
Distributions	Measures	Abstract probability
Convergence	Topology	Modes of convergence
Sufficiency	Invariance	Group actions
Efficiency	Geometry	Information geometry
Optimal transport	Measure theory	Wasserstein distance
Kernel methods	Functional analysis	RKHS theory

Problem: "Estimate mediation effects with measurement error"

Components:
1. Causal structure (DAG with mediator)
2. Latent variable (true M vs observed M*)
3. Identification (what assumptions needed?)
4. Estimation (how to account for error?)
5. Inference (variance under misspecification?)

Abstract patterns in measurement error mediation:
- Signal + noise model
- Latent variable with proxy
- Product of uncertain quantities
- Attenuation toward null

Pattern	Field to Search	Possible Analogues
Signal + noise	Signal processing	Kalman filter, denoising
Latent variable	Factor analysis	EM algorithm, identifiability
Product of uncertainties	Physics	Error propagation, Heisenberg
Attenuation	Econometrics	Errors-in-variables, IV

Evaluation Criteria:
□ Does it solve a real problem?
□ Is it novel (not already done)?
□ Are assumptions reasonable?
□ Is it computationally feasible?
□ Can it be proven to work (theory)?
□ Does it work in practice (simulation)?

## Connection: [Source Method] → [Target Application]

### Source Domain
- **Method**: [Name and citation]
- **Problem it solves**: [Description]
- **Key insight**: [Core idea]
- **Assumptions**: [What it requires]

### Target Domain
- **Problem**: [Statistical problem to solve]
- **Current approaches**: [Existing methods and limitations]
- **Gap**: [What's missing]

### Transfer Analysis
- **Structural correspondence**:
  - [Source concept] ↔ [Target concept]
  - [Source assumption] ↔ [Target assumption]

- **What transfers directly**: [List]
- **What needs modification**: [List]
- **What doesn't transfer**: [List]

### Proposed Innovation
- **Core idea**: [How to adapt]
- **Novel contribution**: [What's new]
- **Theoretical questions**: [What to prove]
- **Empirical questions**: [What to simulate]

### Feasibility Assessment
- [ ] Theoretically sound
- [ ] Computationally tractable
- [ ] Practically relevant
- [ ] Sufficiently novel
- [ ] Publishable venue: [Journal]

### Next Steps
1. [Immediate action]
2. [Follow-up]
3. [Validation approach]

Source Field	Method/Concept	Target Application	Innovation Potential
ML	Double/debiased ML	Semiparametric mediation	High - removes regularization bias
ML	Causal forests	Heterogeneous effects	High - effect modification detection
Physics	Diffusion models	Distribution products	Medium - novel density estimation
Economics	Control functions	Endogenous mediators	High - relaxes assumptions
CS	Sketching algorithms	Large-scale mediation	Medium - computational gains
Biology	Network motifs	Mediation topology	Medium - pattern recognition

# Transfer: Control functions from economics to mediation
# Relaxes sequential ignorability assumption
control_function_mediation <- function(Y, A, M, X, Z) {
  # Z is instrument for A

  # First stage: A on Z and X
  stage1 <- lm(A ~ Z + X)
  A_residual <- residuals(stage1)

  # Second stage with control function
  # Includes residual to correct for endogeneity
  stage2 <- lm(M ~ A + X + A_residual)

  # Third stage: outcome with control
  stage3 <- lm(Y ~ A + M + X + A_residual)

  list(
    a_to_m = coef(stage2)["A"],
    m_to_y = coef(stage3)["M"],
    indirect = coef(stage2)["A"] * coef(stage3)["M"],
    control_function_coef = coef(stage2)["A_residual"]
  )
}

26-data-wise-scholar-skills-research-cross-disciplinary-ideation

Summary

Cross-Disciplinary Ideation

The Cross-Disciplinary Innovation Framework

Why Cross-Disciplinary?

The Innovation Cycle

Machine Learning Connections

Deep Learning for Causal Mediation

Physics Analogies

Energy-Based Statistical Models

Computer Science Algorithms

Algorithmic Approaches to Statistical Problems

Statistics ↔ Computer Science

Statistics ↔ Economics

Biology Applications

Evolutionary and Systems Biology Connections

Statistics ↔ Biology

Statistics ↔ Mathematics

Structured Ideation Process

Step 1: Problem Decomposition

Step 2: Abstract Pattern Recognition

Step 3: Cross-Field Search

Step 4: Deep Dive on Promising Connections

Step 5: Synthesis and Evaluation

Ideation Prompts by Problem Type

When Stuck on Identification

When Stuck on Estimation

When Stuck on Computation

When Stuck on Theory

When Stuck on Robustness

Successful Transfer Examples

Example 1: Propensity Scores from Survey Sampling

Example 2: Lasso from Signal Processing

Example 3: Double Robustness from Missing Data

Example 4: Influence Functions from Robustness

Domain-Specific Prompts for Mediation Research

From Causal Inference Literature

From Machine Learning

From Econometrics

From Biostatistics

From Physics/Information Theory

Innovation Documentation Template

Transfer Opportunities

High-Priority Cross-Disciplinary Transfers for Statistical Research

Immediate Research Directions

Transfer Success Criteria

Integration with Other Skills

Key References

Cross-Disciplinary Statistics

Physics-Statistics Connection

CS-Statistics Connection

Related skills