From reaction list to stochastic evidence

A working tutorial from chemical master equations and exact simulation to burst distributions, linear noise, feedback, switching lifetimes, and growth-coupled memory.

The core asks why a cell can have reproducible behavior and variable molecular histories. This exposition develops the tools needed to answer that question for a new network. A single addition–removal process provides our first complete calculation. Translation and promoter switching then reveal what this calibration leaves out. Finally, reaction-level covariance connects noise to Lecture 4's stability analysis, and growth connects a fixed-volume model to a dividing cell.

Parts 1–4 develop the local state, CME, event sampler and estimators. They include the conditions under which a long history represents a stationary ensemble. Part 5 derives the burst and distribution claims that the core introduces as extensions. Part 6 is a worked route through the linear-noise and cellular-memory problems. Part 7 asks which measurements could distinguish the mechanisms. These are study routes, not a second single-lecture timetable. Each checkpoint has an answer; try it before opening the solution.

Outcome

On a blank page, you will be able to define the stochastic state, derive its CME, obtain moment equations with the generator, code the direct SSA, construct time-weighted and independent-path estimators, test analytic invariants, and distinguish a path claim from a distribution or inference claim.

Three routes from the lecture to independent work

To construct a count model from a concentration model, work through Sections 5–9. To turn simulation output into an estimate, use Sections 16–19, including the absorbing-state counterexamples. To investigate a biological mechanism, choose expression and bursts or noise, switching and growth, then apply the final working protocol. Each route states its assumptions and supplies a checkable calculation.

We retain Lecture 3's reaction bookkeeping. Species are X1,,XsX_1,\ldots,X_s. Their random counts form NX(t)=(NX1(t),,NXs(t))TN_X(t)=(N_{X_1}(t),\ldots,N_{X_s}(t))^T, and nn denotes one realized integer state. A species symbol is not a random variable. Named examples use shorter count symbols, such as NN for one species or M,PM,P for RNA and protein counts.

For channel rr, reactant vector αr\alpha_r and product vector βr\beta_r list the numbers consumed and formed. The jump is γr=βrαr\gamma_r=\beta_r-\alpha_r. Putting those columns together gives Γ\Gamma. Propensities determine when those jumps occur.

THE REACTION OBJECT STATE
NX(t)Z0sN_X(t)\in\mathrm{Z}_{\geq0}^{s}
what exists now JUMP
γr=βrαr\gamma_r=\beta_r-\alpha_r
what one event changes CLOCK
ar(n)  [time1]a_r(n)\;[\mathrm{time}^{-1}]
how often it fires now CHANNEL INTEGER JUMP ELIGIBLE EVENTS PER TIME
X\varnothing\rightsquigarrow X
+1+1
bb
XX\rightsquigarrow\varnothing
1-1
dnXd n_X
A+BkCA+B\xrightarrow{k}C
(1,1,+1)(-1,-1,+1)
kNAVnAnB\frac{k}{N_AV}n_A n_B
2AkC2A\xrightarrow{k}C
(2,+1)(-2,+1)
kNAVnA(nA1)\frac{k}{N_AV}n_A(n_A-1)
nn+γrwhen clock ar(n) ringsn\longmapsto n+\gamma_r\quad\text{when clock }a_r(n)\text{ rings}
Figure 1. One model specification, several derived views. State, jump, and propensity are the irreducible input. The CME, simulated paths, moments, and deterministic limits should all be reproducible from it.
Part 1

Choose a stochastic state

The state is not a list of everything in the cell. It is the smallest list that makes the next-event clocks depend only on the present.

1Begin with the question

A stochastic model is unnecessary until the observable asks for something a deterministic mean cannot answer.

Write the biological question before the reactions. “What is the mean expression level?” might be answered by a rate equation. “What fraction of cells have zero transcript?”, “How long until the first resistant cell appears?”, and “Does a threshold see isolated bursts?” cannot. They depend on the distribution, a boundary, or an individual history.

Now name the sampling operation. A snapshot across 1,000 cells is an ensemble. A 12-hour movie of one lineage is a time series. A population average after lysis is neither a single-cell distribution nor a path. The same mean can arise from all three while hiding different biology. Raj and colleagues made this distinction tangible by counting individual mRNAs and relating punctuated transcription to promoter states.7

Variation also has sources. Elowitz and colleagues used two fluorescent reporters in the same cell to separate reporter-specific fluctuations from shared cell-to-cell changes.5 Swain, Elowitz, and Siggia formalized that intrinsic-versus-extrinsic decomposition.6 A single broad histogram cannot perform this separation because measurement error, hidden cell state, and reaction-event variation are all superposed.

VARIATION HAS A GEOMETRY SHARED CELL STATE growth, resources, environment REPORTER 1 its own reaction history REPORTER 2 its own reaction history compare within each cell
differencechannel-specific component\text{difference}\Rightarrow\text{channel-specific component}
co-motionshared component\text{co-motion}\Rightarrow\text{shared component}
Measurement error is a third source and is not assigned by this covariance alone.
Figure 2. A paired measurement changes what variation can establish. Reporter-specific differences expose channel-level event histories. Correlated movement points to a shared cell state. Measurement error remains a separately calibrated source.
An inference starts with an observable

“The system is noisy” is not yet a modeling question. Replace it with a statistic and a sampling protocol: Fano factor at 30 minutes, probability of zero at division, autocorrelation time in one lineage, or first passage above a threshold.

Choose a path, distribution or mean observable and state how it will be measured before selecting a model.

2Convert concentration to count

Concentration alone does not reveal discreteness. Volume completes the conversion.

For concentration cc in moles per liter and volume VV in liters, multiply by Avogadro's constant NAN_A to get the molecule number NN. Use the rough conversion NA6×1023mol1N_A\approx6\times10^{23}\,\mathrm{mol}^{-1}:

N=cVNA(106mol/L)(1015L)(6×1023mol1)=600.N=cVN_A\approx(10^{-6}\,\mathrm{mol/L})(10^{-15}\,\mathrm L)(6\times10^{23}\,\mathrm{mol}^{-1})=\pf{600}. (1)

A micromolar species in a femtoliter cell therefore has hundreds of copies. Invert the same relation: one copy corresponds to about 1/600μM1.7nM1/600\,\mu\mathrm M\approx1.7\,\mathrm{nM}. The comparison tells us which concentrations lie near an integer boundary.

Exact conversion, after the estimate

The defined constant is NA=6.02214076×1023mol1N_A=6.02214076\times10^{23}\,\mathrm{mol}^{-1}. It gives 602.214 molecules per micromolar in 1 fL, or 1.660539 nM per molecule. The extra digits do not change the copy-number regime.11

Events supply a second counting scale. For independent events with constant rate over a window, split the window into many intervals with a small firing probability. The binomial count approaches a Poisson law with mean and variance both equal to the expected event count KK, so its relative fluctuation is K/K=K1/2\sqrt K/K=K^{-1/2}. A large molecule pool can still inherit a rare regulator's event history. Feedback, correlated packets and a changing rate require a different calculation.

COUNT THE STATE, THEN COUNT THE EVENTS THAT REFRESH IT MOLECULE SCALE
N=cVNAN=cVN_A
5nM×2fL5\,\mathrm{nM}\times2\,\mathrm{fL}
N=6.02N=6.02
1μM×1fL1\,\mu\mathrm{M}\times1\,\mathrm{fL}
N=602.21N=602.21
Concentration needs a volume before it becomes a count. EVENT SCALE 1 10 100 1000 0 .5 1
μ   events\mu\;\text{ events}
CV\mathrm{CV}
CV=μ1/2\mathrm{CV}=\mu^{-1/2}
A high protein count can still be refreshed by a small number of transcript or promoter events.
Figure 3. Two scales decide whether discreteness is visible. Volume converts concentration into molecule count. The number of independent events in the observable's memory time sets a second relative-fluctuation scale.

Low count identifies a scale that needs further interpretation. Rare promoter states matter even when their protein output is abundant. Extinction matters when zero is absorbing. A system near a switching threshold may amplify small fluctuations. Conversely, a high-count species can inherit variation from a low-count regulator. Use the conversion to locate the possible source, then return to the observable.

Convert a concentration and compartment volume into a copy-number scale, and use that scale to test whether integer boundaries matter.

3Choose a local compartment

A geometric volume specifies where to count. A dynamical compartment also needs an exchange timescale and a named observable.

A dendritic spine gives a concrete volume

A dendritic spine is a small protrusion on a neuron's dendrite. The dendrite is an input-receiving branch. A spine head receives a synaptic input and connects to the branch through a narrow neck. The head's calcium signal can help regulate that synapse. Spine size and shape vary, so the following geometry is a representative model choice.26

A submicrometer head has a subfemtoliter volume. Approximate the head by a sphere of radius rh0.3μmr_h\approx0.3\,\mu\mathrm m. Its volume is

V=4πrh330.1μm3.1μm3=1018m3=1015L=1fL.V=\frac{4\pi r_h^3}{3}\approx0.1\,\mu\mathrm m^3. \qquad 1\,\mu\mathrm m^3=10^{-18}\,\mathrm m^3=10^{-15}\,\mathrm L=1\,\mathrm{fL}.

Thus the example volume is about 0.1fL0.1\,\mathrm{fL}. At 100 nM free calcium it contains about six free ions on average. At 10 nM it contains about 0.6. These means concern unbound cytoplasmic calcium. Calcium bound to a protein or stored in an organelle belongs to a different state variable. An instantaneous count remains integer even when its mean is below one.

Derive exchange through the neck

The head exchanges its contents through a restricted cross section. Let chc_h and cdc_d be the head and dendrite concentrations of an ideal diffusing solute. Approximate the neck by a cylinder of length LL and area A=πrneck2A=\pi r_{\mathrm{neck}}^2. Let DD be its diffusion coefficient. Assume a well-mixed head, a large dendritic reservoir and a nearly linear concentration profile along the neck.

Fick's law turns that concentration difference into an exchange rate. The gradient is approximately (chcd)/L(c_h-c_d)/L. Multiply the diffusive flux density by the neck area, then divide by the head volume to obtain its concentration change:

Vdchdtexchange=DAL(chcd),τexchange=VLDA.V\left.\frac{dc_h}{dt}\right|_{\mathrm{exchange}}=-\frac{DA}{L}(c_h-c_d),\qquad \tau_{\mathrm{exchange}}=\frac{VL}{DA}.

The units check is useful: DA/LDA/L is volume per time, so dividing VV by it gives time. A smaller neck radius lengthens equilibration as rneck2r_{\mathrm{neck}}^{-2}. The small head can mix internally while exchange with the dendrite remains slower.

Work the geometric estimate before interpreting calcium

Choose an illustrative unbuffered solute with D=200μm2/sD=200\,\mu\mathrm m^2/\mathrm s, a neck length L=0.5μmL=0.5\,\mu\mathrm m, radius rneck=0.05μmr_{\mathrm{neck}}=0.05\,\mu\mathrm m and head volume V=0.1μm3V=0.1\,\mu\mathrm m^3. Then

τexchange=(0.1)(0.5)(200)π(0.05)2s0.032s.\tau_{\mathrm{exchange}}=\frac{(0.1)(0.5)}{(200)\pi(0.05)^2}\,\mathrm s \approx\pf{0.032\,\mathrm s}.

The free-diffusion traversal scale L2/(2D)0.00063sL^2/(2D)\approx0.00063\,\mathrm s is much shorter. Traversing a neck once and emptying a head through that neck are different problems. The latter depends on its cross section and the head volume. The head's own rough diffusion scale, diameter squared divided by 6D6D, is about 0.0003 s for these illustrative parameters. Calcium binding and clearance still have to be added.

DEFINE THE VOLUME, THEN CHECK ITS EXCHANGE TIME DENDRITIC SPINE: SCHEMATIC
V=0.1μm3V=0.1\,\mu\mathrm m^3
head neck dendrite The head remains connected. IDEAL DIFFUSING SOLUTE 25 50 75 100 0 50 100
rneck  (nm)r_{\mathrm{neck}}\;(\mathrm{nm})
τexchange  (ms)\tau_{\mathrm{exchange}}\;(\mathrm{ms})
L=0.5μm,D=200μm2/s,τexchange=VL/(Dπrneck2)L=0.5\,\mu\mathrm m,\quad D=200\,\mu\mathrm m^2/\mathrm s,\quad\tau_{\mathrm{exchange}}=VL/(D\pi r_{\mathrm{neck}}^2)
Figure 4. A volume becomes a compartment only after exchange is specified. Left: a schematic head and neck. Right: the ideal-solute estimate VL/(Dπrneck2)VL/(D\pi r_{\mathrm{neck}}^2), computed for the stated geometry and diffusion coefficient. The curve is a geometric calculation, not measured calcium transport or a universal spine size.

Compare exchange with the process being observed

Four timescales answer different questions. A head can be a useful state variable while remaining coupled to its dendrite. Treating that state as approximately independent is a stronger simplification.

ScaleMeaningWhat the comparison licenses
τmix\tau_{\mathrm{mix}}Redistribution inside the head.A well-mixed head when this is fast relative to the modeled dynamics.
τexchange\tau_{\mathrm{exchange}}Equilibration with the dendrite through the neck.Whether head and dendrite require separate concentrations.
τclear\tau_{\mathrm{clear}}Removal of a calcium perturbation from the head cytoplasm.Whether the local signal is cleared before much escapes.
TobsT_{\mathrm{obs}}The measurement's averaging window or downstream readout's memory.Whether the observable resolves short fluctuations or averages over them.

A calcium transient can remain local because clearance competes with spread. Let x=chch,0x=c_h-c_{h,0} and y=cdcd,0y=c_d-c_{d,0} denote deviations from a common resting concentration. Let j(t)j(t) be an effective source in concentration per time. After buffering has been represented consistently in the coefficients, a linear compartment model is

dxdt=j(t)xτclearxyτexchange.\frac{dx}{dt}=j(t)-\frac{x}{\tau_{\mathrm{clear}}}-\frac{x-y}{\tau_{\mathrm{exchange}}}.

The pulse divides between two removal routes. Suppose the dendrite stays at baseline, y=0y=0, and an initial excess x0x_0 receives no further source. Define the relaxation rate krelax=1/τclear+1/τexchangek_{\mathrm{relax}}=1/\tau_{\mathrm{clear}}+1/\tau_{\mathrm{exchange}}. The solution is x(t)=x0ekrelaxtx(t)=x_0e^{-k_{\mathrm{relax}}t}. Integrating the neck loss gives the fraction that leaves by that route:

fneck=1x00x(t)τexchangedt=1/τexchangekrelax=τclearτclear+τexchange.f_{\mathrm{neck}}=\frac1{x_0}\int_0^\infty\frac{x(t)}{\tau_{\mathrm{exchange}}}\,dt =\frac{1/\tau_{\mathrm{exchange}}}{k_{\mathrm{relax}}} =\frac{\tau_{\mathrm{clear}}}{\tau_{\mathrm{clear}}+\tau_{\mathrm{exchange}}}.

Local clearance dominates when τclearτexchange\tau_{\mathrm{clear}}\ll\tau_{\mathrm{exchange}}. A sustained source can maintain a local signal through continuing influx and removal. The anatomical connection remains open.

Buffering must be included in both clocks

Binding changes the relation between free calcium and total calcium. In a small-signal, rapid-buffer-equilibrium approximation, define κf\kappa_f and κm\kappa_m as the changes in immobile-bound and mobile-bound calcium per unit change in free calcium. The total incremental capacity is B=1+κf+κmB=1+\kappa_f+\kappa_m. Let DcD_c be free-calcium diffusion, DmD_m mobile-buffer diffusion and kpk_p the linear clearance rate acting on free calcium.

The buffer capacity stores calcium, while mobile buffers also transport it. With uniform coefficients and fast local binding, the incremental total concentration is BxBx and the diffusion coefficient multiplying the free-calcium gradient is Dc+κmDmD_c+\kappa_mD_m. The two effective times are therefore

τexchange=BVLA(Dc+κmDm),τclear=Bkp.\tau_{\mathrm{exchange}}=\frac{BVL}{A(D_c+\kappa_mD_m)},\qquad \tau_{\mathrm{clear}}=\frac{B}{k_p}.

An added immobile buffer lengthens both times in this approximation. Its capacity alone does not establish greater isolation because BB cancels from their ratio. A mobile indicator can additionally carry calcium through the neck. Slow binding, saturation or spatially nonuniform buffers require a more resolved model.

Compare with calcium measurements

Sabatini, Oertner and Svoboda measured a regime with rapid local clearance. In rat hippocampal CA1 pyramidal neurons, extrapolation to zero added indicator gave spine calcium decay times around 12–15 ms. With 100 micromolar Fluo-4 present, their diffusional equilibration estimate averaged about 89 ms and varied with spine geometry. Their Figure 4 uses fluctuations across repeated trials to estimate this coupling.26

The longer native exchange time was inferred from indicator effects. The authors argued that mobile indicator-bound calcium spreads more rapidly than calcium under native buffering. Their correction led to an estimate above 1 s, much longer than clearance. This supports a local calcium signal under their conditions. It does not directly measure dye-free exchange, identify a universal transport coefficient, or establish equal isolation for proteins and other messengers.

A low-count pool can turn over rapidly

Mean count and renewal rate are independent pieces of information. A pool can retain the same mean while its molecules arrive and leave faster. In the constant-addition, linear-removal model developed below, multiplying both rates by the same factor leaves the stationary mean and count distribution unchanged. It shortens the correlation time by that factor. A time-integrating observer can then obtain more independent information from the same small mean pool.

The count conversion survives even when compartment independence fails. The relation Nˉ=cVNA\bar N=cVN_A applies to any specified observation volume with the corresponding volume-averaged concentration. Predicting the fluctuations seen by a sensor additionally requires transport, binding, removal and the sensor's response time. A low count flags a scale worth modeling. It does not specify a probability law or its temporal correlations.

Define the local volume, molecule and readout. Derive or measure exchange, compare it with local reaction and mixing times, and keep the turnover rate separate from the instantaneous molecule count.

4Make hidden memory explicit

A Markov state contains enough present information to determine every instantaneous event rate.

The chemical master equation assumes that, conditional on state NX(t)=nN_X(t)=n, the next-event rates do not depend on the earlier path. If a promoter that just closed has a different reopening hazard from one that has been closed for an hour, the on/off label alone is not Markov. Add an age, a sequence of conformational substates, or a non-Markov waiting-time model.

The same principle handles delays. Replacing transcription initiation by a reaction that instantly produces mature mRNA assumes elongation is either negligible or absorbed into an exponential effective step. If a fixed elongation delay shapes the autocorrelation, add an explicit chain or a delayed event. The simulator cannot repair missing state. It only samples the state model you wrote.

A deterministic decision can look random

Suppose I alternate trips between home and office, and carry my umbrella only if it is raining and the umbrella is at my departure location. Given location, umbrella location, and rain, my action is deterministic. A spectator who records only “carried / did not carry” has omitted the mechanism. That record need not itself be a Markov chain.

For a tractable model, assume rain on each departure is an independent Bernoulli event with probability pp. Let the state before a trip be 0 if the umbrella is unavailable, 1 if available. From 0 I necessarily arrive where it is, so the next state is 1. From 1, rain makes me take it, leaving it available for my next departure; no rain leaves it behind. With current-state rows and next-state columns,

P=[011pp],π0+π1=1,π0=(1p)π1π1=12p.P=\begin{bmatrix}0&1\\1-p&p\end{bmatrix},\qquad \pi_0+\pi_1=1,\quad \pi_0=(1-p)\pi_1 \quad\Longrightarrow\quad\pi_1=\frac1{2-p}.

Under stationary sampling, the carrying probability is p/(2p)p/(2-p), not pp. The random input is our weather model; the decision rule remains deterministic. Biological intrinsic noise is likewise defined relative to a chosen system boundary, but molecular reaction events are not established to be deterministic merely because an everyday decision can be.

Checkpoint 1: If rain probability is 0.3, what fraction of departures include the umbrella?

Availability is 1/1.7=0.58821/1.7=0.5882, so carrying occurs on 0.3/1.7=0.17650.3/1.7=0.1765 of departures in the stationary model. Correlated weather would require a richer state and can change this answer.

observed patternminimal state candidatepossible missing memory
Poisson-like constitutive countmolecule count MMnone evident at that resolution
expression episodes(G,M)(G,M), promoter plus mRNAchromatin or polymerase substates
fixed maturation lagimmature and mature productselapsed time since initiation
shared reporter drifttwo reporters plus a cell stategrowth, size, ribosome pool, environment

Add the hidden state needed to make event hazards depend on the present rather than an unrecorded history.

5Write jumps and propensities

Each reaction channel is an integer displacement paired with an event rate.

Keep the constant from Lecture 3 attached to its concentration law. For elementary channel rr, write

iαirXikriβirXi,vr(c)=kriciαir,γr=βrαr.\sum_i\alpha_{ir}X_i\xrightarrow{k_r}\sum_i\beta_{ir}X_i, \qquad v_r(c)=k_r\prod_i c_i^{\alpha_{ir}},\qquad \gamma_r=\beta_r-\alpha_r.

The reactant order is qr=iαirq_r=\sum_i\alpha_{ir}. Since vrv_r is an event flux in molarity per time, krk_r has units M1qr/time\mathrm M^{1-q_r}/\mathrm{time}. Stoichiometry acts afterward: the channel contributes γrvr\gamma_r v_r to c˙\dot c. In particular, 2AkC2A\xrightarrow{k}C with v=kcA2v=kc_A^2 contributes 2kcA2-2kc_A^2 to c˙A\dot c_A, not kcA2-kc_A^2.

Fix a well-mixed volume VV in liters and let NAN_A be Avogadro's constant. Define Ω=NAV\Omega=N_AV, so a count state nn has concentration c=n/Ωc=n/\Omega. The factor Ω\Omega has units inverse molar. A reaction event changes concentration by γr/Ω\gamma_r/\Omega.

For an integer state nZ0sn\in\mathrm{Z}_{\ge0}^s containing the counts of ss species, channel rr has jump γr\gamma_r and propensity ar(n)a_r(n). The definition concerns the identity of an event:

Pr{channel r fires in [t,t+dt)NX(t)=n}=ar(n)dt+o(dt).\Pr\{\text{channel }r\text{ fires in }[t,t+dt)\mid N_X(t)=n\}=a_r(n)\,dt+o(dt). (2)

Two channels can share the same jump. Basal transcription and an activated route may both add one RNA; their destination probability contains the sum of their propensities. A channel rate is not a destination probability unless that destination uniquely identifies the channel.

For the elementary step A+BkCA+B\xrightarrow{k}C, the jump is (1,1,+1)(-1,-1,+1). Each of the nAn_A molecules can partner with any of the nBn_B molecules, giving nAnBn_An_B eligible pairs. Multiply by a per-pair hazard to obtain the propensity.

For elementary 2AkC2A\xrightarrow{k}C, choosing a first molecule and a distinct partner gives nA(nA1)n_A(n_A-1) ordered pairs. Each unordered pair appears twice. With three molecules there are six ordered pairs but only three physical pairs. If κ\kappa is one physical pair's firing hazard,

a(n)=κ(nA2)=κ2!nA(nA1)=kcountnA(nA1),kcount=κ/2!.a(n)=\kappa\binom{n_A}{2}=\frac{\kappa}{2!}n_A(n_A-1) =k_{\rm count}n_A(n_A-1),\qquad k_{\rm count}=\kappa/2!.

Absorbing the factorial is a change of convention, not an approximation. However, kcountk_{\rm count} is not our concentration constant kk. Its units are inverse time, whereas kk for this bimolecular channel has units inverse molar per time. We must determine their relationship before inserting a measured concentration-scale constant into an SSA.

Derive the conversion while keeping krk_r fixed

There are two ingredients in this conversion. Molecular counting determines the state dependence. The macroscopic limit determines the normalization of the per-combination hazard. Matching a deterministic equation alone would not determine the finite-count model.

For A+BkCA+B\xrightarrow{k}C, the count law is a=κnAnBa=\kappa n_An_B. Divide by Ω\Omega to get concentration event flux. Substituting nA=ΩcAn_A=\Omega c_A and nB=ΩcBn_B=\Omega c_B gives a/Ω=κΩcAcBa/\Omega=\kappa\Omega c_Ac_B. Therefore κ=k/Ω\kappa=k/\Omega matches v=kcAcBv=kc_Ac_B.

For 2AkC2A\xrightarrow{k}C, retain the unordered-pair count. The same calculation gives

a(n)Ω=κ2ΩnA(nA1)=κΩ2cA(cA1Ω).\frac{a(n)}{\Omega}=\frac{\kappa}{2\Omega}n_A(n_A-1) =\frac{\kappa\Omega}{2}c_A\left(c_A-\frac1\Omega\right).

At macroscopic volume with fixed nonzero concentration, 1/Ω1/\Omega is negligible compared with cAc_A. Matching v=kcA2v=kc_A^2 requires κΩ/2=k\kappa\Omega/2=k. Thus

κ=2kΩ,kcount=κ2!=kΩ,a(n)=kΩnA(nA1).\kappa=\frac{2k}{\Omega},\qquad k_{\rm count}=\frac{\kappa}{2!}=\frac{k}{\Omega},\qquad a(n)=\frac{k}{\Omega}n_A(n_A-1).

The combinatorial denominator cancels because the same chemical constant has a different conversion to an unordered-pair hazard. It does not justify setting κ=k/Ω\kappa=k/\Omega for identical reactants. That would halve the macroscopic event flux. Gillespie gives the distinct-reactant and identical-reactant conversions explicitly in Section 2, pages 37–38.1

The general formula counts each reactant species separately. Define hr(n)=i(niαir)h_r(n)=\prod_i\binom{n_i}{\alpha_{ir}} as the number of unordered reactant combinations. Under the elementary stochastic mass-action assumption, each has the same hazard κr\kappa_r, so ar(n)=κrhr(n)a_r(n)=\kappa_r h_r(n). At large counts,

hr(n)Ωqriαir!iciαir,ar(n)ΩκrΩqr1iαir!iciαir.h_r(n)\simeq \frac{\Omega^{q_r}}{\prod_i\alpha_{ir}!}\prod_i c_i^{\alpha_{ir}}, \qquad \frac{a_r(n)}{\Omega}\simeq \frac{\kappa_r\Omega^{q_r-1}}{\prod_i\alpha_{ir}!}\prod_i c_i^{\alpha_{ir}}.

To recover the specified vr(c)v_r(c), set κr=krΩ1qriαir!\kappa_r=k_r\Omega^{1-q_r}\prod_i\alpha_{ir}!. Define the falling factorial (n)m=n(n1)(nm+1)(n)_m=n(n-1)\cdots(n-m+1), with (n)0=1(n)_0=1 and zero value when m>nm>n. Substitution gives the exact propensity of the stated count model:

Same chemistry, explicitly converted constant
ar(n)=krΩ1qri(ni)αir=κri(niαir),κr=krΩ1qriαir!.a_r(n)=k_r\Omega^{1-q_r}\prod_i(n_i)_{\alpha_{ir}} =\kappa_r\prod_i\binom{n_i}{\alpha_{ir}}, \qquad\kappa_r=k_r\Omega^{1-q_r}\prod_i\alpha_{ir}!.

The concentration constant is krk_r. The coefficient multiplying falling factorials is kr,count=krΩ1qrk_{r,\rm count}=k_r\Omega^{1-q_r}. The per-unordered-combination hazard is κr\kappa_r. The last two have inverse-time units because integer combinations are dimensionless. None is silently renamed krk_r.

The factorial product is not a factorial of the total reaction order. A formal reactant vector α=(2,1)\alpha=(2,1) gives h=(nA2)nBh=\binom{n_A}{2}n_B, with denominator 2!1!2!1!, not 3!3!. Its mass-action normalization would be κ=2k/Ω2\kappa=2k/\Omega^2. This is a combinatorial example, not evidence that a biological overall reaction is an elementary three-body collision. Binding and catalysis should be resolved at the mechanism's appropriate scale.

concentration event fluxcount propensityhazard per unordered combinationunits of concentration constant
one-molecule source v=k0v=k_0a=Ωk0a=\Omega k_0Ωk0\Omega k_0 (one source channel)molar/time
elementary v=k1cAv=k_1c_Aa=k1nAa=k_1n_Ak1k_11/time
elementary v=k2cAcBv=k_2c_Ac_Ba=k2nAnB/Ωa=k_2n_An_B/\Omegak2/Ωk_2/\Omega1/(molar × time)
elementary v=k2cA2v=k_2c_A^2a=k2nA(nA1)/Ωa=k_2n_A(n_A-1)/\Omega2k2/Ω2k_2/\Omega1/(molar × time)

The conversion is exact. Replacing falling factorials by powers is not

At an admissible count state, the normalized propensity can be written exactly as

ar(n)Ω=krij=0αir1(cijΩ),ci=niΩ.\frac{a_r(n)}{\Omega} =k_r\prod_i\prod_{j=0}^{\alpha_{ir}-1}\left(c_i-\frac j\Omega\right), \qquad c_i=\frac{n_i}{\Omega}.

When every required reactant count is large compared with its stoichiometric coefficient, replacing each factor by cic_i recovers vr(c)v_r(c). For 2A2A, the ratio a/(Ωv)=11/nAa/(\Omega v)=1-1/n_A for nA>0n_A>0. At one molecule the exact propensity is zero, while substituting concentration directly into ΩkcA2\Omega kc_A^2 would permit an impossible event.

A small-count numerical check

Choose illustrative parameters V=1fLV=1\,\mathrm{fL} and k=106M1s1k=10^6\,\mathrm M^{-1}\mathrm s^{-1}. Then Ω6×108M1\Omega\simeq6\times10^8\,\mathrm M^{-1} and k/Ω1.7×103s1k/\Omega\simeq1.7\times10^{-3}\,\mathrm s^{-1}. With three AA molecules, there are three unordered pairs. Either convention gives a102s1a\simeq10^{-2}\,\mathrm s^{-1}, so the first event takes about 102s10^2\,\mathrm s on average if this is the only channel.

Using ΩkcA2\Omega kc_A^2 instead gives approximately 1.5×102s11.5\times10^{-2}\,\mathrm s^{-1}, 50% too large. After the valid event, only one AA remains and this channel stops. These numbers calibrate the formula. They are not a measured reaction in a named organism.

Checkpoint 2: Double the volume and every reactant count. Does a bimolecular propensity exactly double?

For distinct reactants, yes: (2nA)(2nB)/(2Ω)=2nAnB/Ω(2n_A)(2n_B)/(2\Omega)=2n_An_B/\Omega. For identical reactants at count nA=n2n_A=n\ge2, the ratio is a/a=(2n1)/(n1)a'/a=(2n-1)/(n-1), which approaches two only at large count. The change from three molecules to six multiplies the propensity by 5/25/2. The concentration law still has the same kk. The discrepancy is the finite-count availability correction, not changed chemistry.

An effective concentration law does not uniquely specify noise

The elementary result uses molecular combinatorics in addition to the macroscopic limit. A composite flux has no such automatic microscopic interpretation. For example, one-molecule additions at rate bb and packets of BB molecules at rate b/Bb/B have the same mean input but different event noise. Specify the jump sizes and effective hazards, or resolve the hidden mechanism, before writing the CME.

Likewise, a fitted law written as c˙A=kdisappearancecA2-\dot c_A=k_{\rm disappearance}c_A^2 uses a species-disappearance constant. For 2AkC2A\xrightarrow{k}C in our event-flux convention, kdisappearance=2kk_{\rm disappearance}=2k. Read the defining equation when importing a constant from a paper or simulator.

  1. Order the state vector once and keep that order in every jump.
  2. Compute products minus reactants for each component of γr\gamma_r.
  3. Count eligible reactant combinations at the current integer state.
  4. Multiply by a rate constant whose units make ara_r events per time.
  5. Check that n+γrn+\gamma_r stays admissible whenever ar(n)>0a_r(n)>0.

Construct a jump-and-propensity table with legal destinations, eligible reactant combinations and consistent units.

Part 2

Derive the probability law

A master equation is a conservation law on the state graph. Every arrow contributes one gain and one loss.

6One small interval

The CME follows by keeping all events of order dtdt and discarding events of smaller order.

Let p(n,t)=Pr{NX(t)=n}p(n,t)=\Pr\{N_X(t)=n\}. To occupy nn at t+dtt+dt, either the system was already there and no channel fired, or it was at a predecessor nγrn-\gamma_r and channel rr fired once. The probability of two events is o(dt)o(dt). Therefore

p(n,t+dt)=p(n,t) ⁣[1rar(n)dt]+rp(nγr,t)ar(nγr)dt+o(dt).p(n,t+dt)=p(n,t)\!\left[1-\sum_r a_r(n)dt\right] +\sum_r p(n-\gamma_r,t)a_r(n-\gamma_r)dt+o(dt). (3)

Subtract p(n,t)p(n,t), divide by dtdt, and take the limit. No Gaussian assumption enters. No random term is added to an ODE. The probability flow comes directly from discrete reaction events.

Account for all first-order event probabilities in one short interval before taking the continuous-time limit.

7The general CME

Gain from every predecessor minus loss through every outgoing channel.

Chemical master equation: the probability model
p(n,t)t=r[ar(nγr)p(nγr,t)ar(n)p(n,t)].\frac{\partial p(n,t)}{\partial t} =\sum_r\left[a_r(n-\gamma_r)p(n-\gamma_r,t)-a_r(n)p(n,t)\right]. (4)

The state distribution, not a concentration trajectory, evolves by probability entering and leaving each legal count state. This is the central modelling equation of the lecture.

Read it in this order. The argument nγrn-\gamma_r identifies the state that reaches nn after jump γr\gamma_r. The first propensity is evaluated at that predecessor because the event clock runs before the jump. The second term removes probability from nn at the rate its own clock runs.

The CME is linear in pp even when propensities are nonlinear in nn. Its difficulty is dimension: a modest number of species creates a huge or infinite count lattice. Gillespie's direct method avoids enumerating that lattice by sampling paths instead.1

FOCUS ON STATE n
n1n-1
nn
n+1n+1
n+2n+2
bpn1b p_{n-1}
bpnb p_n
d(n+1)pn+1d(n+1)p_{n+1}
dnpndn p_n
incoming minus outgoing
p˙n=bpn1+d(n+1)pn+1(b+dn)pn\dot p_n=b p_{n-1}+d(n+1)p_{n+1}-(b+dn)p_n
Figure 5. The predecessor stencil is easier to read as arrows. Every incoming arrow is evaluated at its starting state. Every outgoing clock appears once with a minus sign.

Write a chemical master equation by evaluating each incoming clock at its predecessor and each outgoing clock at the current state.

8Boundaries and conservation

The admissible state space determines which predecessor terms exist.

Let bb be a constant addition propensity in events/time, and dd an individual removal hazard in inverse time. For constant addition and first-order removal,

X,a+(n)=b;X,a(n)=dn,p˙n=bpn1+d(n+1)pn+1(b+dn)pn.\varnothing\rightsquigarrow X,\quad a_+(n)=b;\qquad X\rightsquigarrow\varnothing,\quad a_-(n)=dn, \qquad \dot p_n=bp_{n-1}+d(n+1)p_{n+1}-(b+dn)p_n. (5)

At n=0n=0, define p1=0p_{-1}=0. The removal clock is already zero. Hence p˙0=dp1bp0\dot p_0=dp_1-bp_0. Sum equation (5) from zero to infinity. After shifting indices, every addition gain cancels an addition loss and every removal gain cancels a removal loss. Thus dnpn/dt=0d\sum_n p_n/dt=0.

Run three checks on any CME: every gain points from a legal predecessor, every outgoing clock appears once with a minus sign, and summing over the legal state space conserves probability. If probability disappears, either an index is wrong or an absorbing/outside state has not been named.

ZERO IS A MODELLED STATE CONSTANT ADDITION zero can leave AUTOCATALYTIC ADDITION zero is absorbing 0 1 2 0 1 2
bb
bb
dd
2d2d
dd
a+(0)=a(0)=0a_+(0)=a_-(0)=0
kk
2d2d
p˙0=dp1bp0orp˙00  with no escape\dot p_0=d p_1-bp_0\quad\text{or}\quad\dot p_0\geq0\;\text{with no escape}
Figure 6. The zero state records mechanism. A constant addition clock permits escape from zero. An autocatalytic addition clock does not. Both behaviors follow from the reaction list.

Material conservation survives every random event

Probability conservation and molecular conservation are different statements. Resolve elementary binding as A+Bkk+CABA+B\xrightleftharpoons[k_-]{k_+}C_{AB}. The two jumps are (1,1,+1)T(-1,-1,+1)^T and its negative. Each preserves nA+nCABn_A+n_{C_{AB}} and nB+nCABn_B+n_{C_{AB}}, not merely their averages.

More generally, if a row T\ell^T satisfies TΓ=0\ell^T\Gamma=0, then TNX(t)\ell^T N_X(t) is constant on every path of the closed reaction model. With fixed binding totals of 3 A-units and 5 B-units, choose complex count z{0,1,2,3}z\in\{0,1,2,3\} as the only independent coordinate. The clocks become a+(z)=k+(3z)(5z)/(NAV)a_+(z)=k_+(3-z)(5-z)/(N_AV) and a(z)=kza_-(z)=k_-z. At the upper boundary association vanishes. At zero dissociation vanishes. This is Lecture 3's conservation law used to reduce a stochastic state space.

Locate a probability-bookkeeping error by summing the CME, and distinguish an absorbing zero from a zero with a surviving source.

9The generator shortcut

The generator obtains observable equations without writing every state probability.

Choose a numerical observable f(n)f(n) of the current count state, such as a count, its square, or an indicator that the cell is empty. We want its expected instantaneous change without solving all state probabilities. Condition on NX(t)=nN_X(t)=n. In a short interval hh, reaction rr changes the observable by f(n+γr)f(n)f(n+\gamma_r)-f(n) with probability ar(n)h+o(h)a_r(n)h+o(h). No event contributes zero increment. Hence

E[f(NX(t+h))f(n)NX(t)=n]=hrar(n)[f(n+γr)f(n)]+o(h).\mathrm E[f(N_X(t+h))-f(n)\mid N_X(t)=n] =h\sum_r a_r(n)[f(n+\gamma_r)-f(n)]+o(h).

Divide by hh and let it vanish. The resulting linear operator is the infinitesimal generator L\mathcal L. It takes an observable to another function of state, with units observable/time:

(Lf)(n)=rar(n)[f(n+γr)f(n)].(\mathcal{L}f)(n)=\sum_r a_r(n)\left[f(n+\gamma_r)-f(n)\right]. (6)

Then df(NX)/dt=(Lf)(NX)d\langle f(N_X)\rangle/dt=\langle(\mathcal{L}f)(N_X)\rangle. Choosing f(n)=nif(n)=n_i gives the mean of NXiN_{X_i}. Choosing f(n)=ninjf(n)=n_in_j gives the second moment E[NXiNXj]\mathrm E[N_{X_i}N_{X_j}]. Each term asks only how one event changes the selected observable.

For nonlinear propensities, the hierarchy usually opens. A mean equation contains a second moment, which contains a third. Moment closure then becomes an approximation. For affine propensities, polynomial moments of a given order close at that order. The constant-addition, linear-removal process and the two-stage gene-expression example exploit this special structure.

Compare with the concentration rate equation

Collect reaction jumps as the columns of Γ\Gamma and propensities as the column aa. Coordinate observables give the exact count mean and its fixed-volume concentration counterpart:

dE[NX]dt=ΓE[a(NX)],dE[NX/(NAV)]dt=ΓNAVE[a(NX)].\frac{d\,\mathrm E[N_X]}{dt}=\Gamma\mathrm E[a(N_X)],\qquad \frac{d\,\mathrm E[N_X/(N_AV)]}{dt}=\frac{\Gamma}{N_AV}\mathrm E[a(N_X)].

Lecture 3's c˙=Γv(c)\dot c=\Gamma v(c) has the same stoichiometry but different rate units. Each ara_r is an event propensity with dimensions inverse time, while vrv_r has units molar/time. A zeroth-order flux constant has units molar/time, a first-order constant inverse time, and a second-order constant inverse molar/time. Counts and event multiplicities are dimensionless, with “molecules” and “pairs” retained as bookkeeping labels. Macroscopic mass-action constants and count-scale pair coefficients cannot be copied unchanged across volume conventions.

At finite copy number, E[NXiNXj]\mathrm E[N_{X_i}N_{X_j}] contains a covariance and is not generally the product of means. An affine network closes exactly. A nonlinear rate equation instead requires a justified concentration limit or moment approximation.

On a finite state graph using probability columns p˙=Qp\dot p=Qp, the generator acts on an observable column as QTQ^T. This follows by differentiating fTpf^Tp.

Identical reactants reveal two separate finite-count corrections

Consider only the channel 2AkC2A\xrightarrow{k}C from Section 5. Let N(t)N(t) denote its random AA count, cˉA=E[N]/Ω\bar c_A=\mathrm E[N]/\Omega its mean concentration, and σc2=Var(N)/Ω2\sigma_c^2=\operatorname{Var}(N)/\Omega^2 its concentration variance. The jump is 2-2, so the exact mean equation is

dE[N]dt=2kΩE[N(N1)].\frac{d\,\mathrm E[N]}{dt}=-\frac{2k}{\Omega}\mathrm E[N(N-1)].

Use E[N(N1)]=(E[N])2+Var(N)E[N]\mathrm E[N(N-1)]=(\mathrm E[N])^2+\operatorname{Var}(N)-\mathrm E[N], then divide by Ω\Omega:

cˉ˙A=2k[cˉA2+σc2cˉAΩ].\dot{\bar c}_A=-2k\left[\bar c_A^2+\sigma_c^2-\frac{\bar c_A}{\Omega}\right].

The variance term comes from averaging a nonlinear propensity. The negative cˉA/Ω\bar c_A/\Omega term comes from excluding a molecule as its own partner. Both must be accounted for when comparing with c˙A=2kcA2\dot c_A=-2kc_A^2. Neither changes the meaning of kk.

A Poisson count has Var(N)=E[N]\operatorname{Var}(N)=\mathrm E[N], so these two corrections cancel at that instant. The dimerization process does not in general preserve a Poisson distribution. An initial agreement therefore does not establish exact deterministic mean dynamics for all time.

A matrix example fixes the transpose convention

A promoter opens with hazard α\alpha and closes with hazard β\beta. In off/on order, using a column of probabilities,

ddt[p0p1]=[αβαβ]Q[p0p1].\frac d{dt}\begin{bmatrix}p_0\\p_1\end{bmatrix} =\underbrace{\begin{bmatrix}-\alpha&\beta\\\alpha&-\beta\end{bmatrix}}_{Q} \begin{bmatrix}p_0\\p_1\end{bmatrix}.

The columns of QQ sum to zero. For the on-state indicator f=(0,1)Tf=(0,1)^T, QTf=(α,β)TQ^Tf=(\alpha,-\beta)^T: off gains indicator at rate α\alpha, on loses it at rate β\beta. The on-probability therefore obeys p˙1=α(α+β)p1\dot p_1=\alpha-(\alpha+\beta)p_1. Define its stationary value pon=α/(α+β)p_{\mathrm{on}}=\alpha/(\alpha+\beta); integration gives

p1(t)=pon+[p1(0)pon]e(α+β)t.p_1(t)=p_{\mathrm{on}}+[p_1(0)-p_{\mathrm{on}}]e^{-(\alpha+\beta)t}.

The umbrella matrix used discrete-time row probabilities; this example uses continuous-time probability columns. State the convention before comparing matrices.

Derive an observable equation from conditional event increments, and identify the moment closure needed before using a nonlinear deterministic mean.

Part 3

Solve the calibration model

One exactly solvable network becomes a unit test for notation, derivation, code, and interpretation.

10Constant addition and linear removal

This standard immigration–death process is valuable because every representation is tractable.

The state is n0n\ge0. The jump and propensity table is:

channeljumppropensityunits
X\varnothing\rightsquigarrow X+1bbevents/time
XX\rightsquigarrow\varnothing−1dndnevents/time

The deterministic concentration analogue is addition minus first-order removal. The stochastic model adds an integer boundary and a distribution, but it does not change the mechanism. This makes disagreement among the representations especially diagnostic.

Use the addition and removal clocks to identify the stationary count scale and the correct zero-state equation.

11Poisson, step by step

Stationary neighboring fluxes generate a recursion, and normalization finishes it.

Assume b,d>0b,d>0. Define current across edge nn+1n\leftrightarrow n+1 of the state graph by Jn=bpnd(n+1)pn+1J_n=bp_n-d(n+1)p_{n+1}. The CME says p˙n=Jn1Jn\dot p_n=J_{n-1}-J_n. At stationarity the current is constant along the ladder. The zero boundary gives 0=p˙0=J00=\dot p_0=-J_0, so that constant is zero. Only now conclude bpn=d(n+1)pn+1bp_n=d(n+1)p_{n+1}. Rearrange and define μ=b/d\mu=b/d:

pn+1=μn+1pn.p_{n+1}=\frac{\mu}{n+1}p_n. (7)

Iterate: p1=μp0p_1=\mu p_0, p2=μ2p0/2!p_2=\mu^2p_0/2!, and in general pn=p0μn/n!p_n=p_0\mu^n/n!. Normalize:

1=n=0pn=p0n=0μnn!=p0eμ,p0=eμ.1=\sum_{n=0}^{\infty}p_n=p_0\sum_{n=0}^{\infty}\frac{\mu^n}{n!} =p_0e^\mu,\qquad p_0=e^{-\mu}. (8)

Thus NPoisson(μ)N\sim\operatorname{Poisson}(\mu). Its mean and variance both equal μ\mu. This is the reference process against which additional gene-expression clocks can be diagnosed.

Zero edge current is stronger than stationary probability. A cyclic state network can sustain circulating current with every state probability constant. Our boundary argument licenses detailed balance for this nearest-neighbor ladder; it does not say cells at steady state are at thermodynamic equilibrium.

THE NULL MODEL CLOSES A FOUR-WAY LOOP 0 10 20 30 40 0 .04 .08
nn
Pr{N=n}\Pr\{N=n\}
bars: 5,000 seeded endpoints curve: exact Poisson THEORY
N=20.000\langle N\rangle=20.000
Var(N)=20.000\operatorname{Var}(N)=20.000
SIMULATION
Nˉ=19.975\bar N=19.975
s2=19.567s^2=19.567
b=4min1,d=0.2min1,b/d=20b=4\,\mathrm{min}^{-1},\quad d=0.2\,\mathrm{min}^{-1},\quad b/d=20
Figure 7. Theory and 5,000 seeded simulations agree. With b=4b=4 per minute and d=0.2d=0.2 per molecule per minute, the exact stationary parameter is 20. The small empirical discrepancy is finite sampling.

Obtain the Poisson law from boundary-forced zero current and normalization, without assuming pairwise balance on an arbitrary network.

12Moments, step by step

Apply the generator to nn and n2n^2, then convert the second moment to variance.

For f(n)=nf(n)=n, addition changes ff by 1 and removal changes it by −1. Equation (6) gives

Ln=bdn,dNdt=bdN.\mathcal{L}n=b-dn,\qquad \frac{d\langle N\rangle}{dt}=b-d\langle N\rangle. (9)

For f(n)=n2f(n)=n^2, an addition changes the square by (n+1)2n2=2n+1(n+1)^2-n^2=2n+1; a removal changes it by (n1)2n2=2n+1(n-1)^2-n^2=-2n+1. Therefore

dN2dt=b2N+1+dN(2N+1).\frac{d\langle N^2\rangle}{dt} =b\langle2N+1\rangle+d\langle N(-2N+1)\rangle. (10)

Use σ2=N2N2\sigma^2=\langle N^2\rangle-\langle N\rangle^2, reserving VV for volume. Differentiation subtracts 2N(bdN)2\langle N\rangle(b-d\langle N\rangle) from equation (10); the terms 2bN2b\langle N\rangle cancel, and the second moments combine into variance:

dσ2dt=b+dN2dσ2.\frac{d\sigma^2}{dt}=b+d\langle N\rangle-2d\sigma^2. (11)

At stationarity, equation (9) gives N=b/d\langle N\rangle=b/d. Equation (11) then gives σ2=b/d\sigma^2=b/d. The probability recursion and moment method agree, which is precisely why this network is a good implementation test.

Derive both mean and variance from event increments, including the subtraction of the evolving squared mean.

13Transients and system size

The calibration model lets us separate four effects: initialization, fluctuation memory, system size and observation duration.

Starting from mean M0M_0, equation (9) solves to

M(t)=bd+(M0bd)edt.M(t)=\frac{b}{d}+\left(M_0-\frac{b}{d}\right)e^{-dt}. (12)

The relaxation time is 1/d1/d. Sampling at one tenth of that time does not produce a stationary ensemble. Initialization matters even when the eventual stationary law is known.

The entire transient law has a direct construction. Start with exactly n0n_0 molecules. Each independently survives with probability edte^{-dt}, giving a binomial survivor count. New arrivals form a Poisson process; an arrival at time uu survives with probability ed(tu)e^{-d(t-u)}. Independent thinning gives a Poisson new-survivor count with mean 0tbed(tu)du\int_0^t b e^{-d(t-u)}du. The contributions are independent:

N(t)  =law  Binomial(n0,edt)+Poisson ⁣[bd(1edt)].N(t)\;\overset{\mathrm{law}}{=}\;\operatorname{Binomial}(n_0,e^{-dt})+\operatorname{Poisson}\!\left[\frac bd(1-e^{-dt})\right].

For n0=0n_0=0, the transient law is Poisson with a changing mean. At b=4b=4, d=0.2d=0.2 and t=60t=60 minutes, its mean is 20(1e12)19.9998820(1-e^{-12})\simeq19.99988. The sampled mean from 5,000 paths has standard error about 20/5000=0.063\sqrt{20/5000}=0.063.

The stable state still fluctuates

Lecture 4's linearized matrix is the scalar A=dA=-d, restoring mean perturbations as edte^{-dt}. Events continually inject variance. At the stationary mean their squared-jump-weighted rate is D=(+1)2b+(1)2d(b/d)=2bD=(+1)^2b+(-1)^2d(b/d)=2b. If CC is stationary variance, equation (11) becomes

AC+CAT+D=02dC+2b=0C=b/d.AC+CA^T+D=0\quad\Longrightarrow\quad -2dC+2b=0\quad\Longrightarrow\quad C=b/d.

This algebraic Lyapunov equation balances covariance; it is not itself a nonlinear global-stability proof. The same structure appears in network linear-noise approximations; here the second moment is exact. Also, N(t+τ)N(t)=b/d+[N(t)b/d]edτ\langle N(t+\tau)\mid N(t)\rangle=b/d+[N(t)-b/d]e^{-d\tau}. Multiply by the centered count at time tt and average at stationarity: Cov[N(t),N(t+τ)]=(b/d)edτ\operatorname{Cov}[N(t),N(t+\tau)]=(b/d)e^{-d|\tau|}. The restoring time is also the fluctuation memory time.

STABILITY SETS A MEMORY TIME, NOT ZERO NOISE RELAXATION OF THE MEAN 0 5 10 15 20 25 20 25 30
t  (min)t\;(\mathrm{min})
m(t)m(t)
δm˙=dδm\dot{\delta m}=-d\,\delta m
STATIONARY AUTOCORRELATION 0 5 10 15 20 25 0 0.5 1
τ  (min)\tau\;(\mathrm{min})
ρ(τ)\rho(\tau)
AC+CAT+D=0AC+CA^{\mathsf T}+D=0
Figure 8. Stability restores the mean while reactions replenish variation. Exact curves for addition 4 per minute and per-molecule removal 0.2 per minute. The mean starts at 30 on the left; the right is a stationary normalized autocorrelation, not the autocorrelation of that relaxing ensemble.

Change system size without changing the concentration kinetics. Fix a reference volume VrefV_{\mathrm{ref}} and define the dimensionless multiplier RV=V/VrefR_V=V/V_{\mathrm{ref}}. The physical conversion factor remains Ω=NAV=RVNAVref\Omega=N_AV=R_VN_AV_{\mathrm{ref}}. If the reference addition propensity is bb, use RVbR_Vb in the enlarged volume and keep the per-molecule removal hazard dd unchanged. Stationary count mean grows as RVR_V, standard deviation as RV\sqrt{R_V}, and relative spread as RV1/2R_V^{-1/2}. Kurtz gives the rigorous density-dependent convergence to deterministic kinetics.3

The plotted normalization is count per reference volume. Write z=N/RVz=N/R_V. Then E[z]=b/d\mathrm E[z]=b/d and Var(z)=b/(dRV)\operatorname{Var}(z)=b/(dR_V) at stationarity. Actual molarity is c=z/(NAVref)c=z/(N_AV_{\mathrm{ref}}). This separates a dimensionless size comparison from the unit conversion used to derive propensities.

THE ODE EMERGES UNDER A SPECIFIED SCALING 0 10 20 30 0 10 20 30
t  (min)t\;(\mathrm{min})
N/RVN/R_V
RV=1R_V=1
RV=4R_V=4
RV=16R_V=16
z˙=bdz\dot z=b-dz
Figure 9. Relative fluctuations shrink under the correct system-size scaling. The plotted object is N/RVN/R_V, the count normalized to the reference volume. Divide by NAVrefN_AV_{\mathrm{ref}} to obtain molarity. Absolute count variation grows while relative concentration variation shrinks.

Match initial conditions and observation windows before comparing a transient ensemble with a stationary distribution or system-size limit.

Part 4

Simulate and estimate

The direct method samples event histories. Specified observation times, weights and assumptions turn those histories into estimates.

14Derive the waiting time

While no event occurs, the state is fixed, so the total hazard is constant.

Let a0(n)=rar(n)a_0(n)=\sum_r a_r(n). If S(τ)S(\tau) is the probability that no event occurs for another τ\tau, then

S(τ+dτ)=S(τ)(1a0dτ)dSdτ=a0S,S(0)=1.S(\tau+d\tau)=S(\tau)(1-a_0d\tau) \quad\Rightarrow\quad \frac{dS}{d\tau}=-a_0S,\quad S(0)=1. (13)

Hence S(τ)=ea0τS(\tau)=e^{-a_0\tau}. If U1U_1 is uniform on (0,1)(0,1), solve U1=S(τ)U_1=S(\tau):

τ=lnU1a0.\tau=-\frac{\ln U_1}{a_0}. (14)

This skips every empty interval. It is especially efficient when events are rare because the sampled waiting time can be arbitrarily long without repeated null steps.

Sample a next-event time from the survival probability and state why the hazards must remain fixed while waiting.

15Derive the winning channel

Conditional on an event, each channel owns a fraction of the total hazard.

The joint density that the next event occurs at time τ\tau and is channel jj is ajea0τa_j e^{-a_0\tau}. Integrating over time yields Pr(J=j)=aj/a0\Pr(J=j)=a_j/a_0. Draw a second uniform U2U_2 and choose the first jj satisfying

r=1jar(n)>U2a0(n).\sum_{r=1}^{j}a_r(n)>U_2a_0(n). (15)

The order of channels changes no probability if the intervals have the correct widths. After the chosen jump, every propensity that depends on a changed species must be recomputed. The clocks were conditionally independent only while the old state remained fixed.

ONE COMPLETE DIRECT-METHOD STEP DRAW 1: WHEN 0 .5 1 0 .5 1
τ  (min)\tau\;(\mathrm{min})
S(τ)S(\tau)
u1=0.25τ=0.3014minu_1=0.25\Rightarrow\tau=0.3014\,\mathrm{min}
DRAW 2: WHICH addition removal
u2a0=4.278u_2a_0=4.278
a+=4.0,a=0.6,a0=4.6a_+=4.0,\quad a_-=0.6,\quad a_0=4.6
4.278[4.0,4.6)N:324.278\in[4.0,4.6)\Rightarrow N:3\mapsto2
compute every clock draw time draw channel apply jump rebuild clocks
Figure 10. One event exposes every moving part. The first draw inverts no-event survival. The second chooses a propensity interval. The hand trace ends by rebuilding the clocks in the new state.

Select the firing channel from cumulative propensity and update the state only after identifying that channel.

16Implement the direct method

A correct simulator is a short loop surrounded by explicit assertions and event logs.

  1. Initialize time tt, integer state nn, stop condition, and a reproducible random seed.
  2. Evaluate every ar(n)a_r(n). Assert that each value is finite and nonnegative.
  3. Set a0=rara_0=\sum_ra_r. If it is zero, stop at an absorbing state.
  4. Draw U1,U2(0,1)U_1,U_2\in(0,1). Set τ=lnU1/a0\tau=-\ln U_1/a_0.
  5. If t+τt+\tau passes the observation time, record the unchanged state there and stop.
  6. Choose the channel by equation (15), advance time, and apply nn+γjn\leftarrow n+\gamma_j.
  7. Assert integer nonnegative state, log time and channel, then return to step 2.

Store events rather than only regularly sampled output. A step path can be rendered later at any observation grid. Event times are also needed to test waiting-time models, while a regularly sampled trajectory may hide short episodes.

A complete reference implementation

The following Python uses only the standard library. Each returned pair records a state immediately after a jump; the last pair is an observation-time sentinel, not an event. The state between successive timestamps is constant. Parameters use minutes, with bb in additions/minute and dd in inverse minutes.

import math
import random

def addition_removal(b=4.0, d=0.2, end=60.0, n0=0, seed=123):
    assert all(math.isfinite(z) and z >= 0 for z in (b, d, end))
    assert isinstance(n0, int) and n0 >= 0
    rng = random.Random(seed)
    t, n = 0.0, n0
    history = [(t, n)]
    while t < end:
        total = b + d*n
        if total == 0:
            break
        u = rng.random()
        while u == 0:  # require an open lower endpoint for the logarithm
            u = rng.random()
        next_t = t - math.log(u)/total
        if next_t >= end:
            break
        n += 1 if rng.random()*total < b else -1
        assert n >= 0
        t = next_t
        history.append((t, n))
    history.append((end, n))
    return history

The horizon test must occur before applying the jump. Otherwise an event from the future contaminates the endpoint sample. At zero, removal has zero propensity; clipping a negative count would hide a broken event selector. A zero-total-hazard state still contributes its entire remaining residence time.

ONE MECHANISM, THREE QUESTIONS REACTIONS what can happen?
X\varnothing\rightsquigarrow X
a+(N)=ba_+(N)=b
XX\rightsquigarrow\varnothing
a(N)=dNa_-(N)=dN
m˙=bdm\dot{m}=b-dm
TWO HISTORIES + MEAN 0 10 20 30 0 10 20 30
t  (min)t\;(\mathrm{min})
NN
N(t)\langle N(t)\rangle
ONE ENSEMBLE 0 10 20 30 40 0 .04 .08
nn
pnp_n
A smooth mean, a jagged history, and a distribution are not interchangeable observations.
Figure 11. A path and an ensemble are different data products. Event histories, their expected trajectory, and a count distribution can all be derived from one mechanism. Validation compares like with like.

Implement the direct method without a fixed timestep and retain every holding interval. Use the following sections to turn the event log into a specified estimator.

17Estimate observables from event histories

Specify the quantity being estimated, then choose either independent histories or residence intervals as the sampling units.

Sample independent paths at a common time

An ensemble estimator averages realizations of one defined experiment. Let g(n)g(n) be a scalar observable of the count state and write Y(t)=g(NX(t))Y(t)=g(N_X(t)). Generate MM independent paths from the same initial law and parameters. Read each right-continuous path at the same physical time tt, giving Y(t)=g(NX()(t))Y_\ell(t)=g(N_X^{(\ell)}(t)). For M2M\geq2, define

m^g(t)=1M=1MY(t),sg2(t)=1M1=1M[Y(t)m^g(t)]2.\widehat m_g(t)=\frac1M\sum_{\ell=1}^M Y_\ell(t),\qquad s_g^2(t)=\frac1{M-1}\sum_{\ell=1}^M[Y_\ell(t)-\widehat m_g(t)]^2.

Independence makes the variances add. If σg2(t)=Var[g(NX(t))]\sigma_g^2(t)=\operatorname{Var}[g(N_X(t))] is finite, then Var[m^g(t)]=σg2(t)/M\operatorname{Var}[\widehat m_g(t)]=\sigma_g^2(t)/M. A sample standard error is sg(t)/Ms_g(t)/\sqrt M. This is pointwise uncertainty at a fixed time. It requires neither stationarity nor ergodicity.

Choose the observableThe ensemble average estimates
g(n)=nig(n)=n_iThe mean count of species XiX_i.
g(n)=ni2g(n)=n_i^2Its second raw moment. Combine with the mean to obtain variance.
g(n)=1{ni=k}g(n)=\mathbf1\{n_i=k\}The probability of count kk. Repeating over kk produces a histogram.
g(n)=1{nih}g(n)=\mathbf1\{n_i\geq h\}The probability of exceeding a chosen threshold hh.

A probability estimate also has a sampling scale. For an event with probability pp, its indicator has variance p(1p)p(1-p), so the estimator's standard deviation is p(1p)/M\sqrt{p(1-p)/M}. Observing no rare events does not prove that their probability or uncertainty is zero. A symmetric normal approximation can be poor when few events are observed.

A mean curve reuses the same paths at multiple times. Its pointwise errors are therefore correlated. In fact, Cov[m^g(t),m^g(s)]=Cov[Y(t),Y(s)]/M\operatorname{Cov}[\widehat m_g(t),\widehat m_g(s)]=\operatorname{Cov}[Y(t),Y(s)]/M. Averaging the tenth event of each path would answer a different question because those events occur at different physical times.

More paths and later endpoints perform different operations. Increasing MM improves the fixed-time estimate. Extending every run from tt to a later time does not add samples at tt. It permits a different target to be studied, whose variance may be larger or smaller.

Integrate one path with its holding times

An event log determines a finite-window time average exactly. Let its state be njn_j on [tj,tj+1)[t_j,t_{j+1}). Choose an observation window from tbt_b to tet_e, with duration T=tetb>0T=t_e-t_b>0. The weight of interval jj is its overlap with that window:

wj=max{0,min(tj+1,te)max(tj,tb)},g[tb,te]=1Tjwjg(nj).w_j=\max\{0,\min(t_{j+1},t_e)-\max(t_j,t_b)\},\qquad \overline g_{[t_b,t_e]}=\frac1T\sum_j w_jg(n_j).

This is the integral T1tbteg(NX(t))dtT^{-1}\int_{t_b}^{t_e}g(N_X(t))dt. No assumption about ergodicity is needed to define or calculate it. Stationary interpretation comes in the next section. An absorbing state contributes the remaining duration through tet_e. A simulation stopped by an event cap must not invent an unobserved tail.

The worked record makes the weights visible. Counts 2, 3 and 2 occupy successive durations 1, 0.2 and 2.8 minutes. The mean is [2(1)+3(0.2)+2(2.8)]/4=2.05[2(1)+3(0.2)+2(2.8)]/4=2.05. The occupancy of count at least 3 is 0.2/4=0.050.2/4=0.05. The following functions compute those integrals and read fixed-time snapshots from the same event-log representation.

import bisect
import math
import statistics

def time_average(history, observable=lambda n: n, start=0.0, end=None):
    end = history[-1][0] if end is None else end
    if not history[0][0] <= start < end <= history[-1][0]:
        raise ValueError('The complete observation window must be in the history.')
    area = 0.0
    for (t, n), (next_t, _) in zip(history, history[1:]):
        duration = max(0.0, min(next_t, end)-max(t, start))
        area += observable(n)*duration
    return area/(end-start)

def state_at(history, time):
    if not history[0][0] <= time <= history[-1][0]:
        raise ValueError('Observation time is outside the simulated history.')
    index = bisect.bisect_right([t for t, _ in history], time)-1
    return history[index][1]

def ensemble_estimate(histories, time, observable=lambda n: n):
    values = [observable(state_at(h, time)) for h in histories]
    if len(values) < 2:
        raise ValueError('At least two independent paths are needed for a sample SE.')
    return statistics.mean(values), math.sqrt(statistics.variance(values)/len(values))

def residence_mean(history, burn=0.0):
    return time_average(history, start=burn)

Apply the function to an indicator to obtain a time histogram. For example, time_average(history, lambda n: n == 0) returns the fraction of the window at zero. This is an occupancy fraction from one record. It becomes an estimator of a stationary zero probability only under the additional conditions below. The weighted second moment minus the squared weighted mean is a within-record variance. It is consistent under suitable ergodicity, but need not be unbiased at finite duration. Applying a Bessel correction based on the number of events does not remove time correlation or initialization bias.

ONE EVENT RECORD, TWO SAMPLING QUESTIONS TIME WEIGHTS ARE INTERVAL WIDTHS INDEPENDENT PATHS AT A FIXED TIME 0 1 2 3 4 0 2 4
t  (min)t\;(\mathrm{min})
N(t)N(t)
1 10 100 1000 10000 0 0.5 1
M  independent paths (log scale)M\;\text{independent paths (log scale)}
SE/σg(t)\mathrm{SE}/\sigma_g(t)
m^time=2.05,p^N3=0.05\widehat m_{\mathrm{time}}=2.05,\quad\widehat p_{N\geq3}=0.05
SE=σg(t)/M\mathrm{SE}=\sigma_g(t)/\sqrt{M}
Worked record, not an experimental measurement. Finite variance and independent realizations.
Figure 12. One event log supports distinct estimators. The left panel integrates a worked record by residence time. The right panel shows the exact M1/2M^{-1/2} standard-error scaling, normalized by the fixed-time observable standard deviation, for independent paths with finite variance.
An event log is not a time histogram

On an ergodic stationary class with finite positive mean total event rate, compare time sampling with event sampling. Predetermined regular times or residence-time weights estimate the time law. Erban, Chapman and Maini's example explicitly records at fixed time intervals.12 The variable a0(n)a_0(n) is the total outgoing propensity. Giving every pre-event state one vote favors states with larger a0(n)a_0(n). If π\pi is the stationary time law, its event-sampled counterpart is weighted by that rate.

π^(n)=iΔti1{ni=n}iΔti,πevent(n)=a0(n)π(n)ja0(j)π(j).\widehat\pi(n)=\frac{\sum_i\Delta t_i\,\mathbf1\{n_i=n\}}{\sum_i\Delta t_i},\qquad \pi_{\mathrm{event}}(n)=\frac{a_0(n)\pi(n)}{\sum_j a_0(j)\pi(j)}.

For a0(n)=b+dna_0(n)=b+dn and Poisson mean μ=b/d\mu=b/d, the event-sampled mean is [bμ+d(μ2+μ)]/(2b)=μ+1/2[b\mu+d(\mu^2+\mu)]/(2b)=\mu+1/2. Running longer makes that estimator converge more precisely to the wrong mean for time sampling. Regular-time observations avoid this weighting bias, although neighbors remain correlated.

WHAT DID THE HISTOGRAM SAMPLE? RESIDENCE-TIME WEIGHTED 0 2 4 6 8 10 12 14 0.00 0.10 0.20
nn
p(n)p(n)
π(n)=e44n/n!\pi(n)=e^{-4}4^n/n!
mean: theory 4.000; sampled 3.977 ONE VOTE PER PRE-JUMP STATE 0 2 4 6 8 10 12 14 0.00 0.10 0.20
nn
p(n)p(n)
πevent(n)=(4+n)π(n)/8\pi_{\mathrm{event}}(n)=(4+n)\pi(n)/8
mean: theory 4.500; sampled 4.468
Figure 13. One computed history, two sampling measures. Addition 4 per minute, removal 1 per molecule per minute; 20,000 minutes, first 100 discarded, seed 20260906. Stems are measurements from one event log; open circles are the distinct exact laws. Time sampling has mean 4; pre-event sampling has mean 4.5.
A path observable can also be averaged across paths

Independent-path averaging is not restricted to snapshots. Define a path functional FF, such as total occupancy over a window or the indicator that a threshold has been reached by time tt. Average its value across independent paths. The same M1/2M^{-1/2} standard-error rule applies when FF has finite variance.

Unfinished first passages must remain in the sample. Let τhit\tau_{\mathrm{hit}} be the first time the threshold is reached. If every path is simulated only to horizon HH, averaging only the observed hitting times selects early events. The data directly estimate the survival probability through HH and the restricted mean E[min(τhit,H)]\mathrm E[\min(\tau_{\mathrm{hit}},H)]. Estimating an unrestricted mean requires the unobserved tail to be resolved or modeled.

Read independent histories at common physical times for ensemble statistics. Weight holding intervals for time integrals. Keep the target, observation window and sampling unit attached to every reported estimate.

18Use a long history to estimate a stationary law

A long record is useful only when its dynamics sample the relevant states and the record spans enough correlation times.

State the ergodic claim

Ergodicity connects a time average to a stationary expectation. Let π(n)\pi(n) be a stationary probability law. For a nonexplosive, irreducible, positive recurrent continuous-time Markov chain, an observable with ng(n)π(n)<\sum_n|g(n)|\pi(n)<\infty obeys the corresponding ergodic time-average law:

1T0Tg(NX(t))dtng(n)π(n)with probability one.\frac1T\int_0^T g(N_X(t))dt\longrightarrow\sum_n g(n)\pi(n) \qquad\text{with probability one.}

Irreducibility means that the states in the relevant class communicate. Positive recurrence means that returns have finite mean waiting time and the stationary law can be normalized. These are sufficient conditions for this countable-state setting. An arbitrary initial condition within that class can still converge in the long-time average. Starting at stationarity is a stronger convenience used for the exact variance formula below.

The constant-addition, linear-removal model supplies an ergodic calibration. With b,d>0b,d>0, addition permits escape from zero and removal prevents indefinite accumulation. The chain on nonnegative counts is irreducible and positive recurrent, with the Poisson law already derived. A long residence-time histogram can therefore estimate that law.

Separate initialization bias from correlated sampling error

Discarding an initial interval changes the finite-window bias. Write μ=b/d\mu=b/d and suppose N(0)=n0N(0)=n_0. The exact transient mean is μ+(n0μ)edt\mu+(n_0-\mu)e^{-dt}. Integrating it over a window of length TT after a discarded interval tbt_b gives

E[N[tb,tb+T]]μ=(n0μ)edtb1edTdT.\mathrm E[\overline N_{[t_b,t_b+T]}]-\mu =(n_0-\mu)e^{-dt_b}\frac{1-e^{-dT}}{dT}.

A longer discarded interval reduces this bias, at the cost of simulation time. It does not create independent samples. In a metastable switch, a record may remain in one basin for much longer than its local relaxation time. A flat running mean within that basin is not evidence that all basins were sampled.

Temporal covariance gives the variance of a time average. Now assume the record starts at stationarity. Define Cg(τ)=Cov[g(NX(0)),g(NX(τ))]C_g(\tau)=\operatorname{Cov}[g(N_X(0)),g(N_X(\tau))] and σg2=Cg(0)>0\sigma_g^2=C_g(0)>0. Expand the variance of the integral into a double integral. Stationarity makes each covariance depend only on the separation of the two times:

Var(g(T))=1T20T ⁣0TCg(ts)dtds=2T20T(Tτ)Cg(τ)dτ.\begin{aligned} \operatorname{Var}(\overline g(T)) &=\frac1{T^2}\int_0^T\!\int_0^T C_g(|t-s|)\,dt\,ds\\ &=\frac2{T^2}\int_0^T(T-\tau)C_g(\tau)\,d\tau. \end{aligned}

For a separation τ\tau, one ordering of the two times occupies length TτT-\tau. The factor two includes the opposite ordering. This is why densely spaced frames do not count as independent observations.

The integrated correlation time controls the long-window error. Define ρg(τ)=Cg(τ)/σg2\rho_g(\tau)=C_g(\tau)/\sigma_g^2 and τint=0ρg(τ)dτ\tau_{\mathrm{int}}=\int_0^\infty\rho_g(\tau)d\tau. When the covariance is integrable and the window covers its decay,

Var(g(T))2σg2τintT,MeffT2τint.\operatorname{Var}(\overline g(T))\approx\frac{2\sigma_g^2\tau_{\mathrm{int}}}{T},\qquad M_{\mathrm{eff}}\approx\frac{T}{2\tau_{\mathrm{int}}}.

Here MeffM_{\mathrm{eff}} is the number of independent stationary observations that would give the same leading variance. It is specific to the observable. Ergodicity alone does not guarantee this error law. A normal confidence interval additionally needs an appropriate central limit theorem and a reliable estimate of long-lag covariance.

Turnover changes precision at fixed mean count

The calibration model gives every term exactly. Its stationary covariance is CN(τ)=μedτC_N(\tau)=\mu e^{-d\tau}, as derived from the conditional mean earlier. Therefore τint=1/d\tau_{\mathrm{int}}=1/d. Substitute this covariance into the finite-window integral:

Var(N(T))=2μT2[Td1edTd2]2μdT(dT1).\operatorname{Var}(\overline N(T)) =\frac{2\mu}{T^2}\left[\frac{T}{d}-\frac{1-e^{-dT}}{d^2}\right] \simeq\frac{2\mu}{dT}\quad(dT\gg1).

Speeding both clocks preserves the snapshot law. At fixed μ=20\mu=20, changing (b,d)(b,d) from (1,0.05)(1,0.05) to (16,0.8)(16,0.8), with time measured in minutes, leaves the stationary Poisson mean and variance at 20. The correlation time falls from 20 minutes to 1.25 minutes. The exact standard deviation of a stationary 60-minute time average falls from about 3.02 to 0.90 counts.

ONE STATIONARY DISTRIBUTION, THREE MEMORY TIMES 0 20 40 60 0 0.5 1
τ  (min)\tau\;(\mathrm{min})
ρ(τ)\rho(\tau)
0 20 40 60 0 2 4
T  (min)T\;(\mathrm{min})
SD(N(T))\mathrm{SD}(\overline{N}(T))
COUNT AUTOCORRELATION UNCERTAINTY OF A TIME AVERAGE
d=0.05min1d=0.05\,\mathrm{min}^{-1}
d=0.2min1d=0.2\,\mathrm{min}^{-1}
d=0.8min1d=0.8\,\mathrm{min}^{-1}
Figure 14. Faster turnover improves temporal averaging without narrowing this snapshot distribution. All three processes have stationary Poisson mean 20; addition is adjusted to b=20db=20d. The right-hand curves use the exact finite-window variance, not an independent-frame approximation. At zero window length the standard deviation approaches 20\sqrt{20}.
Checkpoint 3: Does one stationary 60-minute movie with removal 0.2/min estimate the mean as accurately as 5,000 independent snapshots?

No. At mean 20, the time-average standard deviation is about 1.748 counts from the exact finite-window formula. The independent-snapshot mean has standard error 20/50000.06325\sqrt{20/5000}\approx0.06325 counts. The movie's long-window effective count is about 60/[2(5)]=660/[2(5)]=6. More frames do not increase that effective count.

Independent long records can improve a stationary estimate in both ways. If each of MM independent, stationary paths has length TT, averaging their time averages gives leading variance 2σg2τint/(MT)2\sigma_g^2\tau_{\mathrm{int}}/(MT). This combines independent replication with time averaging. It is a different estimator from a snapshot at the final time.

For a stationary target, check accessible states, initialization and correlation. Use path number to quantify independent replication and integrated correlation time to quantify information in a long record.

19Check which states one history can sample

An absorbing boundary can remove the stationary positive-population regime needed for a long-path estimate. The exact consequence depends on the reaction mechanism.

Balanced autocatalysis separates finite-time means from long histories

Use the autocatalytic boundary already introduced. Let composite addition X2XX\rightsquigarrow2X and removal XX\rightsquigarrow\varnothing have propensities a+(n)=βna_+(n)=\beta n and a(n)=βna_-(n)=\beta n, with β>0\beta>0 in inverse time. The omitted resources are held fixed by the model. Start with one molecule. Write N(t)N(t) for the count of XX. This is the critical linear branching process.

The generator gives a constant ensemble mean. Addition and removal change the count by opposite amounts at equal rates. Apply the generator to g1(n)=ng_1(n)=n and g2(n)=n2g_2(n)=n^2:

(Lg1)(n)=βnβn=0,(Lg2)(n)=βn[(n+1)2+(n1)22n2]=2βn.(\mathcal Lg_1)(n)=\beta n-\beta n=0,\qquad (\mathcal Lg_2)(n)=\beta n[(n+1)^2+(n-1)^2-2n^2]=2\beta n.

Thus E[N(t)]=1\mathrm E[N(t)]=1 and Var[N(t)]=2βt\operatorname{Var}[N(t)]=2\beta t. An independent-path estimate at fixed tt has standard deviation 2βt/M\sqrt{2\beta t/M}. Increasing the time while holding the number of paths fixed makes this estimate less precise.

Derive extinction from the branching property. Let q(t)=Pr[N(t)=0N(0)=1]q(t)=\Pr[N(t)=0\mid N(0)=1]. In an initial interval of length hh, removal leaves zero descendants, addition creates two independent lineages, and no event leaves one. For the probability of extinction after the remaining time tt,

q(t+h)=βh+(12βh)q(t)+βhq(t)2+o(h).q(t+h)=\beta h+(1-2\beta h)q(t)+\beta h\,q(t)^2+o(h).

Subtract q(t)q(t), divide by hh and let it shrink. With q(0)=0q(0)=0, the resulting equation separates:

q˙=β(1q)2,11q(t)=1+βt,q(t)=βt1+βt.\dot q=\beta(1-q)^2,\qquad \frac1{1-q(t)}=1+\beta t,\qquad q(t)=\frac{\beta t}{1+\beta t}.

Zero is absorbing, so q(t)q(t) is also the probability of having become extinct by time tt. Its limit is one. Every path therefore reaches zero in finite time with probability one. The mean extinction time can still be infinite because 0[1q(t)]dt\int_0^\infty[1-q(t)]dt diverges.

Rare surviving paths carry the finite-time mean. Since extinct paths contribute zero, dividing the full mean by the survival probability gives

Pr[N(t)>0]=11+βt,E[N(t)N(t)>0]=1+βt.\Pr[N(t)>0]=\frac1{1+\beta t},\qquad \mathrm E[N(t)\mid N(t)>0]=1+\beta t.

At βt=99\beta t=99, 99% of paths have count zero. The surviving 1% have mean count 100, leaving full mean 1. A large ensemble and one late-time history can therefore look very different while both follow the same exact reaction model.

BALANCED AUTOCATALYSIS: A LONG PATH DOES NOT ESTIMATE THE FINITE-TIME MEAN TWELVE SEEDED SSA PATHS SURVIVAL PROBABILITY TWO ENSEMBLE MEANS 0 15 30 0 2 5
t  (min)t\;(\mathrm{min})
N(t)N(t)
0 15 30 0 0.5 1
t  (min)t\;(\mathrm{min})
Pr[N(t)>0]\Pr[N(t)>0]
0 15 30 0 15 30
t  (min)t\;(\mathrm{min})
E[N(t)]\mathrm E[N(t)]
a+(n)=a(n)=βn,N(0)=1a_+(n)=a_-(n)=\beta n,\quad N(0)=1
Pr[N(t)>0]=(1+βt)1\Pr[N(t)>0]=(1+\beta t)^{-1}
teal: all paths blue: surviving paths only
β=1min1;the survival and mean curves are exact, not estimates from the twelve paths.\beta=1\,\mathrm{min}^{-1};\quad\text{the survival and mean curves are exact, not estimates from the twelve paths.}
Figure 15. Extinction can coexist with a constant ensemble mean. Left: twelve unselected, seeded SSA paths of the critical model, each starting at one molecule. Middle: exact survival probability. Right: exact mean over all paths and exact conditional mean over survivors. The exact curves are not averages of the twelve displayed paths. Rate β=1min1\beta=1\,\mathrm{min}^{-1}.
Which ergodic claim failed?

The long-path average is dominated by the absorbing tail. Each realized path has only a finite pre-extinction history, followed by zero forever. Consequently N(T)0\overline N(T)\to0 with probability one, while E[N(T)]=1\mathrm E[\overline N(T)]=1 for every finite TT. Taking an expectation and taking the infinite-time limit cannot be interchanged here.

The absorbing stationary law itself is not a counterexample to ergodicity. The law concentrated at zero is stationary, and a path started there has both time and ensemble mean zero. The failed substitution would use one long extinct path to estimate the nonstationary ensemble mean starting from one molecule. Convergence of its distribution toward zero does not force convergence of its unbounded count mean. The rare, increasingly large survivors prevent the uniform integrability needed for that step.

The usual inverse-duration error formula does not apply. This process is not a stationary record with integrable count autocorrelation. For sts\leq t, the conditional mean is E[N(t)N(s)]=N(s)\mathrm E[N(t)\mid N(s)]=N(s), so Cov[N(s),N(t)]=2βs\operatorname{Cov}[N(s),N(t)]=2\beta s. Integrating this nonstationary covariance gives Var(N(T))=2βT/3\operatorname{Var}(\overline N(T))=2\beta T/3. The growing variance and almost-sure limit zero are compatible because of rare large paths.

Multiple absorbing outcomes give a stationary nonergodic example

A finite autocatalytic system can have more than one closed class. Consider two modeled elementary reactions with equal microscopic rate constant kk:

X+Yk2X,X+Yk2Y.X+Y\xrightarrow{k}2X,\qquad X+Y\xrightarrow{k}2Y.

At fixed volume, let the conserved total count be KK, with nn molecules of species XX and KnK-n of species YY. The count-scale constant is κ=k/(NAV)\kappa=k/(N_A V), in inverse time, by the distinct-reactant conversion in Section 5. Both transition propensities are κn(Kn)\kappa n(K-n). Counts zero and KK are absorbing. Every interior state has the same probability of jumping up or down.

One path selects an outcome that an ensemble can mix. Write N(t)N(t) for the random count of XX. If N(0)=n0N(0)=n_0, the symmetric finite random walk reaches KK with probability n0/Kn_0/K. The bounded count has unchanged conditional expectation after each step, so its ensemble mean stays n0n_0. A single path's time mean instead tends to its final count, either zero or KK. For 0<n0<K0<n_0<K, neither outcome equals that ensemble mean.

A stationary mixture of those outcomes is nonergodic. The stationary law (1n0/K)δ0+(n0/K)δK(1-n_0/K)\delta_0+(n_0/K)\delta_K places its probability on two closed classes. A path stays in the class selected at initialization and cannot sample the mixture. This is a literal failure of stationary ergodicity, distinct from the critical model's nonstationary rare-survivor effect.

Absorption has to be interpreted with the rates. For linear autocatalysis with addition kaddnk_{\mathrm{add}}n and removal dndn, with both constants in inverse time, kadd<dk_{\mathrm{add}}<d gives an ensemble mean that decays to zero as well as almost-sure extinction. There is then no disagreement between the two limiting means. Slow switching in an irreducible positive recurrent system presents another situation: asymptotic ergodicity may hold while the available record is too short to use it.

Inspect absorbing states and communicating classes before replacing an ensemble by a long trajectory. Distinguish stationary nonergodicity, a nonstationary extinction limit and an ergodic system observed for too little time.

20Validate before interpreting

A plausible trajectory is almost no evidence that simulation code is correct.

Validation proceeds from invariants to distributions. Assert the state never leaves its admissible lattice. Confirm absorbing states remain absorbing. For the constant-addition, first-order-removal model, compare fixed-time ensemble means and variances with the exact transient predictions for the chosen initial state. Compare against the stationary value b/db/d only after checking relaxation. Compare the entire histogram, not just two moments. Use separate checks for initialization bias, finite-path error and time correlation.

Then run limiting cases. Set addition to zero and check monotone extinction. Set removal to zero and compare event counts with a Poisson process. Increase volume by RVR_V at fixed concentration and check the predicted RV1/2R_V^{-1/2} relative-noise scaling. Gillespie, Hellander, and Petzold describe the exact method and approximation ladder in enough detail to make these tests model-specific.2

Exact has a scope

The direct SSA samples the stated well-mixed Markov jump process without timestep approximation. Floating-point arithmetic aside, it is exact for that CME. It is not exact spatial chemistry, exact crowding, or exact biology.

Checkpoint 4: What tests can reject the reference implementation without inspecting a plot?

With b=0,n0=0b=0,n_0=0, every state must be zero. With d=0d=0, counts must be nondecreasing and the endpoint increment is Poisson with mean bTbT. With both constants zero and n0=7n_0=7, the residence mean must equal 7 for any legal burn. Reusing a seed must reproduce the entire history. For 5,000 independent (b,d,T,n0)=(4,0.2,60,0)(b,d,T,n_0)=(4,0.2,60,0) paths, the exact transient mean is 19.999877; deviations of a few hundredths are ordinary sampling error.

Reject an implementation that violates a count boundary, conservation law or analytic calibration before interpreting its biology.

Part 5

Go beyond Poisson

Once the calibration passes, hidden biological clocks can be added and their signatures compared with data.

21Translation amplifies

One mRNA can create a random packet of proteins before it disappears.

Let GG be a fixed gene-copy count, MM the RNA count and PP the protein count. Transcription per gene and translation per RNA have constants kmk_m and kpk_p; per-molecule removal constants are γm\gamma_m and γp\gamma_p. All four channels are composite:

GG+M,MM+P,M,P,(a1,a2,a3,a4)=(kmG,kpM,γmM,γpP).G\rightsquigarrow G+M,\quad M\rightsquigarrow M+P,\quad M\rightsquigarrow\varnothing,\quad P\rightsquigarrow\varnothing, \qquad (a_1,a_2,a_3,a_4)=(k_mG,k_pM,\gamma_mM,\gamma_pP). (16)

Take GG constant: gene replication and promoter switching are not part of this model. All four constants have inverse-time units when gene, RNA and protein copies are dimensionless counts. Let pm,p(t)p_{m,p}(t) denote the joint probability of mm RNAs and pp proteins, and put it to zero outside the legal lattice. The four-channel CME is

p˙m,p=kmG(pm1,ppm,p)+kpm(pm,p1pm,p)+γm[(m+1)pm+1,pmpm,p]+γp[(p+1)pm,p+1ppm,p].\begin{aligned} \dot p_{m,p}={}&k_mG(p_{m-1,p}-p_{m,p})+k_pm(p_{m,p-1}-p_{m,p})\\ &+\gamma_m[(m+1)p_{m+1,p}-mp_{m,p}]\\ &+\gamma_p[(p+1)p_{m,p+1}-pp_{m,p}]. \end{aligned}

The translation predecessor has the same RNA count: translation does not consume its template. Coordinate observables give mˉ˙=kmGγmmˉ\dot{\bar m}=k_mG-\gamma_m\bar m and pˉ˙=kpmˉγppˉ\dot{\bar p}=k_p\bar m-\gamma_p\bar p. Because all propensities are affine, these means and the second moments close exactly. We will derive

FP=1+kpγm+γp.F_P=1+\frac{k_p}{\gamma_m+\gamma_p}. (17)

Write count covariance as Σij=Cov(NXi,NXj)\Sigma_{ij}=\operatorname{Cov}(N_{X_i},N_{X_j}), keeping CC available for molecular complexes. Here the count shorthand is MM for RNA and PP for protein. At stationarity, the RNA subsystem is Poisson: mˉ=kmG/γm\bar m=k_mG/\gamma_m and ΣMM=mˉ\Sigma_{MM}=\bar m. Protein mean is pˉ=kpmˉ/γp\bar p=k_p\bar m/\gamma_p.

For the mixed observable mpmp, transcription adds pp, translation adds mm, RNA removal subtracts pp, and protein removal subtracts mm. Multiplying each increment by its clock gives L(mp)=kmGp+kpm2(γm+γp)mp\mathcal L(mp)=k_mGp+k_pm^2-(\gamma_m+\gamma_p)mp. Differentiate E[MP]mˉpˉ\mathrm E[MP]-\bar m\bar p to obtain

Σ˙MP=kpΣMM(γm+γp)ΣMP,ΣMP=kpmˉγm+γp.\dot\Sigma_{MP}=k_p\Sigma_{MM}-(\gamma_m+\gamma_p)\Sigma_{MP},\qquad \Sigma_{MP}^{*}=\frac{k_p\bar m}{\gamma_m+\gamma_p}.

Apply the squared-count calculation of Section 12 to protein. Its addition clock now fluctuates with RNA, leaving an extra covariance term:

Σ˙PP=kpmˉ+γppˉ+2kpΣMP2γpΣPP.ΣPP=pˉ+kpγpΣMP.\dot\Sigma_{PP}=k_p\bar m+\gamma_p\bar p+2k_p\Sigma_{MP}-2\gamma_p\Sigma_{PP}. \qquad\Sigma_{PP}^{*}=\bar p+\frac{k_p}{\gamma_p}\Sigma_{MP}^{*}.

Divide by pˉ\bar p and use kpmˉ=γppˉk_p\bar m=\gamma_p\bar p to recover equation (17). The first term is the protein event contribution. The second records how long protein retains a fluctuating RNA input. No Gaussian assumption has been made.

If protein is much longer lived than mRNA, the excess approaches kp/γmk_p/\gamma_m, the mean number of translation events during one mRNA lifetime. Thattai and van Oudenaarden used this architecture to analyze intrinsic gene-expression noise.4 The interpretation still needs a copy-number check. When many mRNAs overlap, a high Fano factor does not imply visually isolated protein bursts in a single trace.

Checkpoint 5: What controls relative protein noise in the short-RNA limit?

With fixed GG and γpγm\gamma_p\ll\gamma_m, CVP21/pˉ+γp/(kmG)\mathrm{CV}_P^2\simeq1/\bar p+\gamma_p/(k_mG). The second term is the inverse number of transcripts initiated during a protein's mean lifetime. The relevant averaging count is not simply the number of RNAs present in one snapshot.14

Estimate translational amplification from the ratio of protein-synthesis and mRNA-removal clocks, without inferring isolated bursts from a Fano factor alone.

22Promoters create environments

When the addition rate switches, the molecule count is driven by a stochastic input rather than one fixed clock.

Resolve one promoter into off and on states. Write its binary state as g{0,1}g\in\{0,1\} and its RNA count as nn. The composite channels have conditional propensities

G0G1:aon(g,n)=α(1g),G1G0:aoff(g,n)=βg,G1G1+M:a+(g,n)=kg,M:a(g,n)=γn.\begin{aligned} G_0\rightsquigarrow G_1 &: \quad a_{\mathrm{on}}(g,n)=\alpha(1-g),\\ G_1\rightsquigarrow G_0 &: \quad a_{\mathrm{off}}(g,n)=\beta g,\\ G_1\rightsquigarrow G_1+M &: \quad a_+(g,n)=kg,\\ M\rightsquigarrow\varnothing &: \quad a_-(g,n)=\gamma n. \end{aligned} (18)

All four constants are inverse-time quantities in this count model; kk is the on-state transcription propensity, not a bimolecular binding constant. Use uppercase G(t)G(t) and M(t)M(t) for the random promoter indicator and RNA count, and lowercase g,ng,n for their values. With pg,n=Pr(G=g,M=n)p_{g,n}=\Pr(G=g,M=n), the two coupled probability equations are

p˙0,n=αp0,n+βp1,n+γ[(n+1)p0,n+1np0,n],p˙1,n=αp0,nβp1,n+k[p1,n1p1,n]+γ[(n+1)p1,n+1np1,n].\begin{aligned} \dot p_{0,n}&=-\alpha p_{0,n}+\beta p_{1,n}+\gamma[(n+1)p_{0,n+1}-np_{0,n}],\\ \dot p_{1,n}&=\alpha p_{0,n}-\beta p_{1,n}+k[p_{1,n-1}-p_{1,n}]\\ &\hspace{2em}+\gamma[(n+1)p_{1,n+1}-np_{1,n}]. \end{aligned}

Summing over nn recovers the promoter equation from Section 9. Summing over promoter states does not close an RNA-only CME: its addition term still involves p1,np_{1,n}. The exact stationary mean and Fano factor are

M=kαγ(α+β),FM=1+kβ(α+β)(γ+α+β).\langle M\rangle=\frac{k\alpha}{\gamma(\alpha+\beta)},\qquad F_M=1+\frac{k\beta}{(\alpha+\beta)(\gamma+\alpha+\beta)}. (19)

The on fraction fixes the mean, while the switching clock controls how much promoter variation survives mRNA filtering. This explains why the same occupancy can give either modest overdispersion or long expression episodes. It does not make a two-state promoter generically bimodal.

To derive equation (19), put pon=G=α/(α+β)p_{\mathrm{on}}=\langle G\rangle=\alpha/(\alpha+\beta) and mˉ=M=kpon/γ\bar m=\langle M\rangle=kp_{\mathrm{on}}/\gamma. Since G2=GG^2=G, the mixed moment closes:

dGMdt=αM(α+β+γ)GM+kG.\frac{d\langle GM\rangle}{dt}=\alpha\langle M\rangle-(\alpha+\beta+\gamma)\langle GM\rangle+k\langle G\rangle.

At stationarity this yields Cov(G,M)=kpon(1pon)/(γ+α+β)\operatorname{Cov}(G,M)=kp_{\mathrm{on}}(1-p_{\mathrm{on}})/(\gamma+\alpha+\beta). The RNA variance equation is Σ˙MM=kG+γM+2kCov(G,M)2γΣMM\dot\Sigma_{MM}=k\langle G\rangle+\gamma\langle M\rangle+2k\operatorname{Cov}(G,M)-2\gamma\Sigma_{MM}. Thus ΣMM=mˉ+(k/γ)Cov(G,M)\Sigma_{MM}^{*}=\bar m+(k/\gamma)\operatorname{Cov}(G,M), yielding equation (19). Excess variance records a correlation erased by substituting the promoter's mean. This is the concrete question carried into Lecture 6.

The promoter covariance itself is pon(1pon)e(α+β)τp_{\mathrm{on}}(1-p_{\mathrm{on}})e^{-(\alpha+\beta)|\tau|}, obtained from the conditional relaxation in Section 9. RNA remembers that input for time 1/γ1/\gamma. Multiplying both switching constants by a large factor keeps occupancy fixed but shortens the input memory. For this unregulated model, the extra Fano term vanishes in that limit.

EQUAL OCCUPANCY DOES NOT MEAN EQUAL EVIDENCE 0 10 20 30 40 0 10 20 30
t   in mRNA lifetimest\;\text{ in mRNA lifetimes}
NMN_M
FAST SWITCHING
NM=12,F=1.381\langle N_M\rangle=12,\quad F=1.381
0 10 20 30 40 0 10 20 30
t   in mRNA lifetimest\;\text{ in mRNA lifetimes}
NMN_M
SLOW SWITCHING
NM=12,F=7.667\langle N_M\rangle=12,\quad F=7.667
Both models have stationary on-probability 0.6; a short trace need not spend 60% on. 0 10 20 30 40 0 0.3
nn
pnp_n
fast endpoint distribution 0 10 20 30 40 0 0.3
nn
pnp_n
slow endpoint distribution 2,500 independent endpoints per model at t = 100 RNA lifetimes; each starts off with zero RNA.
Figure 16. Equal stationary occupancy and mean do not imply equal temporal evidence. Both models have on-probability 0.6 and stationary mean 12. A finite trace need not realize those averages. Slow switching remains visible as episodes and raises the exact Fano factor from 1.381 to 7.667. Endpoint histograms use the same count and probability scales.

Predict how promoter switching changes the mean, covariance and Fano factor, and compare switching time with transcript lifetime.

23Derive random protein packets

A burst has a size distribution and an observation window. Both enter its noise.

Follow one newly made transcript. While it is alive, translation events have propensity kpk_p and removal has propensity γm\gamma_m. At the next event, translation wins with probability q=kp/(kp+γm)q=k_p/(k_p+\gamma_m). After translation the same two clocks restart, because the transcript is still present. Exactly jj translations followed by removal therefore has probability

Pr(B=j)=(1q)qj,j=0,1,;B=q1q=kpγm,E[B2]=B+2B2.\Pr(B=j)=(1-q)q^j,\quad j=0,1,\ldots;\qquad \overline B=\frac q{1-q}=\frac{k_p}{\gamma_m},\qquad \mathrm E[B^2]=\overline B+2\overline B^2. (20)

This geometric law includes a zero-protein transcript. Conditioning on an experimentally detected nonzero burst changes the distribution and its mean. The packet becomes an effectively instantaneous event for protein only when the RNA lifetime is short compared with the protein timescale being resolved. The two-stage model in Section 21 remains appropriate outside that limit.

An order-of-magnitude estimate is a translation every ten seconds over a mean three-minute RNA life: B18\overline B\simeq18. This is an illustrative calculation, not a universal biological constant. Cai, Friedman and Xie inferred 20±820\pm8 protein monomers, or 5±25\pm2 active tetramers, per burst for their weakly expressed β-galactosidase reporter. Catalytic amplification, calibration and membrane permeability enter that inference.13 A transcriptional burst instead counts RNAs made during one promoter-on episode; do not attach a protein packet estimate to it.

First count packets in a window without removal

Let KPoisson(ρT)K\sim\operatorname{Poisson}(\rho T) be the number of independent packet arrivals in time TT. Sizes B1,B2,B_1,B_2,\ldots are independent of arrivals and of one another. Total additions are Y=i=1KBiY=\sum_{i=1}^{K}B_i. Condition on KK, then use total expectation and total variance:

E[Y]=E[K]B=ρTB,Var(Y)=E[K]Var(B)+Var(K)B2=ρTE[B2].\begin{aligned} \mathrm E[Y]&=\mathrm E[K]\overline B=\rho T\overline B,\\ \operatorname{Var}(Y)&=\mathrm E[K]\operatorname{Var}(B)+\operatorname{Var}(K)\overline B^2 =\rho T\mathrm E[B^2]. \end{aligned}

Thus Fwindow=E[B2]/BF_{\mathrm{window}}=\mathrm E[B^2]/\overline B. Fixed-size packets give F=BF=B; geometric packets give F=1+2BF=1+2\overline B. These are laws for accumulated additions, not stationary abundance. The core's fixed-packet counting argument belongs to this window calculation.

Now let molecules disappear independently

Add first-order removal with propensity dndn. The composite addition channel is BX\varnothing\rightsquigarrow B X, where the integer packet size is drawn at an arrival; equivalently, use one channel of jump jj and propensity ρPr(B=j)\rho\Pr(B=j) for every positive jj. A zero packet changes no state. Applying the generator to nn and n2n^2 gives

m˙=ρBdm,dσ2dt=ρE[B2]+dm2dσ2.\dot m=\rho\overline B-dm,\qquad \frac{d\sigma^2}{dt}=\rho\mathrm E[B^2]+dm-2d\sigma^2.

At stationarity dm=ρBdm=\rho\overline B, so

Fstationary=12(1+E[B2]B).Ffixed=1+B2,Fgeometric=1+B.F_{\mathrm{stationary}}=\frac12\left(1+\frac{\mathrm E[B^2]}{\overline B}\right). \qquad F_{\mathrm{fixed}}=\frac{1+B}{2},\quad F_{\mathrm{geometric}}=1+\overline B. (21)

The difference is physical: older packets have been independently thinned by removal. A stationary pool contains a mixture of packet ages, whereas our first window retained every arrival. Equation (21) is exact for the instantaneous-packet model; it agrees with the fast-RNA limit of Section 21. At arbitrary RNA lifetimes, use the full two-stage Fano factor.

DO NOT TRANSFER A WINDOW FANO FACTOR TO A STATIONARY POOL A GEOMETRIC PACKET: MEAN 4 SAME MEAN PACKET SIZE, DIFFERENT F 0 6 12 18 0.0 0.1 0.2
BB
Pr(B=k)\Pr(B=k)
1 4 7 10 0 10 20
E[B]\mathrm E[B]
FF
geometric, window geometric, stationary fixed, window fixed, stationary
Figure 17. A packet's mean is insufficient to determine noise. Left: an exact geometric size distribution with mean 4, including zero packets. Right: exact Fano factors for accumulated additions without removal and for stationary abundance with independent first-order removal. The fixed-packet curves interpolate their values at integer packet sizes.
Checkpoint 6: For mean packet size 20, which Fano factor should a student report?

State the model and observable first. Fixed packets: window 20, stationary 10.5. Geometric packets: window 41, stationary 21. For finite RNA lifetime use 1+kp/(γm+γp)1+k_p/(\gamma_m+\gamma_p) instead. None is a contradiction of another.

Derive a packet distribution from competing clocks and calculate its noise for the actual observation window.

24Derive the distribution limits

Poisson, negative binomial, gamma and log-normal describe regimes and mechanisms, not fixed categories of molecules.

Geometric packets give an exact negative binomial

Define the probability-generating function H(z)=E[zN]=n0pnznH(z)=\mathrm E[z^N]=\sum_{n\ge0}p_nz^n. A packet multiplies znz^n by zBz^B. Its own generating function is gB(z)=1/[1+B(1z)]g_B(z)=1/[1+\overline B(1-z)], obtained by summing the geometric series in equation (20). Removal contributes d(1z)H(z)d(1-z)H'(z). The stationary generator equation becomes

0=ρ[gB(z)1]H(z)+d(1z)H(z).HH=rB1+B(1z),r=ρ/d.0=\rho[g_B(z)-1]H(z)+d(1-z)H'(z). \qquad\frac{H'}H=\frac{r\overline B}{1+\overline B(1-z)},\quad r=\rho/d.

Integrate and impose H(1)=1H(1)=1. The result and its series coefficients are

H(z)=[1+B(1z)]r,pn=rnn!Bn(1+B)n+r,H(z)=[1+\overline B(1-z)]^{-r},\qquad p_n=\frac{r^{\overline{n}}}{n!}\frac{\overline B^n}{(1+\overline B)^{n+r}}, (22)

Here r0=1r^{\overline{0}}=1 and rn=r(r+1)(r+n1)r^{\overline{n}}=r(r+1)\cdots(r+n-1) is a rising factorial. It is different from the falling factorial (n)m(n)_m used to count available reactants in Section 5. The series coefficient follows by differentiating (1x)r(1-x)^{-r} nn times at zero, which produces the successive factors r,r+1,,r+n1r,r+1,\ldots,r+n-1.

This is a negative-binomial distribution with possibly noninteger shape rr. Differentiating HH at 1 recovers mean rBr\overline B and variance rB(1+B)r\overline B(1+\overline B). Shahrezaei and Swain derive this law from the short-lived-RNA limit of gene expression.8

What the continuous gamma approximation removes

Keep rr fixed and scale abundance as Y=N/BY=N/\overline B while B\overline B grows. The Laplace transform is H(es/B)H(e^{-s/\overline B}). Since B(1es/B)s\overline B(1-e^{-s/\overline B})\longrightarrow s, it tends to (1+s)r(1+s)^{-r}, the transform of the gamma density

pY(y)=yr1eyΓ(r),y>0,Γ(r)=0ur1eudu.p_Y(y)=\frac{y^{r-1}e^{-y}}{\Gamma(r)},\quad y>0, \qquad \Gamma(r)=\int_0^\infty u^{r-1}e^{-u}du.

The function Γ(r)\Gamma(r) here is Euler's gamma function, not the stoichiometric matrix. The limiting density has mean rr and variance rr. Restoring the abundance scale gives mean rBr\overline B and variance rB2r\overline B^2. Compared with the discrete model, the extra variance rBr\overline B has been neglected.

Friedman, Cai and Xie's continuous burst model uses exponentially distributed jumps and continuous removal; its gamma law has this same distinction from a discrete count CME.15 A continuous density has no point mass at zero. It must not be used to read off the probability of zero RNA or zero protein. That probability in equation (22) is (1+B)r(1+\overline B)^{-r}.

FIX THE SHAPE AT TWO; INCREASE THE MEAN PACKET SIZE
b=1b=1
0 2 4 6 0 0.2 0.4
y=n/by=n/b
scaled mass / density\text{scaled mass / density}
zero-count mass = 0.2500
b=4b=4
0 2 4 6 0 0.2 0.4
y=n/by=n/b
scaled mass / density\text{scaled mass / density}
zero-count mass = 0.0400
b=20b=20
0 2 4 6 0 0.2 0.4
y=n/by=n/b
scaled mass / density\text{scaled mass / density}
zero-count mass = 0.0023 Dots: probability divided by lattice spacing. Curve: the limiting gamma density.
Figure 18. The gamma curve emerges under a declared rescaling. Shape is fixed at 2; the figure abbreviates mean packet size as b=Bb=\overline B, increasing from 1 to 20. To compare a mass function with a density on y=n/By=n/\overline B, each probability is divided by lattice spacing 1/B1/\overline B. Thus dots show Bpn\overline B p_n, not raw probabilities. The annotated zero-count probabilities remain discrete-model quantities.

The telegraph model has a different exact mixture

For the unregulated promoter of Section 22, condition on its entire stationary history. RNA additions are then an inhomogeneous Poisson process, and independent removal thins them. The surviving RNA count is Poisson with random mean (k/γ)U(k/\gamma)U, where

U(t)=γteγ(ts)G(s)ds,U˙=γ(GU),0U1.U(t)=\gamma\int_{-\infty}^t e^{-\gamma(t-s)}G(s)ds,\qquad \dot U=\gamma(G-U),\quad0\le U\le1.

Let ρ0(u)\rho_0(u) and ρ1(u)\rho_1(u) be stationary densities jointly with promoter state. Probability transport under the two deterministic velocities, combined with promoter switching, gives

0=γddu(uρ0)αρ0+βρ1,0=γddu[(1u)ρ1]+αρ0βρ1.\begin{aligned} 0&=\gamma\frac d{du}(u\rho_0)-\alpha\rho_0+\beta\rho_1,\\ 0&=-\gamma\frac d{du}[(1-u)\rho_1]+\alpha\rho_0-\beta\rho_1. \end{aligned}

Add the equations. Zero boundary flux implies uρ0=(1u)ρ1u\rho_0=(1-u)\rho_1. With ρ=ρ0+ρ1\rho=\rho_0+\rho_1, this means ρ1=uρ\rho_1=u\rho and ρ0=(1u)ρ\rho_0=(1-u)\rho. Substitute into the first equation and divide by u(1u)ρu(1-u)\rho:

ρρ=α/γ1uβ/γ11u.UBeta(α/γ,β/γ).\frac{\rho'}\rho=\frac{\alpha/\gamma-1}{u}-\frac{\beta/\gamma-1}{1-u}. \quad\Longrightarrow\quad U\sim\operatorname{Beta}(\alpha/\gamma,\beta/\gamma).

Thus stationary RNA is a Poisson–beta mixture: sample UU, then sample MUPoisson(kU/γ)M\mid U\sim\operatorname{Poisson}(kU/\gamma). Total variance immediately reproduces equation (19). This result requires positive switching and removal constants, no feedback from RNA to the promoter, and the infinite-past stationary construction. It is not a generic statement about all RNA distributions.

A distribution is a mechanistic hypothesis, not a species label

A constitutive RNA can be Poisson; a switching promoter gives the mixture above; a brief active episode can generate a negative-binomial RNA limit. A protein can have an approximately gamma distribution in a burst regime. Multiplicative variability can make its logarithm approximately Gaussian and hence its level approximately log-normal. Taniguchi's calibrated bacterial protein survey and Furusawa's growth-coupled models address different regimes.2425 “RNA is gamma, protein is log-normal” is not a sound classification.

Checkpoint 7: A negative binomial has mean 12 and Fano factor 5. Infer its parameters and its zero probability.

Under this model, B=F1=4\overline B=F-1=4 and r=12/4=3r=12/4=3, so p0=53=0.008p_0=5^{-3}=0.008. This identifies two effective parameters within the model, not the molecular mechanism uniquely.

Derive a count distribution from its event model and state the scaling that permits a continuous approximation.

Part 6

Noise, stability and memory

The Jacobian describes restoring motion. Reaction events describe the disturbances being restored. A growing cell adds another part of the state.

25Linear noise from reaction events

The linear-noise approximation reuses Lecture 4's matrix, but the noise strength must be derived from the reaction list.

Write the deterministic count-scale drift as F(n)=Γa(n)F(n)=\Gamma a(n). At a fixed point nn^*, define Aij=Fi/njnA_{ij}=\partial F_i/\partial n_j|_{n^*}. For this local calculation, treat count as continuous. The deterministic perturbation equation is ξ˙=Aξ\dot\xi=A\xi. If all eigenvalues of AA have strictly negative real parts, perturbations decay. This does not mean the stochastic system stops receiving perturbations.

Derive the covariance supplied by one event

A jump γr\gamma_r changes ninjn_in_j by γirnj+γjrni+γirγjr\gamma_{ir}n_j+\gamma_{jr}n_i+\gamma_{ir}\gamma_{jr}. The last term is simultaneous change, absent from an ordinary chain rule. The generator therefore produces an exact identity before any linearization:

Σ˙=Cov(F(NX),NX)+Cov(NX,F(NX))+E[D(NX)],D(n)=rar(n)γrγrT.\dot\Sigma=\operatorname{Cov}(F(N_X),N_X)+\operatorname{Cov}(N_X,F(N_X)) +\mathrm E[D(N_X)],\qquad D(n)=\sum_r a_r(n)\gamma_r\gamma_r^T. (23)

Here NXN_X is the count vector defined at the start. The ijij entry of Cov(F(NX),NX)\operatorname{Cov}(F(N_X),N_X) is Cov(Fi(NX),NXj)\operatorname{Cov}(F_i(N_X),N_{X_j}). Independent reaction channels have conditionally independent firing increments to first order in time, but species increments need not be independent. One reaction can change several species.

Linearize FF about the deterministic fixed point, evaluate DD there, and neglect higher-order terms. This gives the LNA covariance equation and a corresponding local Gaussian process:

dξ=Aξdt+Γdiag(a(n))dW,Σ˙=AΣ+ΣAT+D(n).d\xi=A\xi\,dt+\Gamma\operatorname{diag}(\sqrt{a(n^*)})\,dW, \qquad\dot\Sigma=A\Sigma+\Sigma A^T+D(n^*). (24)

The components of WW are independent standard Wiener processes, with increment variance dtdt. Consequently DD has units count-squared/time and AA inverse time. Paulsson's treatments connect the same covariance calculation to fluctuation–dissipation and noise filtering.1614

Why a Lyapunov equation appears

At stationarity, covariance added by events balances covariance removed by restoring dynamics:

AΣ+ΣAT+D=0,Σ=0eAtDeATtdt.A\Sigma+\Sigma A^T+D=0, \qquad \Sigma=\int_0^\infty e^{At}D e^{A^Tt}dt. (25)

For a Hurwitz matrix AA, the integral converges. Differentiating its integrand and evaluating the endpoints gives AΣ+ΣAT=DA\Sigma+\Sigma A^T=-D. The integral also shows that covariance is positive semidefinite: every disturbance is propagated forward and accumulated. This is an algebraic covariance balance, distinct from constructing a Lyapunov function to prove global nonlinear stability.

If a conservation law leaves zero modes in the full coordinates, first restrict to independent variables within a fixed compatibility class. If a restoring eigenvalue approaches zero, fluctuations spread and the local approximation can break down. Rare switching, extinction and strongly separated modes require a global stochastic calculation. For affine propensities, the first two moment equations are exact; the stationary distribution can still be Poisson or otherwise non-Gaussian. Exact covariance does not make the Gaussian distribution exact.

Checkpoint 8: Recover the Poisson variance using the LNA matrices.

For b=4,d=0.2b=4,d=0.2, n=20n^*=20, A=0.2A=-0.2 and D=b+dn=8D=b+dn^*=8. Equation (25) gives 0.4Σ+8=0-0.4\Sigma+8=0, hence Σ=20\Sigma=20. These moments are exact because both clocks are affine, but a Gaussian would incorrectly assign some probability to negative counts.

Build both the restoring matrix and event-covariance matrix from a reaction model before solving its local noise balance.

26Suppression and reaction coupling

A steeper restoring slope can reduce local noise, but a complete calculation also includes the controller's events.

We make three comparisons. First change the restoring slope while holding the mean fixed. Then keep the drift fixed and change which additions occur together. Finally ask what event budget a molecular sensor needs to implement feedback. These isolate restoration, event covariance and information cost.

Start with effective addition X\varnothing\rightsquigarrow X of propensity f(n)f(n) and removal XX\rightsquigarrow\varnothing of propensity dndn. At f(n)=dnf(n^*)=dn^*, the scalar matrices are A=f(n)dA=f'(n^*)-d and D=2dnD=2dn^*. Equation (25) gives

Σ=dndf(n),FLNA=ddf(n)=11+h,h=f(n)/d.\Sigma=\frac{dn^*}{d-f'(n^*)},\qquad F_{\mathrm{LNA}}=\frac{d}{d-f'(n^*)}=\frac1{1+h},\quad h=-f'(n^*)/d. (26)

Negative feedback has f<0f'<0, so restoration is faster and the local Fano factor is below one. This comparison holds the mean fixed by adjusting the operating point. The actual addition law must stay nonnegative on the count lattice; its tangent need not. Equation (26) is a local approximation, not permission to implement a negative propensity.

Two networks with the same ODE and different covariance

Now keep the restoring dynamics fixed. Consider two species with effective addition and removal. In an independent-addition model the composite channels are X\varnothing\rightsquigarrow X and Y\varnothing\rightsquigarrow Y, each at propensity ww. In a coupled-addition model replace them with one X+Y\varnothing\rightsquigarrow X+Y, also at propensity ww. Both retain X+YYX+Y\rightsquigarrow Y at κeffnXnY\kappa_{\mathrm{eff}}n_Xn_Y and YY\rightsquigarrow\varnothing at dnYdn_Y. The removal of X catalysed by Y is an effective process here, not a resolved elementary collision.

This is a version of the coupled feedforward example studied by Xiao and colleagues.18 Use x,yx,y as continuous count coordinates in this local approximation, not molar concentrations. Each network has drift x˙=wκeffxy, y˙=wdy\dot x=w-\kappa_{\mathrm{eff}}xy,\ \dot y=w-dy and fixed point y=w/d, x=d/κeffy^*=w/d,\ x^*=d/\kappa_{\mathrm{eff}}. Choose illustrative count-scale parameters w=10min1w=10\,\mathrm{min}^{-1}, d=0.2min1d=0.2\,\mathrm{min}^{-1} and κeff=0.004min1\kappa_{\mathrm{eff}}=0.004\,\mathrm{min}^{-1} per eligible X/Y pair. Both fixed-point counts equal 50. At that point,

A=[.2.20.2],Dind=[200020],Dcoup=[20101020].A=\begin{bmatrix}-.2&-.2\\0&-.2\end{bmatrix},\qquad D_{\mathrm{ind}}=\begin{bmatrix}20&0\\0&20\end{bmatrix},\quad D_{\mathrm{coup}}=\begin{bmatrix}20&10\\10&20\end{bmatrix}. (27)

For the coupled addition, the outer product of jump (1,1)T(1,1)^T has four entries equal to one. Multiplication by propensity 10 supplies the off-diagonal 10. Both diagonal entries remain 20 after adding removal events. Let c=DXYc=D_{XY}. The three independent entries of the Lyapunov equation are

0=0.4ΣYY+20,0=0.4ΣXY0.2ΣYY+c,0=0.4ΣXX0.4ΣXY+20.\begin{aligned} 0&=-0.4\Sigma_{YY}+20,\\ 0&=-0.4\Sigma_{XY}-0.2\Sigma_{YY}+c,\\ 0&=-0.4\Sigma_{XX}-0.4\Sigma_{XY}+20. \end{aligned}

Solve in that order. First ΣYY=50\Sigma_{YY}=50. Then ΣXY=(c10)/0.4\Sigma_{XY}=(c-10)/0.4 and ΣXX=50ΣXY\Sigma_{XX}=50-\Sigma_{XY}. Independent additions give (ΣXX,ΣXY,ΣYY)=(75,25,50)(\Sigma_{XX},\Sigma_{XY},\Sigma_{YY})=(75,-25,50); coupled addition gives (50,0,50)(50,0,50).

SAME DRIFT AND FIXED POINT; DIFFERENT EVENT COINCIDENCE INDEPENDENT ADDITIONS 35 50 65 35 50 65
nXn_X
nYn_Y
D=[200020]D=\begin{bmatrix}20&0\\0&20\end{bmatrix}
Σ=[75252550]\Sigma=\begin{bmatrix}75&-25\\-25&50\end{bmatrix}
COUPLED ADDITION 35 50 65 35 50 65
nXn_X
nYn_Y
D=[20101020]D=\begin{bmatrix}20&10\\10&20\end{bmatrix}
Σ=[500050]\Sigma=\begin{bmatrix}50&0\\0&50\end{bmatrix}
LNA covariance ellipses, not measured clouds or global stationary distributions.
Figure 19. Event coincidence changes noise without changing the deterministic fixed point or Jacobian. These are computed LNA ellipses at Mahalanobis radius one, not experimental clouds and not 68% probability contours. The bilinear removal means the true finite-count moments need not equal this approximation. The coupled example removes the transmitted excess in X; it does not establish universal sub-Poisson suppression.

Intuitively, extra Y promotes later X removal and generates negative covariance. A shared addition simultaneously supplies X when it supplies Y. In this example those correlations offset one another. Other coupling signs and other restoring matrices can amplify noise. Neither the deterministic network diagram alone nor “coupling helps” is an adequate noise calculation.

Why unlimited restoring gain is not a free controller

Equation (26) assumes that the effective propensity has access to the current count. A molecular controller must sense that count through events. Lestas, Vinnicombe and Paulsson bound achievable suppression for a specified signalling architecture, allowing a very general causal controller.17 Let N1N_1 be the controlled mean count and N2N_2 the expected number of signalling events in one controlled-species lifetime. In their convention, R=N2/N1R=N_2/N_1 and

F21+1+4R.F\ge\frac{2}{1+\sqrt{1+4R}}. (28)

The main-text information bound can be expressed as F1/(1+Cτ)F\ge1/(1+\mathcal C\tau) with signalling capacity bounded by CτRF\mathcal C\tau\le RF. Those are the theorem inputs, not results of our LNA. Combining them gives RF2+F10RF^2+F-1\ge0; the positive root yields equation (28). The original treatment uses a continuous stochastic approximation for the controlled species, with discrete signalling and potentially history-dependent control.

At large signal budget the lower bound on standard deviation scales as R1/4R^{-1/4} at fixed controlled mean. Lowering that bound tenfold requires roughly ten thousand times the signal budget. This is not an engineering guarantee or a theorem covering every architecture. Reactions that simultaneously alter sensing and controlled species change the assumptions behind a decoupled signalling calculation. The appropriate response is to specify the new channel structure and recompute, not to announce a violation of a universal law.

Separate restoring gain, sensing cost and correlated reaction events when evaluating a claim of noise suppression.

27A stable switch has a lifetime

A Jacobian describes recovery inside a basin. Memory also depends on how long a random path stays there.

For the symmetric toggle in the core playground, let dimensionless concentrations be x=nX/Ωx=n_X/\Omega and y=nY/Ωy=n_Y/\Omega. Here the playground uses Ω\Omega for the count corresponding to its chosen concentration unit crefc_{\mathrm{ref}}: Ω=NAVcref\Omega=N_AVc_{\mathrm{ref}}. This is a dimensionless count scale, unlike NAVN_AV alone when concentrations are molar. In removal-lifetime time units, use composite additions X\varnothing\rightsquigarrow X, Y\varnothing\rightsquigarrow Y, and individual removals. The propensities are

aX+=8Ω1+(nY/Ω)2,aX=nX,aY+=8Ω1+(nX/Ω)2,aY=nY.a_{X+}=\frac{8\Omega}{1+(n_Y/\Omega)^2},\quad a_{X-}=n_X,\qquad a_{Y+}=\frac{8\Omega}{1+(n_X/\Omega)^2},\quad a_{Y-}=n_Y.

These Hill laws are assumed effective expression laws, motivated by fast regulatory binding. The count model does not resolve promoter binding, RNA, bursts, maturation or growth. A deterministic Hill reduction does not, by itself, prove that these particular stochastic propensities preserve all those mechanisms.10

The macroscopic equations are x˙=8/(1+y2)x\dot x=8/(1+y^2)-x and its symmetric partner. The outer fixed points satisfy xy=1, x+y=8xy=1,\ x+y=8, giving (4+15,415)(4+\sqrt{15},4-\sqrt{15}) and its reversal. The Jacobian's eigenvalues there are 1±1/4-1\pm1/4, so both states restore small perturbations. Their deterministic positions and restoring rates do not change when Ω\Omega changes. Their stochastic residence times do.

A one-dimensional first-passage problem we can solve completely

Use a self-activator to learn the calculation before tackling the two-dimensional toggle. Let un=Ω[0.05+2(n/Ω)2/(1+(n/Ω)2)]u_n=\Omega[0.05+2(n/\Omega)^2/(1+(n/\Omega)^2)] be the addition propensity and dn=nd_n=n the removal propensity. The deterministic drift has stable roots 0.056325 and 1.322381, separated by unstable root 0.671294. Define a target count h=0.671294Ωh=\lceil0.671294\Omega\rceil. Let TnT_n be mean time to first reach that target, starting at n<hn<h.

In a short interval, time dtdt is spent regardless of the next jump. Condition on the three possibilities, cancel TnT_n, and divide by dtdt. The backward equation and boundaries are

1=un(Tn+1Tn)+dn(Tn1Tn),Th=0,d0=0.-1=u_n(T_{n+1}-T_n)+d_n(T_{n-1}-T_n),\qquad T_h=0,\quad d_0=0. (29)

Put Rn=Tn1TnR_n=T_{n-1}-T_n. The zero boundary gives R1=1/u0R_1=1/u_0. Every next difference follows from Rn+1=(1+dnRn)/unR_{n+1}=(1+d_nR_n)/u_n. Finally sum backwards from the absorbing target:

Ti=j=i+1hRj.T_i=\sum_{j=i+1}^{h}R_j. (30)

This finite recurrence is exact for the declared birth–death model and hitting target. It requires no noise-strength fit or escape asymptotics. For Ω=20\Omega=20, start at count 1 and target 14: T=341.658T=341.658 removal lifetimes. At Ω=40\Omega=40, start at 2 and target 27: T=6011.264T=6011.264. The deterministic attractors did not move. Passing the middle threshold is not the same as committing to the upper basin, since recrossings remain possible.

STABILITY AND MEMORY LIFETIME ANSWER DIFFERENT QUESTIONS EFFECTIVE ADDITION AND REMOVAL EXACT FIRST PASSAGE TO THE THRESHOLD 0 1 2 0 1 2
xx
flux\text{flux}
0 40 80 120 160 0 4 8 12
Ω\Omega
log10(T/lifetime)\log_{10}(T/\text{lifetime})
Start near the lower attractor; stop at the first count at or above the middle root. Threshold crossing is not a commitment probability for the other basin.
Figure 20. Local stability does not determine a memory lifetime. Left: effective addition flux and linear removal for the declared self-activator. Filled intersections are stable; the open one is unstable. Right: exact backward-equation hitting times at six system sizes, displayed on a logarithmic time axis. Targets are rounded upward to the first eligible integer count; initial counts are rounded to the lower fixed point.

The toggle needs a two-dimensional backward equation 1=rar(n)[T(n+γr)T(n)]-1=\sum_r a_r(n)[T(n+\gamma_r)-T(n)] outside a specified target region, or a suitably validated trajectory estimate. A scalar self-activator formula cannot be copied into it. In simulation, record trajectories that have not switched by the stopping time as right-censored. Averaging only the paths that switched underestimates memory lifetime. A local Gaussian fit is particularly poor evidence about a rare tail event.19

Distinguish local recovery, threshold crossing and basin-to-basin switching, and compute an exact one-dimensional hitting-time benchmark.

28Growth and division are different

Growth changes the concentration denominator; division changes the state by a separate reset.

Build the growing-cell model in three steps: its balance between divisions, its partition rule at division, and the event clock when volume changes while we wait. The last step determines which simulation algorithm samples the specified model.

Let volume obey V˙=λV\dot V=\lambda V, and let the deterministic molecule balance between divisions be N˙=NAVf(c,λ)δN\dot N=N_AVf(c,\lambda)-\delta N. Here c=N/(NAV)c=N/(N_AV) is molarity, ff a concentration addition flux, δ\delta true degradation, and λ\lambda growth rate. The quotient rule gives

c˙=N˙NAVNV˙NAV2=f(c,λ)(δ+λ)c.\dot c=\frac{\dot N}{N_AV}-\frac{N\dot V}{N_AV^2} =f(c,\lambda)-(\delta+\lambda)c. (31)

This recovers Lecture 3's addition–removal form. The term λc-\lambda c removes concentration, not molecules. At the event level, between synthesis and degradation jumps the count is constant while concentration decreases continuously with volume. It is therefore a different model from adding random molecular deaths at hazard λN\lambda N in a fixed-volume CME.

Dilution can also set a timing mechanism. If synthesis is suppressed, degradation is negligible and a repressor starts at concentration c0c_0, then c(t)=c0eλtc(t)=c_0e^{-\lambda t}. Release at a threshold ccc_c occurs after tc=λ1ln(c0/cc)t_c=\lambda^{-1}\ln(c_0/c_c). A twofold peak change adds one doubling time to this interval. The repressilator redesign illustrates how dilution and titration thresholds can set timing; the lineage separates these interventions from better observation.23

What happens at division?

Suppose the tracked daughter receives volume fraction rr. Independent, well-mixed partition assigns each of the nn parental molecules to that daughter with probability rr. Then N+N=nBinomial(n,r)N^+\mid N^-=n\sim\operatorname{Binomial}(n,r) and V+=rVV^+=rV^-. Keeping parental count and volume fixed,

E[c+n,V]=nrNArV=c,Var(c+n,V)(c)2=1rnr.\mathrm E[c^+\mid n,V^-]=\frac{nr}{N_ArV^-}=c^-,\qquad \frac{\operatorname{Var}(c^+\mid n,V^-)}{(c^-)^2}=\frac{1-r}{nr}. (32)

For symmetric division, conditional concentration CV is 1/n1/\sqrt n. At parental count 20 it is 22.36%; at count 80 it is 11.18%. Exact proportional partition leaves concentration unchanged, not halved. Clustering, unequal partition probability, or random daughter size require another reset law. Golding and colleagues tested approximately binomial partitioning for their labelled RNAs; that result is evidence for a particular reporter, not a universal partition theorem.20

SELF-ACTIVATOR SYMMETRIC TOGGLE PARTITION AT DIVISION 0 1 2 0 1 2
xx
rate\text{rate}
f+(x)=0.05+2x21+x2f^+(x)=0.05+\frac{2x^2}{1+x^2}
Cross the unstable threshold, lose the state 0 4 8 0 4 8
xx
yy
(x,y)r(x,y),0<r<1(x,y)\mapsto r(x,y),\quad 0<r<1
A common pulse stays on one side of the diagonal 0 1 2 0 .1 .2
c+/cc^+/c^-
Pr\Pr
N+Binomial(20,1/2)N^+\sim\mathrm{Binomial}(20,1/2)
Daughter volume is halved too Left/centre: illustrative rate laws. Right: exact partition probabilities, not measured data.
Figure 21. Three distinct ways to change memory. Left and middle are illustrative concentration perturbations relative to a self-activator's threshold and a toggle's basin geometry. They are not literal concentration halving at division. Right is an exact symmetric-binomial partition law for parental count 20, expressed as daughter concentration relative to parental concentration.

The event clock changes when volume grows

For a constant concentration addition flux f0f_0, count propensity between events is a+(t)=NAV(t)f0a_+(t)=N_AV(t)f_0. Waiting no longer leaves all hazards fixed. The general no-event law is

S(τ)=exp ⁣[0τa0(n,V(t+s))ds].S(\tau)=\exp\!\left[-\int_0^\tau a_0(n,V(t+s))ds\right]. (33)

For addition alone during exponential growth, put a+(t+s)=a+(t)eλsa_+(t+s)=a_+(t)e^{\lambda s}. Drawing U(0,1)U\in(0,1) and integrating gives τ=λ1ln[1+λ(lnU)/a+(t)]\tau=\lambda^{-1}\ln[1+\lambda(-\ln U)/a_+(t)]. Its limit as λ0\lambda\to0 is the usual exponential draw. With several time-varying hazards, solve the integrated clock and choose the channel using its hazards at the event time. A scheduled division that occurs sooner must be processed first, with the reset and subsequent clocks recomputed.

The growth studies mentioned in the core now ask distinguishable questions. Tian's group compared self-activation and mutual repression under growth-dependent dilution; Fu's group showed how unequal growth responses of the toggle's arms can move the decision landscape itself.2122 Test a deterministic growth-rate pulse, growth-dependent expression parameters, and random partition separately before combining them. A moving basin is not just a larger random kick in a fixed basin.

The Fu-group experiment distinguishes unequal expression responses from unequal phenotype growth. The published study found no significant growth-rate difference between the two phenotypes under its comparison. The two regulatory arms nevertheless responded differently across growth conditions. Thus the landscape change need not arise from a high-expression state slowing its own growth through metabolic burden. A model can hold growth externally prescribed and still change its nullclines through growth-dependent synthesis.22

Checkpoint 9: Should a count-and-volume simulation include both random deaths at rate λN and volume growth?

Not to represent the same dilution. Volume growth already decreases concentration. Add molecular removal only for an independently specified mechanism such as degradation. Likewise, halving both count and volume preserves concentration under proportional division; an additional concentration-halving reset would count dilution again.

Construct a count–volume model with separate synthesis, degradation, continuous dilution and division partitioning.

Part 7

Make an inference

A solved model is only half the argument. The observation must distinguish it from credible alternatives.

29What another observable buys

A second reporter or a time interval can expose a mechanism that one histogram cannot identify.

Derive the paired-reporter decomposition

Let two calibrated reporter outputs be X,YX,Y, with the same conditional distribution given shared cell history ZZ. Assume they are conditionally independent. Write conditional mean m(Z)m(Z) and variance v(Z)v(Z), and overall mean μ\mu. Total variance and covariance give

Var(X)=E[v(Z)]+Var(m(Z)),Cov(X,Y)=Var(m(Z)),12E[(XY)2]=E[v(Z)].\operatorname{Var}(X)=\mathrm E[v(Z)]+\operatorname{Var}(m(Z)),\quad \operatorname{Cov}(X,Y)=\operatorname{Var}(m(Z)),\quad \frac12\mathrm E[(X-Y)^2]=\mathrm E[v(Z)].

Dividing by μ2\mu^2 yields intrinsic and extrinsic relative-noise estimates. The algebra explains the diagonal and off-diagonal directions of the reporter cloud: common changes move both reporters together; conditional independent events separate them. This is the logic of Elowitz's experiment and Swain's formal treatment.56

Reporter competition, unequal maturation, shared transcripts, correlated measurement error, or different regulatory responses violate the simple decomposition. Independent detector noise enters the difference just like reporter-specific chemistry unless calibrated separately. What counts as “intrinsic” changes with the subsystem boundary; it is not a synonym for the unexplained residual.

A hidden sequence leaves a waiting-time signature

Compare a single exponential step of mean 20 minutes with two sequential exponential steps, each of mean 10 minutes. Both total intervals have mean 20. Their densities are f1(t)=0.05e0.05tf_1(t)=0.05e^{-0.05t} and f2(t)=0.12te0.1tf_2(t)=0.1^2te^{-0.1t}. To obtain the second, convolve the two stage densities: 0t0.1e0.1s0.1e0.1(ts)ds\int_0^t0.1e^{-0.1s}0.1e^{-0.1(t-s)}ds.

The one-step process has CV 1 and a positive density at zero. The two-step interval has CV 1/21/\sqrt2 and zero density at zero because two steps must finish. Its survival is (1+0.1t)e0.1t(1+0.1t)e^{-0.1t}. This is an illustrative hidden-stage diagnostic, not a claim that every mammalian promoter has exactly three states.

THE MEAN INTERVAL IS 20 MINUTES IN BOTH MODELS WAITING-TIME DENSITY 0 20 40 60 80 0 0.02 0.04
t  (min)t\;(\mathrm{min})
f(t)  (min1)f(t)\;(\mathrm{min}^{-1})
NO-EVENT SURVIVAL 0 20 40 60 80 0 0.5 1
t  (min)t\;(\mathrm{min})
S(t)S(t)
one exponential stage two sequential exponential stages
Figure 22. Equal mean waiting does not imply the same mechanism. Exact one-stage and two-stage interval laws. The two-stage short-time deficit would be invisible to a comparison of means alone. Actual transcription-event measurements must also account for elongation, detection thresholds and missed events.

Braichenko, Holehouse and Grima compare promoter models that can fit similar count distributions while differing in initiation-time evidence.9 A negative-binomial fit can estimate effective frequency and size within a chosen model; it cannot establish how many chromatin or initiation states generated it. Add the observable most likely to separate alternatives: temporal correlations, waiting times, paired reporters, or a controlled growth perturbation.

Checkpoint 10: Two reporters each have mean 10, variance 25 and covariance 9. What does the simple decomposition infer?

Shared relative variance is 9/100=0.099/100=0.09; reporter-specific relative variance is (259)/100=0.16(25-9)/100=0.16. Total relative variance is 0.25. These interpretations require the conditional-independence and reporter-matching assumptions, not just the arithmetic.

Choose an additional measurement that separates plausible mechanisms and state the assumptions behind its interpretation.

30A complete working protocol

End with a model another person can reconstruct and a plot that could prove it wrong.

  1. Question. State the observable, sampling operation, time window, and condition.
  2. Scale. Convert concentrations to counts and identify every low-copy or boundary-sensitive species.
  3. State. Add enough hidden states to make event hazards conditionally memoryless.
  4. Mechanism. List reactions, integer jumps, propensities, parameter units, and conserved quantities.
  5. Probability. Write an interior CME stencil and every special boundary equation.
  6. Analysis. Derive at least one moment, limiting law, conservation identity, or absorbing-state result.
  7. Code. Seed the direct method, log events, assert admissibility, and preserve the exact parameter file.
  8. Calibration. Reproduce the constant-addition, first-order-removal Poisson benchmark before running the new network.
  9. Estimation. Declare the sampling measure, initialization, estimator and uncertainty. Test ergodicity before interpreting one long path as a stationary ensemble.
  10. Evidence. Compare the representation with the actual observation: path with path, histogram with histogram, waiting time with waiting time.
  11. Failure. Name one pattern the model cannot create and the smallest additional state or process that could create it.
THE MODEL IS NOT FINISHED WHEN THE TRACE LOOKS JAGGED 1 QUESTION what must be predicted? 2 STATE what makes clocks Markov? 3 EVENTS jumps, rates, units 4 VIEW path, distribution, mean 5 TEST what result would reject it? A histogram can reject a model without identifying its replacement. Keep event times when competing mechanisms can agree on counts.
Figure 23. A reusable workflow ends at a falsifier. The selected observable decides which state and representation matter. Lecture 6 adds the question of whether a reduced model preserves that observable.
Final worked problem: Make the equal-mean promoter comparison reproducible.

Use time in minutes, k=20min1k=20\,\mathrm{min}^{-1} and γ=1min1\gamma=1\,\mathrm{min}^{-1}. Compare slow switching (α,β)=(0.12,0.08)(\alpha,\beta)=(0.12,0.08) with fast switching (12,8)(12,8). Both have on fraction 0.6 and mean RNA count 12. Equation (19) predicts Fano factors 7.666667 and 1.380952, respectively.

Implement the four propensities in equation (18). Start each path at promoter off and RNA zero. A 100-minute burn spans 20 slow promoter relaxation times; compare with a longer burn to test the initialization choice. Collect one endpoint from each of 5,000 independently seeded paths. Their mean-estimator standard errors are about 0.1356 and 0.0576 counts using the stationary variances. These are not the errors of 5,000 adjacent frames in one movie.

Save all transcription-event timestamps from separate long paths. Plot waiting-time survival with its observation censoring, not just a fitted exponential. Compare the RNA-only mean-hazard reduction with the full model for mean, zero fraction, Fano factor and temporal correlations. It preserves the stationary mean for these parameters; it predicts Poisson Fano 1 and misses finite switching memory.

For a second project, compare the two addition-coupling networks of Section 26 using their declared channels and the same observation protocol. LNA predicts different covariances despite identical deterministic drift. Compare with SSA and report any discrepancy from the local approximation; do not force the simulated mean to equal the deterministic fixed point.

Two analytic experiments

These controls evaluate the equations above; they are not stochastic simulations. Change one scale while holding the stated comparison fixed.

Packet size and observation

Each calculation uses independent Poisson packet arrivals. Only the stationary calculation includes individual molecular removal.

How long did you average?

Poisson mean 20; individual removal 0.2/min. An independent snapshot still has standard deviation 4.472 counts, whatever the movie length.

methodobject approximatedfirst warning to test
direct SSAnone within the specified CMEmissing spatial, cell-cycle or history state
tau-leapingmany firing counts over a short leapnegative counts or changing hazards within the leap
LNAlocal fluctuations around one macroscopic trajectoryboundaries, skew, weak restoration or basin switching
rate equationmacroscopic concentration trajectoryevent timing, tails and finite-count covariance

Fast-state reduction adds a separate question: what survives elimination? Fast unregulated promoter switching can leave a mean addition hazard. Short-lived RNA can leave a random protein packet. Fast binding under feedback can require conditional averages at fixed totals.10 These are different reduced objects. The next lecture develops how to select them systematically.

You are finished when

A reader can regenerate the model from your reaction table, reproduce the stochastic path from the seed, verify it against an analytic limit, and understand which observation would force a richer state. A beautiful trajectory without those links is an illustration, not evidence.

Build a reproducible model packet that names its state, units, observable, calibration and a result that would falsify it.


References

  1. D. T. Gillespie, “Stochastic Simulation of Chemical Kinetics,” Annual Review of Physical Chemistry 58, 35–55 (2007). DOI
  2. D. T. Gillespie, A. Hellander, and L. R. Petzold, “Perspective: Stochastic algorithms for chemical kinetics,” Journal of Chemical Physics 138, 170901 (2013). full text
  3. T. G. Kurtz, “The Relationship between Stochastic and Deterministic Models for Chemical Reactions,” Journal of Chemical Physics 57, 2976–2978 (1972). DOI
  4. M. Thattai and A. van Oudenaarden, “Intrinsic noise in gene regulatory networks,” PNAS 98, 8614–8619 (2001). full text
  5. M. B. Elowitz, A. J. Levine, E. D. Siggia, and P. S. Swain, “Stochastic Gene Expression in a Single Cell,” Science 297, 1183–1186 (2002). DOI
  6. P. S. Swain, M. B. Elowitz, and E. D. Siggia, “Intrinsic and extrinsic contributions to stochasticity in gene expression,” PNAS 99, 12795–12800 (2002). full text
  7. A. Raj et al., “Stochastic mRNA Synthesis in Mammalian Cells,” PLoS Biology 4, e309 (2006). DOI
  8. V. Shahrezaei and P. S. Swain, “Analytical distributions for stochastic gene expression,” PNAS 105, 17256–17261 (2008). full text
  9. S. Braichenko, J. Holehouse, and R. Grima, “Distinguishing between models of mammalian gene expression: telegraph-like models versus mechanistic models,” Journal of the Royal Society Interface 18, 20210510 (2021). full text
  10. J. Holehouse and R. Grima, “Revisiting the Reduction of Stochastic Models of Genetic Feedback Loops with Fast Promoter Switching,” Biophysical Journal 117, 1311–1330 (2019). DOI
  11. Lecture 5 numerical and figure ledger, seeds 20260902 and 20260915.The checked generator produces the conversions, simulations, exact statistics, and plotted coordinates used here.
  12. R. Erban, S. J. Chapman, and P. K. Maini, “A practical guide to stochastic simulations of reaction-diffusion processes” (2007), arXiv:0704.1908. full textExample-led CME and SSA derivations; section 2.2 makes the sampling times explicit.
  13. L. Cai, N. Friedman and X. S. Xie, “Stochastic protein expression in individual cells at the single molecule level,” Nature 440, 358–362 (2006). DOIThe measured protein packet is inferred from calibrated enzyme activity.
  14. J. Paulsson, “Models of stochastic gene expression,” Physics of Life Reviews 2, 157–175 (2005). DOI§§3–5 develop lifetime averaging, covariance equations and subsystem-relative noise.
  15. N. Friedman, L. Cai and X. S. Xie, “Linking Stochastic Dynamics to Population Distribution: An Analytical Framework of Gene Expression,” Physical Review Letters 97, 168302 (2006). open full textContinuous burst model; p. 2 explicitly distinguishes its Fano factor from the discrete result.
  16. J. Paulsson, “Summing up the noise in gene networks,” Nature 427, 415–418 (2004). DOI
  17. I. Lestas, G. Vinnicombe and J. Paulsson, “Fundamental limits on the suppression of molecular fluctuations,” Nature 467, 174–178 (2010). full textEquation 2 and Box 1; signalling architecture and controlled-species approximation matter.
  18. F. Xiao, M. Fang, J. Yan and J. C. Doyle, “Coupled Reaction Networks for Noise Suppression,” American Control Conference, 1547–1554 (2019). repository record§III-A supplies the independent-versus-coupled addition comparison; parameters and balances here are declared anew.
  19. M. Vellela and H. Qian, “Stochastic dynamics and non-equilibrium thermodynamics of a bistable chemical system: the Schlögl model revisited,” Journal of the Royal Society Interface 6, 925–940 (2009). DOIStationary probability and stochastic transitions beyond local deterministic stability.
  20. I. Golding, J. Paulsson, S. M. Zawilski and E. C. Cox, “Real-Time Kinetics of Gene Activity in Individual Bacteria,” Cell 123, 1025–1036 (2005). DOI
  21. R. Zhang et al., “Topology-dependent interference of synthetic gene circuit function by growth feedback,” Nature Chemical Biology 16, 695–701 (2020). full author manuscript
  22. J. Zhu, P. Chu and X. Fu, “Unbalanced response to growth variations reshapes the cell fate decision landscape,” Nature Chemical Biology 19, 1097–1104 (2023). DOI; open preprintPublished pp. 1099–1100 and Figures 1–3: equal-growth-rate comparison, unequal expression responses and the measured versus predicted bifurcation ranges.
  23. L. Potvin-Trottier, N. D. Lord, G. Vinnicombe and J. Paulsson, “Synchronous long-term oscillations in a synthetic gene circuit,” Nature 538, 514–517 (2016). DOIThe companion lineage distinguishes observation improvements from circuit redesign.
  24. Y. Taniguchi et al., “Quantifying E. coli proteome and transcriptome with single-molecule sensitivity in single cells,” Science 329, 533–538 (2010). full text
  25. C. Furusawa et al., “Ubiquity of log-normal distributions in intra-cellular reaction dynamics,” Biophysics 1, 25–31 (2005). full text
  26. B. L. Sabatini, T. G. Oertner and K. Svoboda, “The Life Cycle of Ca2+ Ions in Dendritic Spines,” Neuron 33, 439–452 (2002). DOIPrinted pp. 441–443 and 446–448. Clearance, indicator-dependent equilibration and the inferred native exchange time.