From reaction list to stochastic evidence
A working tutorial from chemical master equations and exact simulation to burst distributions, linear noise, feedback, switching lifetimes, and growth-coupled memory.
The core asks why a cell can have reproducible behavior and variable molecular histories. This exposition develops the tools needed to answer that question for a new network. A single addition–removal process provides our first complete calculation. Translation and promoter switching then reveal what this calibration leaves out. Finally, reaction-level covariance connects noise to Lecture 4's stability analysis, and growth connects a fixed-volume model to a dividing cell.
Parts 1–4 develop the local state, CME, event sampler and estimators. They include the conditions under which a long history represents a stationary ensemble. Part 5 derives the burst and distribution claims that the core introduces as extensions. Part 6 is a worked route through the linear-noise and cellular-memory problems. Part 7 asks which measurements could distinguish the mechanisms. These are study routes, not a second single-lecture timetable. Each checkpoint has an answer; try it before opening the solution.
On a blank page, you will be able to define the stochastic state, derive its CME, obtain moment equations with the generator, code the direct SSA, construct time-weighted and independent-path estimators, test analytic invariants, and distinguish a path claim from a distribution or inference claim.
To construct a count model from a concentration model, work through Sections 5–9. To turn simulation output into an estimate, use Sections 16–19, including the absorbing-state counterexamples. To investigate a biological mechanism, choose expression and bursts or noise, switching and growth, then apply the final working protocol. Each route states its assumptions and supplies a checkable calculation.
We retain Lecture 3's reaction bookkeeping. Species are . Their random counts form , and denotes one realized integer state. A species symbol is not a random variable. Named examples use shorter count symbols, such as for one species or for RNA and protein counts.
For channel , reactant vector and product vector list the numbers consumed and formed. The jump is . Putting those columns together gives . Propensities determine when those jumps occur.
Choose a stochastic state
The state is not a list of everything in the cell. It is the smallest list that makes the next-event clocks depend only on the present.
1Begin with the question
A stochastic model is unnecessary until the observable asks for something a deterministic mean cannot answer.
Write the biological question before the reactions. “What is the mean expression level?” might be answered by a rate equation. “What fraction of cells have zero transcript?”, “How long until the first resistant cell appears?”, and “Does a threshold see isolated bursts?” cannot. They depend on the distribution, a boundary, or an individual history.
Now name the sampling operation. A snapshot across 1,000 cells is an ensemble. A 12-hour movie of one lineage is a time series. A population average after lysis is neither a single-cell distribution nor a path. The same mean can arise from all three while hiding different biology. Raj and colleagues made this distinction tangible by counting individual mRNAs and relating punctuated transcription to promoter states.7
Variation also has sources. Elowitz and colleagues used two fluorescent reporters in the same cell to separate reporter-specific fluctuations from shared cell-to-cell changes.5 Swain, Elowitz, and Siggia formalized that intrinsic-versus-extrinsic decomposition.6 A single broad histogram cannot perform this separation because measurement error, hidden cell state, and reaction-event variation are all superposed.
“The system is noisy” is not yet a modeling question. Replace it with a statistic and a sampling protocol: Fano factor at 30 minutes, probability of zero at division, autocorrelation time in one lineage, or first passage above a threshold.
Choose a path, distribution or mean observable and state how it will be measured before selecting a model.
2Convert concentration to count
Concentration alone does not reveal discreteness. Volume completes the conversion.
For concentration in moles per liter and volume in liters, multiply by Avogadro's constant to get the molecule number . Use the rough conversion :
A micromolar species in a femtoliter cell therefore has hundreds of copies. Invert the same relation: one copy corresponds to about . The comparison tells us which concentrations lie near an integer boundary.
The defined constant is . It gives 602.214 molecules per micromolar in 1 fL, or 1.660539 nM per molecule. The extra digits do not change the copy-number regime.11
Events supply a second counting scale. For independent events with constant rate over a window, split the window into many intervals with a small firing probability. The binomial count approaches a Poisson law with mean and variance both equal to the expected event count , so its relative fluctuation is . A large molecule pool can still inherit a rare regulator's event history. Feedback, correlated packets and a changing rate require a different calculation.
Low count identifies a scale that needs further interpretation. Rare promoter states matter even when their protein output is abundant. Extinction matters when zero is absorbing. A system near a switching threshold may amplify small fluctuations. Conversely, a high-count species can inherit variation from a low-count regulator. Use the conversion to locate the possible source, then return to the observable.
Convert a concentration and compartment volume into a copy-number scale, and use that scale to test whether integer boundaries matter.
3Choose a local compartment
A geometric volume specifies where to count. A dynamical compartment also needs an exchange timescale and a named observable.
A dendritic spine gives a concrete volume
A dendritic spine is a small protrusion on a neuron's dendrite. The dendrite is an input-receiving branch. A spine head receives a synaptic input and connects to the branch through a narrow neck. The head's calcium signal can help regulate that synapse. Spine size and shape vary, so the following geometry is a representative model choice.26
A submicrometer head has a subfemtoliter volume. Approximate the head by a sphere of radius . Its volume is
Thus the example volume is about . At 100 nM free calcium it contains about six free ions on average. At 10 nM it contains about 0.6. These means concern unbound cytoplasmic calcium. Calcium bound to a protein or stored in an organelle belongs to a different state variable. An instantaneous count remains integer even when its mean is below one.
Derive exchange through the neck
The head exchanges its contents through a restricted cross section. Let and be the head and dendrite concentrations of an ideal diffusing solute. Approximate the neck by a cylinder of length and area . Let be its diffusion coefficient. Assume a well-mixed head, a large dendritic reservoir and a nearly linear concentration profile along the neck.
Fick's law turns that concentration difference into an exchange rate. The gradient is approximately . Multiply the diffusive flux density by the neck area, then divide by the head volume to obtain its concentration change:
The units check is useful: is volume per time, so dividing by it gives time. A smaller neck radius lengthens equilibration as . The small head can mix internally while exchange with the dendrite remains slower.
Choose an illustrative unbuffered solute with , a neck length , radius and head volume . Then
The free-diffusion traversal scale is much shorter. Traversing a neck once and emptying a head through that neck are different problems. The latter depends on its cross section and the head volume. The head's own rough diffusion scale, diameter squared divided by , is about 0.0003 s for these illustrative parameters. Calcium binding and clearance still have to be added.
Compare exchange with the process being observed
Four timescales answer different questions. A head can be a useful state variable while remaining coupled to its dendrite. Treating that state as approximately independent is a stronger simplification.
| Scale | Meaning | What the comparison licenses |
|---|---|---|
| Redistribution inside the head. | A well-mixed head when this is fast relative to the modeled dynamics. | |
| Equilibration with the dendrite through the neck. | Whether head and dendrite require separate concentrations. | |
| Removal of a calcium perturbation from the head cytoplasm. | Whether the local signal is cleared before much escapes. | |
| The measurement's averaging window or downstream readout's memory. | Whether the observable resolves short fluctuations or averages over them. |
A calcium transient can remain local because clearance competes with spread. Let and denote deviations from a common resting concentration. Let be an effective source in concentration per time. After buffering has been represented consistently in the coefficients, a linear compartment model is
The pulse divides between two removal routes. Suppose the dendrite stays at baseline, , and an initial excess receives no further source. Define the relaxation rate . The solution is . Integrating the neck loss gives the fraction that leaves by that route:
Local clearance dominates when . A sustained source can maintain a local signal through continuing influx and removal. The anatomical connection remains open.
Binding changes the relation between free calcium and total calcium. In a small-signal, rapid-buffer-equilibrium approximation, define and as the changes in immobile-bound and mobile-bound calcium per unit change in free calcium. The total incremental capacity is . Let be free-calcium diffusion, mobile-buffer diffusion and the linear clearance rate acting on free calcium.
The buffer capacity stores calcium, while mobile buffers also transport it. With uniform coefficients and fast local binding, the incremental total concentration is and the diffusion coefficient multiplying the free-calcium gradient is . The two effective times are therefore
An added immobile buffer lengthens both times in this approximation. Its capacity alone does not establish greater isolation because cancels from their ratio. A mobile indicator can additionally carry calcium through the neck. Slow binding, saturation or spatially nonuniform buffers require a more resolved model.
Sabatini, Oertner and Svoboda measured a regime with rapid local clearance. In rat hippocampal CA1 pyramidal neurons, extrapolation to zero added indicator gave spine calcium decay times around 12–15 ms. With 100 micromolar Fluo-4 present, their diffusional equilibration estimate averaged about 89 ms and varied with spine geometry. Their Figure 4 uses fluctuations across repeated trials to estimate this coupling.26
The longer native exchange time was inferred from indicator effects. The authors argued that mobile indicator-bound calcium spreads more rapidly than calcium under native buffering. Their correction led to an estimate above 1 s, much longer than clearance. This supports a local calcium signal under their conditions. It does not directly measure dye-free exchange, identify a universal transport coefficient, or establish equal isolation for proteins and other messengers.
A low-count pool can turn over rapidly
Mean count and renewal rate are independent pieces of information. A pool can retain the same mean while its molecules arrive and leave faster. In the constant-addition, linear-removal model developed below, multiplying both rates by the same factor leaves the stationary mean and count distribution unchanged. It shortens the correlation time by that factor. A time-integrating observer can then obtain more independent information from the same small mean pool.
The count conversion survives even when compartment independence fails. The relation applies to any specified observation volume with the corresponding volume-averaged concentration. Predicting the fluctuations seen by a sensor additionally requires transport, binding, removal and the sensor's response time. A low count flags a scale worth modeling. It does not specify a probability law or its temporal correlations.
Define the local volume, molecule and readout. Derive or measure exchange, compare it with local reaction and mixing times, and keep the turnover rate separate from the instantaneous molecule count.
4Make hidden memory explicit
A Markov state contains enough present information to determine every instantaneous event rate.
The chemical master equation assumes that, conditional on state , the next-event rates do not depend on the earlier path. If a promoter that just closed has a different reopening hazard from one that has been closed for an hour, the on/off label alone is not Markov. Add an age, a sequence of conformational substates, or a non-Markov waiting-time model.
The same principle handles delays. Replacing transcription initiation by a reaction that instantly produces mature mRNA assumes elongation is either negligible or absorbed into an exponential effective step. If a fixed elongation delay shapes the autocorrelation, add an explicit chain or a delayed event. The simulator cannot repair missing state. It only samples the state model you wrote.
A deterministic decision can look random
Suppose I alternate trips between home and office, and carry my umbrella only if it is raining and the umbrella is at my departure location. Given location, umbrella location, and rain, my action is deterministic. A spectator who records only “carried / did not carry” has omitted the mechanism. That record need not itself be a Markov chain.
For a tractable model, assume rain on each departure is an independent Bernoulli event with probability . Let the state before a trip be 0 if the umbrella is unavailable, 1 if available. From 0 I necessarily arrive where it is, so the next state is 1. From 1, rain makes me take it, leaving it available for my next departure; no rain leaves it behind. With current-state rows and next-state columns,
Under stationary sampling, the carrying probability is , not . The random input is our weather model; the decision rule remains deterministic. Biological intrinsic noise is likewise defined relative to a chosen system boundary, but molecular reaction events are not established to be deterministic merely because an everyday decision can be.
Checkpoint 1: If rain probability is 0.3, what fraction of departures include the umbrella?
Availability is , so carrying occurs on of departures in the stationary model. Correlated weather would require a richer state and can change this answer.
| observed pattern | minimal state candidate | possible missing memory |
|---|---|---|
| Poisson-like constitutive count | molecule count | none evident at that resolution |
| expression episodes | , promoter plus mRNA | chromatin or polymerase substates |
| fixed maturation lag | immature and mature products | elapsed time since initiation |
| shared reporter drift | two reporters plus a cell state | growth, size, ribosome pool, environment |
Add the hidden state needed to make event hazards depend on the present rather than an unrecorded history.
5Write jumps and propensities
Each reaction channel is an integer displacement paired with an event rate.
Keep the constant from Lecture 3 attached to its concentration law. For elementary channel , write
The reactant order is . Since is an event flux in molarity per time, has units . Stoichiometry acts afterward: the channel contributes to . In particular, with contributes to , not .
Fix a well-mixed volume in liters and let be Avogadro's constant. Define , so a count state has concentration . The factor has units inverse molar. A reaction event changes concentration by .
For an integer state containing the counts of species, channel has jump and propensity . The definition concerns the identity of an event:
Two channels can share the same jump. Basal transcription and an activated route may both add one RNA; their destination probability contains the sum of their propensities. A channel rate is not a destination probability unless that destination uniquely identifies the channel.
For the elementary step , the jump is . Each of the molecules can partner with any of the molecules, giving eligible pairs. Multiply by a per-pair hazard to obtain the propensity.
For elementary , choosing a first molecule and a distinct partner gives ordered pairs. Each unordered pair appears twice. With three molecules there are six ordered pairs but only three physical pairs. If is one physical pair's firing hazard,
Absorbing the factorial is a change of convention, not an approximation. However, is not our concentration constant . Its units are inverse time, whereas for this bimolecular channel has units inverse molar per time. We must determine their relationship before inserting a measured concentration-scale constant into an SSA.
Derive the conversion while keeping fixed
There are two ingredients in this conversion. Molecular counting determines the state dependence. The macroscopic limit determines the normalization of the per-combination hazard. Matching a deterministic equation alone would not determine the finite-count model.
For , the count law is . Divide by to get concentration event flux. Substituting and gives . Therefore matches .
For , retain the unordered-pair count. The same calculation gives
At macroscopic volume with fixed nonzero concentration, is negligible compared with . Matching requires . Thus
The combinatorial denominator cancels because the same chemical constant has a different conversion to an unordered-pair hazard. It does not justify setting for identical reactants. That would halve the macroscopic event flux. Gillespie gives the distinct-reactant and identical-reactant conversions explicitly in Section 2, pages 37–38.1
The general formula counts each reactant species separately. Define as the number of unordered reactant combinations. Under the elementary stochastic mass-action assumption, each has the same hazard , so . At large counts,
To recover the specified , set . Define the falling factorial , with and zero value when . Substitution gives the exact propensity of the stated count model:
The concentration constant is . The coefficient multiplying falling factorials is . The per-unordered-combination hazard is . The last two have inverse-time units because integer combinations are dimensionless. None is silently renamed .
The factorial product is not a factorial of the total reaction order. A formal reactant vector gives , with denominator , not . Its mass-action normalization would be . This is a combinatorial example, not evidence that a biological overall reaction is an elementary three-body collision. Binding and catalysis should be resolved at the mechanism's appropriate scale.
| concentration event flux | count propensity | hazard per unordered combination | units of concentration constant |
|---|---|---|---|
| one-molecule source | (one source channel) | molar/time | |
| elementary | 1/time | ||
| elementary | 1/(molar × time) | ||
| elementary | 1/(molar × time) |
The conversion is exact. Replacing falling factorials by powers is not
At an admissible count state, the normalized propensity can be written exactly as
When every required reactant count is large compared with its stoichiometric coefficient, replacing each factor by recovers . For , the ratio for . At one molecule the exact propensity is zero, while substituting concentration directly into would permit an impossible event.
Choose illustrative parameters and . Then and . With three molecules, there are three unordered pairs. Either convention gives , so the first event takes about on average if this is the only channel.
Using instead gives approximately , 50% too large. After the valid event, only one remains and this channel stops. These numbers calibrate the formula. They are not a measured reaction in a named organism.
Checkpoint 2: Double the volume and every reactant count. Does a bimolecular propensity exactly double?
For distinct reactants, yes: . For identical reactants at count , the ratio is , which approaches two only at large count. The change from three molecules to six multiplies the propensity by . The concentration law still has the same . The discrepancy is the finite-count availability correction, not changed chemistry.
The elementary result uses molecular combinatorics in addition to the macroscopic limit. A composite flux has no such automatic microscopic interpretation. For example, one-molecule additions at rate and packets of molecules at rate have the same mean input but different event noise. Specify the jump sizes and effective hazards, or resolve the hidden mechanism, before writing the CME.
Likewise, a fitted law written as uses a species-disappearance constant. For in our event-flux convention, . Read the defining equation when importing a constant from a paper or simulator.
- Order the state vector once and keep that order in every jump.
- Compute products minus reactants for each component of .
- Count eligible reactant combinations at the current integer state.
- Multiply by a rate constant whose units make events per time.
- Check that stays admissible whenever .
Construct a jump-and-propensity table with legal destinations, eligible reactant combinations and consistent units.
Derive the probability law
A master equation is a conservation law on the state graph. Every arrow contributes one gain and one loss.
6One small interval
The CME follows by keeping all events of order and discarding events of smaller order.
Let . To occupy at , either the system was already there and no channel fired, or it was at a predecessor and channel fired once. The probability of two events is . Therefore
Subtract , divide by , and take the limit. No Gaussian assumption enters. No random term is added to an ODE. The probability flow comes directly from discrete reaction events.
Account for all first-order event probabilities in one short interval before taking the continuous-time limit.
7The general CME
Gain from every predecessor minus loss through every outgoing channel.
The state distribution, not a concentration trajectory, evolves by probability entering and leaving each legal count state. This is the central modelling equation of the lecture.
Read it in this order. The argument identifies the state that reaches after jump . The first propensity is evaluated at that predecessor because the event clock runs before the jump. The second term removes probability from at the rate its own clock runs.
The CME is linear in even when propensities are nonlinear in . Its difficulty is dimension: a modest number of species creates a huge or infinite count lattice. Gillespie's direct method avoids enumerating that lattice by sampling paths instead.1
Write a chemical master equation by evaluating each incoming clock at its predecessor and each outgoing clock at the current state.
8Boundaries and conservation
The admissible state space determines which predecessor terms exist.
Let be a constant addition propensity in events/time, and an individual removal hazard in inverse time. For constant addition and first-order removal,
At , define . The removal clock is already zero. Hence . Sum equation (5) from zero to infinity. After shifting indices, every addition gain cancels an addition loss and every removal gain cancels a removal loss. Thus .
Run three checks on any CME: every gain points from a legal predecessor, every outgoing clock appears once with a minus sign, and summing over the legal state space conserves probability. If probability disappears, either an index is wrong or an absorbing/outside state has not been named.
Material conservation survives every random event
Probability conservation and molecular conservation are different statements. Resolve elementary binding as . The two jumps are and its negative. Each preserves and , not merely their averages.
More generally, if a row satisfies , then is constant on every path of the closed reaction model. With fixed binding totals of 3 A-units and 5 B-units, choose complex count as the only independent coordinate. The clocks become and . At the upper boundary association vanishes. At zero dissociation vanishes. This is Lecture 3's conservation law used to reduce a stochastic state space.
Locate a probability-bookkeeping error by summing the CME, and distinguish an absorbing zero from a zero with a surviving source.
9The generator shortcut
The generator obtains observable equations without writing every state probability.
Choose a numerical observable of the current count state, such as a count, its square, or an indicator that the cell is empty. We want its expected instantaneous change without solving all state probabilities. Condition on . In a short interval , reaction changes the observable by with probability . No event contributes zero increment. Hence
Divide by and let it vanish. The resulting linear operator is the infinitesimal generator . It takes an observable to another function of state, with units observable/time:
Then . Choosing gives the mean of . Choosing gives the second moment . Each term asks only how one event changes the selected observable.
For nonlinear propensities, the hierarchy usually opens. A mean equation contains a second moment, which contains a third. Moment closure then becomes an approximation. For affine propensities, polynomial moments of a given order close at that order. The constant-addition, linear-removal process and the two-stage gene-expression example exploit this special structure.
Collect reaction jumps as the columns of and propensities as the column . Coordinate observables give the exact count mean and its fixed-volume concentration counterpart:
Lecture 3's has the same stoichiometry but different rate units. Each is an event propensity with dimensions inverse time, while has units molar/time. A zeroth-order flux constant has units molar/time, a first-order constant inverse time, and a second-order constant inverse molar/time. Counts and event multiplicities are dimensionless, with “molecules” and “pairs” retained as bookkeeping labels. Macroscopic mass-action constants and count-scale pair coefficients cannot be copied unchanged across volume conventions.
At finite copy number, contains a covariance and is not generally the product of means. An affine network closes exactly. A nonlinear rate equation instead requires a justified concentration limit or moment approximation.
On a finite state graph using probability columns , the generator acts on an observable column as . This follows by differentiating .
Identical reactants reveal two separate finite-count corrections
Consider only the channel from Section 5. Let denote its random count, its mean concentration, and its concentration variance. The jump is , so the exact mean equation is
Use , then divide by :
The variance term comes from averaging a nonlinear propensity. The negative term comes from excluding a molecule as its own partner. Both must be accounted for when comparing with . Neither changes the meaning of .
A Poisson count has , so these two corrections cancel at that instant. The dimerization process does not in general preserve a Poisson distribution. An initial agreement therefore does not establish exact deterministic mean dynamics for all time.
A matrix example fixes the transpose convention
A promoter opens with hazard and closes with hazard . In off/on order, using a column of probabilities,
The columns of sum to zero. For the on-state indicator , : off gains indicator at rate , on loses it at rate . The on-probability therefore obeys . Define its stationary value ; integration gives
The umbrella matrix used discrete-time row probabilities; this example uses continuous-time probability columns. State the convention before comparing matrices.
Derive an observable equation from conditional event increments, and identify the moment closure needed before using a nonlinear deterministic mean.
Solve the calibration model
One exactly solvable network becomes a unit test for notation, derivation, code, and interpretation.
10Constant addition and linear removal
This standard immigration–death process is valuable because every representation is tractable.
The state is . The jump and propensity table is:
| channel | jump | propensity | units |
|---|---|---|---|
| +1 | events/time | ||
| −1 | events/time |
The deterministic concentration analogue is addition minus first-order removal. The stochastic model adds an integer boundary and a distribution, but it does not change the mechanism. This makes disagreement among the representations especially diagnostic.
Use the addition and removal clocks to identify the stationary count scale and the correct zero-state equation.
11Poisson, step by step
Stationary neighboring fluxes generate a recursion, and normalization finishes it.
Assume . Define current across edge of the state graph by . The CME says . At stationarity the current is constant along the ladder. The zero boundary gives , so that constant is zero. Only now conclude . Rearrange and define :
Iterate: , , and in general . Normalize:
Thus . Its mean and variance both equal . This is the reference process against which additional gene-expression clocks can be diagnosed.
Zero edge current is stronger than stationary probability. A cyclic state network can sustain circulating current with every state probability constant. Our boundary argument licenses detailed balance for this nearest-neighbor ladder; it does not say cells at steady state are at thermodynamic equilibrium.
Obtain the Poisson law from boundary-forced zero current and normalization, without assuming pairwise balance on an arbitrary network.
12Moments, step by step
Apply the generator to and , then convert the second moment to variance.
For , addition changes by 1 and removal changes it by −1. Equation (6) gives
For , an addition changes the square by ; a removal changes it by . Therefore
Use , reserving for volume. Differentiation subtracts from equation (10); the terms cancel, and the second moments combine into variance:
At stationarity, equation (9) gives . Equation (11) then gives . The probability recursion and moment method agree, which is precisely why this network is a good implementation test.
Derive both mean and variance from event increments, including the subtraction of the evolving squared mean.
13Transients and system size
The calibration model lets us separate four effects: initialization, fluctuation memory, system size and observation duration.
Starting from mean , equation (9) solves to
The relaxation time is . Sampling at one tenth of that time does not produce a stationary ensemble. Initialization matters even when the eventual stationary law is known.
The entire transient law has a direct construction. Start with exactly molecules. Each independently survives with probability , giving a binomial survivor count. New arrivals form a Poisson process; an arrival at time survives with probability . Independent thinning gives a Poisson new-survivor count with mean . The contributions are independent:
For , the transient law is Poisson with a changing mean. At , and minutes, its mean is . The sampled mean from 5,000 paths has standard error about .
The stable state still fluctuates
Lecture 4's linearized matrix is the scalar , restoring mean perturbations as . Events continually inject variance. At the stationary mean their squared-jump-weighted rate is . If is stationary variance, equation (11) becomes
This algebraic Lyapunov equation balances covariance; it is not itself a nonlinear global-stability proof. The same structure appears in network linear-noise approximations; here the second moment is exact. Also, . Multiply by the centered count at time and average at stationarity: . The restoring time is also the fluctuation memory time.
Change system size without changing the concentration kinetics. Fix a reference volume and define the dimensionless multiplier . The physical conversion factor remains . If the reference addition propensity is , use in the enlarged volume and keep the per-molecule removal hazard unchanged. Stationary count mean grows as , standard deviation as , and relative spread as . Kurtz gives the rigorous density-dependent convergence to deterministic kinetics.3
The plotted normalization is count per reference volume. Write . Then and at stationarity. Actual molarity is . This separates a dimensionless size comparison from the unit conversion used to derive propensities.
Match initial conditions and observation windows before comparing a transient ensemble with a stationary distribution or system-size limit.
Simulate and estimate
The direct method samples event histories. Specified observation times, weights and assumptions turn those histories into estimates.
14Derive the waiting time
While no event occurs, the state is fixed, so the total hazard is constant.
Let . If is the probability that no event occurs for another , then
Hence . If is uniform on , solve :
This skips every empty interval. It is especially efficient when events are rare because the sampled waiting time can be arbitrarily long without repeated null steps.
Sample a next-event time from the survival probability and state why the hazards must remain fixed while waiting.
15Derive the winning channel
Conditional on an event, each channel owns a fraction of the total hazard.
The joint density that the next event occurs at time and is channel is . Integrating over time yields . Draw a second uniform and choose the first satisfying
The order of channels changes no probability if the intervals have the correct widths. After the chosen jump, every propensity that depends on a changed species must be recomputed. The clocks were conditionally independent only while the old state remained fixed.
Select the firing channel from cumulative propensity and update the state only after identifying that channel.
16Implement the direct method
A correct simulator is a short loop surrounded by explicit assertions and event logs.
- Initialize time , integer state , stop condition, and a reproducible random seed.
- Evaluate every . Assert that each value is finite and nonnegative.
- Set . If it is zero, stop at an absorbing state.
- Draw . Set .
- If passes the observation time, record the unchanged state there and stop.
- Choose the channel by equation (15), advance time, and apply .
- Assert integer nonnegative state, log time and channel, then return to step 2.
Store events rather than only regularly sampled output. A step path can be rendered later at any observation grid. Event times are also needed to test waiting-time models, while a regularly sampled trajectory may hide short episodes.
A complete reference implementation
The following Python uses only the standard library. Each returned pair records a state immediately after a jump; the last pair is an observation-time sentinel, not an event. The state between successive timestamps is constant. Parameters use minutes, with in additions/minute and in inverse minutes.
import math
import random
def addition_removal(b=4.0, d=0.2, end=60.0, n0=0, seed=123):
assert all(math.isfinite(z) and z >= 0 for z in (b, d, end))
assert isinstance(n0, int) and n0 >= 0
rng = random.Random(seed)
t, n = 0.0, n0
history = [(t, n)]
while t < end:
total = b + d*n
if total == 0:
break
u = rng.random()
while u == 0: # require an open lower endpoint for the logarithm
u = rng.random()
next_t = t - math.log(u)/total
if next_t >= end:
break
n += 1 if rng.random()*total < b else -1
assert n >= 0
t = next_t
history.append((t, n))
history.append((end, n))
return history
The horizon test must occur before applying the jump. Otherwise an event from the future contaminates the endpoint sample. At zero, removal has zero propensity; clipping a negative count would hide a broken event selector. A zero-total-hazard state still contributes its entire remaining residence time.
Implement the direct method without a fixed timestep and retain every holding interval. Use the following sections to turn the event log into a specified estimator.
17Estimate observables from event histories
Specify the quantity being estimated, then choose either independent histories or residence intervals as the sampling units.
Sample independent paths at a common time
An ensemble estimator averages realizations of one defined experiment. Let be a scalar observable of the count state and write . Generate independent paths from the same initial law and parameters. Read each right-continuous path at the same physical time , giving . For , define
Independence makes the variances add. If is finite, then . A sample standard error is . This is pointwise uncertainty at a fixed time. It requires neither stationarity nor ergodicity.
| Choose the observable | The ensemble average estimates |
|---|---|
| The mean count of species . | |
| Its second raw moment. Combine with the mean to obtain variance. | |
| The probability of count . Repeating over produces a histogram. | |
| The probability of exceeding a chosen threshold . |
A probability estimate also has a sampling scale. For an event with probability , its indicator has variance , so the estimator's standard deviation is . Observing no rare events does not prove that their probability or uncertainty is zero. A symmetric normal approximation can be poor when few events are observed.
A mean curve reuses the same paths at multiple times. Its pointwise errors are therefore correlated. In fact, . Averaging the tenth event of each path would answer a different question because those events occur at different physical times.
More paths and later endpoints perform different operations. Increasing improves the fixed-time estimate. Extending every run from to a later time does not add samples at . It permits a different target to be studied, whose variance may be larger or smaller.
Integrate one path with its holding times
An event log determines a finite-window time average exactly. Let its state be on . Choose an observation window from to , with duration . The weight of interval is its overlap with that window:
This is the integral . No assumption about ergodicity is needed to define or calculate it. Stationary interpretation comes in the next section. An absorbing state contributes the remaining duration through . A simulation stopped by an event cap must not invent an unobserved tail.
The worked record makes the weights visible. Counts 2, 3 and 2 occupy successive durations 1, 0.2 and 2.8 minutes. The mean is . The occupancy of count at least 3 is . The following functions compute those integrals and read fixed-time snapshots from the same event-log representation.
import bisect
import math
import statistics
def time_average(history, observable=lambda n: n, start=0.0, end=None):
end = history[-1][0] if end is None else end
if not history[0][0] <= start < end <= history[-1][0]:
raise ValueError('The complete observation window must be in the history.')
area = 0.0
for (t, n), (next_t, _) in zip(history, history[1:]):
duration = max(0.0, min(next_t, end)-max(t, start))
area += observable(n)*duration
return area/(end-start)
def state_at(history, time):
if not history[0][0] <= time <= history[-1][0]:
raise ValueError('Observation time is outside the simulated history.')
index = bisect.bisect_right([t for t, _ in history], time)-1
return history[index][1]
def ensemble_estimate(histories, time, observable=lambda n: n):
values = [observable(state_at(h, time)) for h in histories]
if len(values) < 2:
raise ValueError('At least two independent paths are needed for a sample SE.')
return statistics.mean(values), math.sqrt(statistics.variance(values)/len(values))
def residence_mean(history, burn=0.0):
return time_average(history, start=burn)
Apply the function to an indicator to obtain a time histogram. For example, time_average(history, lambda n: n == 0) returns the fraction of the window at zero. This is an occupancy fraction from one record. It becomes an estimator of a stationary zero probability only under the additional conditions below. The weighted second moment minus the squared weighted mean is a within-record variance. It is consistent under suitable ergodicity, but need not be unbiased at finite duration. Applying a Bessel correction based on the number of events does not remove time correlation or initialization bias.
On an ergodic stationary class with finite positive mean total event rate, compare time sampling with event sampling. Predetermined regular times or residence-time weights estimate the time law. Erban, Chapman and Maini's example explicitly records at fixed time intervals.12 The variable is the total outgoing propensity. Giving every pre-event state one vote favors states with larger . If is the stationary time law, its event-sampled counterpart is weighted by that rate.
For and Poisson mean , the event-sampled mean is . Running longer makes that estimator converge more precisely to the wrong mean for time sampling. Regular-time observations avoid this weighting bias, although neighbors remain correlated.
Independent-path averaging is not restricted to snapshots. Define a path functional , such as total occupancy over a window or the indicator that a threshold has been reached by time . Average its value across independent paths. The same standard-error rule applies when has finite variance.
Unfinished first passages must remain in the sample. Let be the first time the threshold is reached. If every path is simulated only to horizon , averaging only the observed hitting times selects early events. The data directly estimate the survival probability through and the restricted mean . Estimating an unrestricted mean requires the unobserved tail to be resolved or modeled.
Read independent histories at common physical times for ensemble statistics. Weight holding intervals for time integrals. Keep the target, observation window and sampling unit attached to every reported estimate.
18Use a long history to estimate a stationary law
A long record is useful only when its dynamics sample the relevant states and the record spans enough correlation times.
State the ergodic claim
Ergodicity connects a time average to a stationary expectation. Let be a stationary probability law. For a nonexplosive, irreducible, positive recurrent continuous-time Markov chain, an observable with obeys the corresponding ergodic time-average law:
Irreducibility means that the states in the relevant class communicate. Positive recurrence means that returns have finite mean waiting time and the stationary law can be normalized. These are sufficient conditions for this countable-state setting. An arbitrary initial condition within that class can still converge in the long-time average. Starting at stationarity is a stronger convenience used for the exact variance formula below.
The constant-addition, linear-removal model supplies an ergodic calibration. With , addition permits escape from zero and removal prevents indefinite accumulation. The chain on nonnegative counts is irreducible and positive recurrent, with the Poisson law already derived. A long residence-time histogram can therefore estimate that law.
Separate initialization bias from correlated sampling error
Discarding an initial interval changes the finite-window bias. Write and suppose . The exact transient mean is . Integrating it over a window of length after a discarded interval gives
A longer discarded interval reduces this bias, at the cost of simulation time. It does not create independent samples. In a metastable switch, a record may remain in one basin for much longer than its local relaxation time. A flat running mean within that basin is not evidence that all basins were sampled.
Temporal covariance gives the variance of a time average. Now assume the record starts at stationarity. Define and . Expand the variance of the integral into a double integral. Stationarity makes each covariance depend only on the separation of the two times:
For a separation , one ordering of the two times occupies length . The factor two includes the opposite ordering. This is why densely spaced frames do not count as independent observations.
The integrated correlation time controls the long-window error. Define and . When the covariance is integrable and the window covers its decay,
Here is the number of independent stationary observations that would give the same leading variance. It is specific to the observable. Ergodicity alone does not guarantee this error law. A normal confidence interval additionally needs an appropriate central limit theorem and a reliable estimate of long-lag covariance.
Turnover changes precision at fixed mean count
The calibration model gives every term exactly. Its stationary covariance is , as derived from the conditional mean earlier. Therefore . Substitute this covariance into the finite-window integral:
Speeding both clocks preserves the snapshot law. At fixed , changing from to , with time measured in minutes, leaves the stationary Poisson mean and variance at 20. The correlation time falls from 20 minutes to 1.25 minutes. The exact standard deviation of a stationary 60-minute time average falls from about 3.02 to 0.90 counts.
Checkpoint 3: Does one stationary 60-minute movie with removal 0.2/min estimate the mean as accurately as 5,000 independent snapshots?
No. At mean 20, the time-average standard deviation is about 1.748 counts from the exact finite-window formula. The independent-snapshot mean has standard error counts. The movie's long-window effective count is about . More frames do not increase that effective count.
Independent long records can improve a stationary estimate in both ways. If each of independent, stationary paths has length , averaging their time averages gives leading variance . This combines independent replication with time averaging. It is a different estimator from a snapshot at the final time.
For a stationary target, check accessible states, initialization and correlation. Use path number to quantify independent replication and integrated correlation time to quantify information in a long record.
19Check which states one history can sample
An absorbing boundary can remove the stationary positive-population regime needed for a long-path estimate. The exact consequence depends on the reaction mechanism.
Balanced autocatalysis separates finite-time means from long histories
Use the autocatalytic boundary already introduced. Let composite addition and removal have propensities and , with in inverse time. The omitted resources are held fixed by the model. Start with one molecule. Write for the count of . This is the critical linear branching process.
The generator gives a constant ensemble mean. Addition and removal change the count by opposite amounts at equal rates. Apply the generator to and :
Thus and . An independent-path estimate at fixed has standard deviation . Increasing the time while holding the number of paths fixed makes this estimate less precise.
Derive extinction from the branching property. Let . In an initial interval of length , removal leaves zero descendants, addition creates two independent lineages, and no event leaves one. For the probability of extinction after the remaining time ,
Subtract , divide by and let it shrink. With , the resulting equation separates:
Zero is absorbing, so is also the probability of having become extinct by time . Its limit is one. Every path therefore reaches zero in finite time with probability one. The mean extinction time can still be infinite because diverges.
Rare surviving paths carry the finite-time mean. Since extinct paths contribute zero, dividing the full mean by the survival probability gives
At , 99% of paths have count zero. The surviving 1% have mean count 100, leaving full mean 1. A large ensemble and one late-time history can therefore look very different while both follow the same exact reaction model.
The long-path average is dominated by the absorbing tail. Each realized path has only a finite pre-extinction history, followed by zero forever. Consequently with probability one, while for every finite . Taking an expectation and taking the infinite-time limit cannot be interchanged here.
The absorbing stationary law itself is not a counterexample to ergodicity. The law concentrated at zero is stationary, and a path started there has both time and ensemble mean zero. The failed substitution would use one long extinct path to estimate the nonstationary ensemble mean starting from one molecule. Convergence of its distribution toward zero does not force convergence of its unbounded count mean. The rare, increasingly large survivors prevent the uniform integrability needed for that step.
The usual inverse-duration error formula does not apply. This process is not a stationary record with integrable count autocorrelation. For , the conditional mean is , so . Integrating this nonstationary covariance gives . The growing variance and almost-sure limit zero are compatible because of rare large paths.
Multiple absorbing outcomes give a stationary nonergodic example
A finite autocatalytic system can have more than one closed class. Consider two modeled elementary reactions with equal microscopic rate constant :
At fixed volume, let the conserved total count be , with molecules of species and of species . The count-scale constant is , in inverse time, by the distinct-reactant conversion in Section 5. Both transition propensities are . Counts zero and are absorbing. Every interior state has the same probability of jumping up or down.
One path selects an outcome that an ensemble can mix. Write for the random count of . If , the symmetric finite random walk reaches with probability . The bounded count has unchanged conditional expectation after each step, so its ensemble mean stays . A single path's time mean instead tends to its final count, either zero or . For , neither outcome equals that ensemble mean.
A stationary mixture of those outcomes is nonergodic. The stationary law places its probability on two closed classes. A path stays in the class selected at initialization and cannot sample the mixture. This is a literal failure of stationary ergodicity, distinct from the critical model's nonstationary rare-survivor effect.
Absorption has to be interpreted with the rates. For linear autocatalysis with addition and removal , with both constants in inverse time, gives an ensemble mean that decays to zero as well as almost-sure extinction. There is then no disagreement between the two limiting means. Slow switching in an irreducible positive recurrent system presents another situation: asymptotic ergodicity may hold while the available record is too short to use it.
Inspect absorbing states and communicating classes before replacing an ensemble by a long trajectory. Distinguish stationary nonergodicity, a nonstationary extinction limit and an ergodic system observed for too little time.
20Validate before interpreting
A plausible trajectory is almost no evidence that simulation code is correct.
Validation proceeds from invariants to distributions. Assert the state never leaves its admissible lattice. Confirm absorbing states remain absorbing. For the constant-addition, first-order-removal model, compare fixed-time ensemble means and variances with the exact transient predictions for the chosen initial state. Compare against the stationary value only after checking relaxation. Compare the entire histogram, not just two moments. Use separate checks for initialization bias, finite-path error and time correlation.
Then run limiting cases. Set addition to zero and check monotone extinction. Set removal to zero and compare event counts with a Poisson process. Increase volume by at fixed concentration and check the predicted relative-noise scaling. Gillespie, Hellander, and Petzold describe the exact method and approximation ladder in enough detail to make these tests model-specific.2
The direct SSA samples the stated well-mixed Markov jump process without timestep approximation. Floating-point arithmetic aside, it is exact for that CME. It is not exact spatial chemistry, exact crowding, or exact biology.
Checkpoint 4: What tests can reject the reference implementation without inspecting a plot?
With , every state must be zero. With , counts must be nondecreasing and the endpoint increment is Poisson with mean . With both constants zero and , the residence mean must equal 7 for any legal burn. Reusing a seed must reproduce the entire history. For 5,000 independent paths, the exact transient mean is 19.999877; deviations of a few hundredths are ordinary sampling error.
Reject an implementation that violates a count boundary, conservation law or analytic calibration before interpreting its biology.
Go beyond Poisson
Once the calibration passes, hidden biological clocks can be added and their signatures compared with data.
21Translation amplifies
One mRNA can create a random packet of proteins before it disappears.
Let be a fixed gene-copy count, the RNA count and the protein count. Transcription per gene and translation per RNA have constants and ; per-molecule removal constants are and . All four channels are composite:
Take constant: gene replication and promoter switching are not part of this model. All four constants have inverse-time units when gene, RNA and protein copies are dimensionless counts. Let denote the joint probability of RNAs and proteins, and put it to zero outside the legal lattice. The four-channel CME is
The translation predecessor has the same RNA count: translation does not consume its template. Coordinate observables give and . Because all propensities are affine, these means and the second moments close exactly. We will derive
Write count covariance as , keeping available for molecular complexes. Here the count shorthand is for RNA and for protein. At stationarity, the RNA subsystem is Poisson: and . Protein mean is .
For the mixed observable , transcription adds , translation adds , RNA removal subtracts , and protein removal subtracts . Multiplying each increment by its clock gives . Differentiate to obtain
Apply the squared-count calculation of Section 12 to protein. Its addition clock now fluctuates with RNA, leaving an extra covariance term:
Divide by and use to recover equation (17). The first term is the protein event contribution. The second records how long protein retains a fluctuating RNA input. No Gaussian assumption has been made.
If protein is much longer lived than mRNA, the excess approaches , the mean number of translation events during one mRNA lifetime. Thattai and van Oudenaarden used this architecture to analyze intrinsic gene-expression noise.4 The interpretation still needs a copy-number check. When many mRNAs overlap, a high Fano factor does not imply visually isolated protein bursts in a single trace.
Checkpoint 5: What controls relative protein noise in the short-RNA limit?
With fixed and , . The second term is the inverse number of transcripts initiated during a protein's mean lifetime. The relevant averaging count is not simply the number of RNAs present in one snapshot.14
Estimate translational amplification from the ratio of protein-synthesis and mRNA-removal clocks, without inferring isolated bursts from a Fano factor alone.
22Promoters create environments
When the addition rate switches, the molecule count is driven by a stochastic input rather than one fixed clock.
Resolve one promoter into off and on states. Write its binary state as and its RNA count as . The composite channels have conditional propensities
All four constants are inverse-time quantities in this count model; is the on-state transcription propensity, not a bimolecular binding constant. Use uppercase and for the random promoter indicator and RNA count, and lowercase for their values. With , the two coupled probability equations are
Summing over recovers the promoter equation from Section 9. Summing over promoter states does not close an RNA-only CME: its addition term still involves . The exact stationary mean and Fano factor are
The on fraction fixes the mean, while the switching clock controls how much promoter variation survives mRNA filtering. This explains why the same occupancy can give either modest overdispersion or long expression episodes. It does not make a two-state promoter generically bimodal.
To derive equation (19), put and . Since , the mixed moment closes:
At stationarity this yields . The RNA variance equation is . Thus , yielding equation (19). Excess variance records a correlation erased by substituting the promoter's mean. This is the concrete question carried into Lecture 6.
The promoter covariance itself is , obtained from the conditional relaxation in Section 9. RNA remembers that input for time . Multiplying both switching constants by a large factor keeps occupancy fixed but shortens the input memory. For this unregulated model, the extra Fano term vanishes in that limit.
Predict how promoter switching changes the mean, covariance and Fano factor, and compare switching time with transcript lifetime.
23Derive random protein packets
A burst has a size distribution and an observation window. Both enter its noise.
Follow one newly made transcript. While it is alive, translation events have propensity and removal has propensity . At the next event, translation wins with probability . After translation the same two clocks restart, because the transcript is still present. Exactly translations followed by removal therefore has probability
This geometric law includes a zero-protein transcript. Conditioning on an experimentally detected nonzero burst changes the distribution and its mean. The packet becomes an effectively instantaneous event for protein only when the RNA lifetime is short compared with the protein timescale being resolved. The two-stage model in Section 21 remains appropriate outside that limit.
An order-of-magnitude estimate is a translation every ten seconds over a mean three-minute RNA life: . This is an illustrative calculation, not a universal biological constant. Cai, Friedman and Xie inferred protein monomers, or active tetramers, per burst for their weakly expressed β-galactosidase reporter. Catalytic amplification, calibration and membrane permeability enter that inference.13 A transcriptional burst instead counts RNAs made during one promoter-on episode; do not attach a protein packet estimate to it.
First count packets in a window without removal
Let be the number of independent packet arrivals in time . Sizes are independent of arrivals and of one another. Total additions are . Condition on , then use total expectation and total variance:
Thus . Fixed-size packets give ; geometric packets give . These are laws for accumulated additions, not stationary abundance. The core's fixed-packet counting argument belongs to this window calculation.
Now let molecules disappear independently
Add first-order removal with propensity . The composite addition channel is , where the integer packet size is drawn at an arrival; equivalently, use one channel of jump and propensity for every positive . A zero packet changes no state. Applying the generator to and gives
At stationarity , so
The difference is physical: older packets have been independently thinned by removal. A stationary pool contains a mixture of packet ages, whereas our first window retained every arrival. Equation (21) is exact for the instantaneous-packet model; it agrees with the fast-RNA limit of Section 21. At arbitrary RNA lifetimes, use the full two-stage Fano factor.
Checkpoint 6: For mean packet size 20, which Fano factor should a student report?
State the model and observable first. Fixed packets: window 20, stationary 10.5. Geometric packets: window 41, stationary 21. For finite RNA lifetime use instead. None is a contradiction of another.
Derive a packet distribution from competing clocks and calculate its noise for the actual observation window.
24Derive the distribution limits
Poisson, negative binomial, gamma and log-normal describe regimes and mechanisms, not fixed categories of molecules.
Geometric packets give an exact negative binomial
Define the probability-generating function . A packet multiplies by . Its own generating function is , obtained by summing the geometric series in equation (20). Removal contributes . The stationary generator equation becomes
Integrate and impose . The result and its series coefficients are
Here and is a rising factorial. It is different from the falling factorial used to count available reactants in Section 5. The series coefficient follows by differentiating times at zero, which produces the successive factors .
This is a negative-binomial distribution with possibly noninteger shape . Differentiating at 1 recovers mean and variance . Shahrezaei and Swain derive this law from the short-lived-RNA limit of gene expression.8
What the continuous gamma approximation removes
Keep fixed and scale abundance as while grows. The Laplace transform is . Since , it tends to , the transform of the gamma density
The function here is Euler's gamma function, not the stoichiometric matrix. The limiting density has mean and variance . Restoring the abundance scale gives mean and variance . Compared with the discrete model, the extra variance has been neglected.
Friedman, Cai and Xie's continuous burst model uses exponentially distributed jumps and continuous removal; its gamma law has this same distinction from a discrete count CME.15 A continuous density has no point mass at zero. It must not be used to read off the probability of zero RNA or zero protein. That probability in equation (22) is .
The telegraph model has a different exact mixture
For the unregulated promoter of Section 22, condition on its entire stationary history. RNA additions are then an inhomogeneous Poisson process, and independent removal thins them. The surviving RNA count is Poisson with random mean , where
Let and be stationary densities jointly with promoter state. Probability transport under the two deterministic velocities, combined with promoter switching, gives
Add the equations. Zero boundary flux implies . With , this means and . Substitute into the first equation and divide by :
Thus stationary RNA is a Poisson–beta mixture: sample , then sample . Total variance immediately reproduces equation (19). This result requires positive switching and removal constants, no feedback from RNA to the promoter, and the infinite-past stationary construction. It is not a generic statement about all RNA distributions.
A constitutive RNA can be Poisson; a switching promoter gives the mixture above; a brief active episode can generate a negative-binomial RNA limit. A protein can have an approximately gamma distribution in a burst regime. Multiplicative variability can make its logarithm approximately Gaussian and hence its level approximately log-normal. Taniguchi's calibrated bacterial protein survey and Furusawa's growth-coupled models address different regimes.2425 “RNA is gamma, protein is log-normal” is not a sound classification.
Checkpoint 7: A negative binomial has mean 12 and Fano factor 5. Infer its parameters and its zero probability.
Under this model, and , so . This identifies two effective parameters within the model, not the molecular mechanism uniquely.
Derive a count distribution from its event model and state the scaling that permits a continuous approximation.
Noise, stability and memory
The Jacobian describes restoring motion. Reaction events describe the disturbances being restored. A growing cell adds another part of the state.
25Linear noise from reaction events
The linear-noise approximation reuses Lecture 4's matrix, but the noise strength must be derived from the reaction list.
Write the deterministic count-scale drift as . At a fixed point , define . For this local calculation, treat count as continuous. The deterministic perturbation equation is . If all eigenvalues of have strictly negative real parts, perturbations decay. This does not mean the stochastic system stops receiving perturbations.
Derive the covariance supplied by one event
A jump changes by . The last term is simultaneous change, absent from an ordinary chain rule. The generator therefore produces an exact identity before any linearization:
Here is the count vector defined at the start. The entry of is . Independent reaction channels have conditionally independent firing increments to first order in time, but species increments need not be independent. One reaction can change several species.
Linearize about the deterministic fixed point, evaluate there, and neglect higher-order terms. This gives the LNA covariance equation and a corresponding local Gaussian process:
The components of are independent standard Wiener processes, with increment variance . Consequently has units count-squared/time and inverse time. Paulsson's treatments connect the same covariance calculation to fluctuation–dissipation and noise filtering.1614
Why a Lyapunov equation appears
At stationarity, covariance added by events balances covariance removed by restoring dynamics:
For a Hurwitz matrix , the integral converges. Differentiating its integrand and evaluating the endpoints gives . The integral also shows that covariance is positive semidefinite: every disturbance is propagated forward and accumulated. This is an algebraic covariance balance, distinct from constructing a Lyapunov function to prove global nonlinear stability.
If a conservation law leaves zero modes in the full coordinates, first restrict to independent variables within a fixed compatibility class. If a restoring eigenvalue approaches zero, fluctuations spread and the local approximation can break down. Rare switching, extinction and strongly separated modes require a global stochastic calculation. For affine propensities, the first two moment equations are exact; the stationary distribution can still be Poisson or otherwise non-Gaussian. Exact covariance does not make the Gaussian distribution exact.
Checkpoint 8: Recover the Poisson variance using the LNA matrices.
For , , and . Equation (25) gives , hence . These moments are exact because both clocks are affine, but a Gaussian would incorrectly assign some probability to negative counts.
Build both the restoring matrix and event-covariance matrix from a reaction model before solving its local noise balance.
26Suppression and reaction coupling
A steeper restoring slope can reduce local noise, but a complete calculation also includes the controller's events.
We make three comparisons. First change the restoring slope while holding the mean fixed. Then keep the drift fixed and change which additions occur together. Finally ask what event budget a molecular sensor needs to implement feedback. These isolate restoration, event covariance and information cost.
Start with effective addition of propensity and removal of propensity . At , the scalar matrices are and . Equation (25) gives
Negative feedback has , so restoration is faster and the local Fano factor is below one. This comparison holds the mean fixed by adjusting the operating point. The actual addition law must stay nonnegative on the count lattice; its tangent need not. Equation (26) is a local approximation, not permission to implement a negative propensity.
Two networks with the same ODE and different covariance
Now keep the restoring dynamics fixed. Consider two species with effective addition and removal. In an independent-addition model the composite channels are and , each at propensity . In a coupled-addition model replace them with one , also at propensity . Both retain at and at . The removal of X catalysed by Y is an effective process here, not a resolved elementary collision.
This is a version of the coupled feedforward example studied by Xiao and colleagues.18 Use as continuous count coordinates in this local approximation, not molar concentrations. Each network has drift and fixed point . Choose illustrative count-scale parameters , and per eligible X/Y pair. Both fixed-point counts equal 50. At that point,
For the coupled addition, the outer product of jump has four entries equal to one. Multiplication by propensity 10 supplies the off-diagonal 10. Both diagonal entries remain 20 after adding removal events. Let . The three independent entries of the Lyapunov equation are
Solve in that order. First . Then and . Independent additions give ; coupled addition gives .
Intuitively, extra Y promotes later X removal and generates negative covariance. A shared addition simultaneously supplies X when it supplies Y. In this example those correlations offset one another. Other coupling signs and other restoring matrices can amplify noise. Neither the deterministic network diagram alone nor “coupling helps” is an adequate noise calculation.
Why unlimited restoring gain is not a free controller
Equation (26) assumes that the effective propensity has access to the current count. A molecular controller must sense that count through events. Lestas, Vinnicombe and Paulsson bound achievable suppression for a specified signalling architecture, allowing a very general causal controller.17 Let be the controlled mean count and the expected number of signalling events in one controlled-species lifetime. In their convention, and
The main-text information bound can be expressed as with signalling capacity bounded by . Those are the theorem inputs, not results of our LNA. Combining them gives ; the positive root yields equation (28). The original treatment uses a continuous stochastic approximation for the controlled species, with discrete signalling and potentially history-dependent control.
At large signal budget the lower bound on standard deviation scales as at fixed controlled mean. Lowering that bound tenfold requires roughly ten thousand times the signal budget. This is not an engineering guarantee or a theorem covering every architecture. Reactions that simultaneously alter sensing and controlled species change the assumptions behind a decoupled signalling calculation. The appropriate response is to specify the new channel structure and recompute, not to announce a violation of a universal law.
Separate restoring gain, sensing cost and correlated reaction events when evaluating a claim of noise suppression.
27A stable switch has a lifetime
A Jacobian describes recovery inside a basin. Memory also depends on how long a random path stays there.
For the symmetric toggle in the core playground, let dimensionless concentrations be and . Here the playground uses for the count corresponding to its chosen concentration unit : . This is a dimensionless count scale, unlike alone when concentrations are molar. In removal-lifetime time units, use composite additions , , and individual removals. The propensities are
These Hill laws are assumed effective expression laws, motivated by fast regulatory binding. The count model does not resolve promoter binding, RNA, bursts, maturation or growth. A deterministic Hill reduction does not, by itself, prove that these particular stochastic propensities preserve all those mechanisms.10
The macroscopic equations are and its symmetric partner. The outer fixed points satisfy , giving and its reversal. The Jacobian's eigenvalues there are , so both states restore small perturbations. Their deterministic positions and restoring rates do not change when changes. Their stochastic residence times do.
A one-dimensional first-passage problem we can solve completely
Use a self-activator to learn the calculation before tackling the two-dimensional toggle. Let be the addition propensity and the removal propensity. The deterministic drift has stable roots 0.056325 and 1.322381, separated by unstable root 0.671294. Define a target count . Let be mean time to first reach that target, starting at .
In a short interval, time is spent regardless of the next jump. Condition on the three possibilities, cancel , and divide by . The backward equation and boundaries are
Put . The zero boundary gives . Every next difference follows from . Finally sum backwards from the absorbing target:
This finite recurrence is exact for the declared birth–death model and hitting target. It requires no noise-strength fit or escape asymptotics. For , start at count 1 and target 14: removal lifetimes. At , start at 2 and target 27: . The deterministic attractors did not move. Passing the middle threshold is not the same as committing to the upper basin, since recrossings remain possible.
The toggle needs a two-dimensional backward equation outside a specified target region, or a suitably validated trajectory estimate. A scalar self-activator formula cannot be copied into it. In simulation, record trajectories that have not switched by the stopping time as right-censored. Averaging only the paths that switched underestimates memory lifetime. A local Gaussian fit is particularly poor evidence about a rare tail event.19
Distinguish local recovery, threshold crossing and basin-to-basin switching, and compute an exact one-dimensional hitting-time benchmark.
28Growth and division are different
Growth changes the concentration denominator; division changes the state by a separate reset.
Build the growing-cell model in three steps: its balance between divisions, its partition rule at division, and the event clock when volume changes while we wait. The last step determines which simulation algorithm samples the specified model.
Let volume obey , and let the deterministic molecule balance between divisions be . Here is molarity, a concentration addition flux, true degradation, and growth rate. The quotient rule gives
This recovers Lecture 3's addition–removal form. The term removes concentration, not molecules. At the event level, between synthesis and degradation jumps the count is constant while concentration decreases continuously with volume. It is therefore a different model from adding random molecular deaths at hazard in a fixed-volume CME.
Dilution can also set a timing mechanism. If synthesis is suppressed, degradation is negligible and a repressor starts at concentration , then . Release at a threshold occurs after . A twofold peak change adds one doubling time to this interval. The repressilator redesign illustrates how dilution and titration thresholds can set timing; the lineage separates these interventions from better observation.23
What happens at division?
Suppose the tracked daughter receives volume fraction . Independent, well-mixed partition assigns each of the parental molecules to that daughter with probability . Then and . Keeping parental count and volume fixed,
For symmetric division, conditional concentration CV is . At parental count 20 it is 22.36%; at count 80 it is 11.18%. Exact proportional partition leaves concentration unchanged, not halved. Clustering, unequal partition probability, or random daughter size require another reset law. Golding and colleagues tested approximately binomial partitioning for their labelled RNAs; that result is evidence for a particular reporter, not a universal partition theorem.20
The event clock changes when volume grows
For a constant concentration addition flux , count propensity between events is . Waiting no longer leaves all hazards fixed. The general no-event law is
For addition alone during exponential growth, put . Drawing and integrating gives . Its limit as is the usual exponential draw. With several time-varying hazards, solve the integrated clock and choose the channel using its hazards at the event time. A scheduled division that occurs sooner must be processed first, with the reset and subsequent clocks recomputed.
The growth studies mentioned in the core now ask distinguishable questions. Tian's group compared self-activation and mutual repression under growth-dependent dilution; Fu's group showed how unequal growth responses of the toggle's arms can move the decision landscape itself.2122 Test a deterministic growth-rate pulse, growth-dependent expression parameters, and random partition separately before combining them. A moving basin is not just a larger random kick in a fixed basin.
The Fu-group experiment distinguishes unequal expression responses from unequal phenotype growth. The published study found no significant growth-rate difference between the two phenotypes under its comparison. The two regulatory arms nevertheless responded differently across growth conditions. Thus the landscape change need not arise from a high-expression state slowing its own growth through metabolic burden. A model can hold growth externally prescribed and still change its nullclines through growth-dependent synthesis.22
Checkpoint 9: Should a count-and-volume simulation include both random deaths at rate λN and volume growth?
Not to represent the same dilution. Volume growth already decreases concentration. Add molecular removal only for an independently specified mechanism such as degradation. Likewise, halving both count and volume preserves concentration under proportional division; an additional concentration-halving reset would count dilution again.
Construct a count–volume model with separate synthesis, degradation, continuous dilution and division partitioning.
Make an inference
A solved model is only half the argument. The observation must distinguish it from credible alternatives.
29What another observable buys
A second reporter or a time interval can expose a mechanism that one histogram cannot identify.
Derive the paired-reporter decomposition
Let two calibrated reporter outputs be , with the same conditional distribution given shared cell history . Assume they are conditionally independent. Write conditional mean and variance , and overall mean . Total variance and covariance give
Dividing by yields intrinsic and extrinsic relative-noise estimates. The algebra explains the diagonal and off-diagonal directions of the reporter cloud: common changes move both reporters together; conditional independent events separate them. This is the logic of Elowitz's experiment and Swain's formal treatment.56
Reporter competition, unequal maturation, shared transcripts, correlated measurement error, or different regulatory responses violate the simple decomposition. Independent detector noise enters the difference just like reporter-specific chemistry unless calibrated separately. What counts as “intrinsic” changes with the subsystem boundary; it is not a synonym for the unexplained residual.
A hidden sequence leaves a waiting-time signature
Compare a single exponential step of mean 20 minutes with two sequential exponential steps, each of mean 10 minutes. Both total intervals have mean 20. Their densities are and . To obtain the second, convolve the two stage densities: .
The one-step process has CV 1 and a positive density at zero. The two-step interval has CV and zero density at zero because two steps must finish. Its survival is . This is an illustrative hidden-stage diagnostic, not a claim that every mammalian promoter has exactly three states.
Braichenko, Holehouse and Grima compare promoter models that can fit similar count distributions while differing in initiation-time evidence.9 A negative-binomial fit can estimate effective frequency and size within a chosen model; it cannot establish how many chromatin or initiation states generated it. Add the observable most likely to separate alternatives: temporal correlations, waiting times, paired reporters, or a controlled growth perturbation.
Checkpoint 10: Two reporters each have mean 10, variance 25 and covariance 9. What does the simple decomposition infer?
Shared relative variance is ; reporter-specific relative variance is . Total relative variance is 0.25. These interpretations require the conditional-independence and reporter-matching assumptions, not just the arithmetic.
Choose an additional measurement that separates plausible mechanisms and state the assumptions behind its interpretation.
30A complete working protocol
End with a model another person can reconstruct and a plot that could prove it wrong.
- Question. State the observable, sampling operation, time window, and condition.
- Scale. Convert concentrations to counts and identify every low-copy or boundary-sensitive species.
- State. Add enough hidden states to make event hazards conditionally memoryless.
- Mechanism. List reactions, integer jumps, propensities, parameter units, and conserved quantities.
- Probability. Write an interior CME stencil and every special boundary equation.
- Analysis. Derive at least one moment, limiting law, conservation identity, or absorbing-state result.
- Code. Seed the direct method, log events, assert admissibility, and preserve the exact parameter file.
- Calibration. Reproduce the constant-addition, first-order-removal Poisson benchmark before running the new network.
- Estimation. Declare the sampling measure, initialization, estimator and uncertainty. Test ergodicity before interpreting one long path as a stationary ensemble.
- Evidence. Compare the representation with the actual observation: path with path, histogram with histogram, waiting time with waiting time.
- Failure. Name one pattern the model cannot create and the smallest additional state or process that could create it.
Final worked problem: Make the equal-mean promoter comparison reproducible.
Use time in minutes, and . Compare slow switching with fast switching . Both have on fraction 0.6 and mean RNA count 12. Equation (19) predicts Fano factors 7.666667 and 1.380952, respectively.
Implement the four propensities in equation (18). Start each path at promoter off and RNA zero. A 100-minute burn spans 20 slow promoter relaxation times; compare with a longer burn to test the initialization choice. Collect one endpoint from each of 5,000 independently seeded paths. Their mean-estimator standard errors are about 0.1356 and 0.0576 counts using the stationary variances. These are not the errors of 5,000 adjacent frames in one movie.
Save all transcription-event timestamps from separate long paths. Plot waiting-time survival with its observation censoring, not just a fitted exponential. Compare the RNA-only mean-hazard reduction with the full model for mean, zero fraction, Fano factor and temporal correlations. It preserves the stationary mean for these parameters; it predicts Poisson Fano 1 and misses finite switching memory.
For a second project, compare the two addition-coupling networks of Section 26 using their declared channels and the same observation protocol. LNA predicts different covariances despite identical deterministic drift. Compare with SSA and report any discrepancy from the local approximation; do not force the simulated mean to equal the deterministic fixed point.
These controls evaluate the equations above; they are not stochastic simulations. Change one scale while holding the stated comparison fixed.
Packet size and observation
Each calculation uses independent Poisson packet arrivals. Only the stationary calculation includes individual molecular removal.
How long did you average?
Poisson mean 20; individual removal 0.2/min. An independent snapshot still has standard deviation 4.472 counts, whatever the movie length.
| method | object approximated | first warning to test |
|---|---|---|
| direct SSA | none within the specified CME | missing spatial, cell-cycle or history state |
| tau-leaping | many firing counts over a short leap | negative counts or changing hazards within the leap |
| LNA | local fluctuations around one macroscopic trajectory | boundaries, skew, weak restoration or basin switching |
| rate equation | macroscopic concentration trajectory | event timing, tails and finite-count covariance |
Fast-state reduction adds a separate question: what survives elimination? Fast unregulated promoter switching can leave a mean addition hazard. Short-lived RNA can leave a random protein packet. Fast binding under feedback can require conditional averages at fixed totals.10 These are different reduced objects. The next lecture develops how to select them systematically.
A reader can regenerate the model from your reaction table, reproduce the stochastic path from the seed, verify it against an analytic limit, and understand which observation would force a richer state. A beautiful trajectory without those links is an illustration, not evidence.
Build a reproducible model packet that names its state, units, observable, calibration and a result that would falsify it.
†References
- D. T. Gillespie, “Stochastic Simulation of Chemical Kinetics,” Annual Review of Physical Chemistry 58, 35–55 (2007). DOI
- D. T. Gillespie, A. Hellander, and L. R. Petzold, “Perspective: Stochastic algorithms for chemical kinetics,” Journal of Chemical Physics 138, 170901 (2013). full text
- T. G. Kurtz, “The Relationship between Stochastic and Deterministic Models for Chemical Reactions,” Journal of Chemical Physics 57, 2976–2978 (1972). DOI
- M. Thattai and A. van Oudenaarden, “Intrinsic noise in gene regulatory networks,” PNAS 98, 8614–8619 (2001). full text
- M. B. Elowitz, A. J. Levine, E. D. Siggia, and P. S. Swain, “Stochastic Gene Expression in a Single Cell,” Science 297, 1183–1186 (2002). DOI
- P. S. Swain, M. B. Elowitz, and E. D. Siggia, “Intrinsic and extrinsic contributions to stochasticity in gene expression,” PNAS 99, 12795–12800 (2002). full text
- A. Raj et al., “Stochastic mRNA Synthesis in Mammalian Cells,” PLoS Biology 4, e309 (2006). DOI
- V. Shahrezaei and P. S. Swain, “Analytical distributions for stochastic gene expression,” PNAS 105, 17256–17261 (2008). full text
- S. Braichenko, J. Holehouse, and R. Grima, “Distinguishing between models of mammalian gene expression: telegraph-like models versus mechanistic models,” Journal of the Royal Society Interface 18, 20210510 (2021). full text
- J. Holehouse and R. Grima, “Revisiting the Reduction of Stochastic Models of Genetic Feedback Loops with Fast Promoter Switching,” Biophysical Journal 117, 1311–1330 (2019). DOI
- Lecture 5 numerical and figure ledger, seeds 20260902 and 20260915.The checked generator produces the conversions, simulations, exact statistics, and plotted coordinates used here.
- R. Erban, S. J. Chapman, and P. K. Maini, “A practical guide to stochastic simulations of reaction-diffusion processes” (2007), arXiv:0704.1908. full textExample-led CME and SSA derivations; section 2.2 makes the sampling times explicit.
- L. Cai, N. Friedman and X. S. Xie, “Stochastic protein expression in individual cells at the single molecule level,” Nature 440, 358–362 (2006). DOIThe measured protein packet is inferred from calibrated enzyme activity.
- J. Paulsson, “Models of stochastic gene expression,” Physics of Life Reviews 2, 157–175 (2005). DOI§§3–5 develop lifetime averaging, covariance equations and subsystem-relative noise.
- N. Friedman, L. Cai and X. S. Xie, “Linking Stochastic Dynamics to Population Distribution: An Analytical Framework of Gene Expression,” Physical Review Letters 97, 168302 (2006). open full textContinuous burst model; p. 2 explicitly distinguishes its Fano factor from the discrete result.
- J. Paulsson, “Summing up the noise in gene networks,” Nature 427, 415–418 (2004). DOI
- I. Lestas, G. Vinnicombe and J. Paulsson, “Fundamental limits on the suppression of molecular fluctuations,” Nature 467, 174–178 (2010). full textEquation 2 and Box 1; signalling architecture and controlled-species approximation matter.
- F. Xiao, M. Fang, J. Yan and J. C. Doyle, “Coupled Reaction Networks for Noise Suppression,” American Control Conference, 1547–1554 (2019). repository record§III-A supplies the independent-versus-coupled addition comparison; parameters and balances here are declared anew.
- M. Vellela and H. Qian, “Stochastic dynamics and non-equilibrium thermodynamics of a bistable chemical system: the Schlögl model revisited,” Journal of the Royal Society Interface 6, 925–940 (2009). DOIStationary probability and stochastic transitions beyond local deterministic stability.
- I. Golding, J. Paulsson, S. M. Zawilski and E. C. Cox, “Real-Time Kinetics of Gene Activity in Individual Bacteria,” Cell 123, 1025–1036 (2005). DOI
- R. Zhang et al., “Topology-dependent interference of synthetic gene circuit function by growth feedback,” Nature Chemical Biology 16, 695–701 (2020). full author manuscript
- J. Zhu, P. Chu and X. Fu, “Unbalanced response to growth variations reshapes the cell fate decision landscape,” Nature Chemical Biology 19, 1097–1104 (2023). DOI; open preprintPublished pp. 1099–1100 and Figures 1–3: equal-growth-rate comparison, unequal expression responses and the measured versus predicted bifurcation ranges.
- L. Potvin-Trottier, N. D. Lord, G. Vinnicombe and J. Paulsson, “Synchronous long-term oscillations in a synthetic gene circuit,” Nature 538, 514–517 (2016). DOIThe companion lineage distinguishes observation improvements from circuit redesign.
- Y. Taniguchi et al., “Quantifying E. coli proteome and transcriptome with single-molecule sensitivity in single cells,” Science 329, 533–538 (2010). full text
- C. Furusawa et al., “Ubiquity of log-normal distributions in intra-cellular reaction dynamics,” Biophysics 1, 25–31 (2005). full text
- B. L. Sabatini, T. G. Oertner and K. Svoboda, “The Life Cycle of Ca2+ Ions in Dendritic Spines,” Neuron 33, 439–452 (2002). DOIPrinted pp. 441–443 and 446–448. Clearance, indicator-dependent equilibration and the inferred native exchange time.