In simple terms
A friendly intro before the formal notes — no formulas yet.
The Probability Vending Machine
A Probability Generating Function (PGF) is a special function that encodes all the probabilities of a discrete random variable into a single polynomial. By manipulating this function, we can easily extract key information like probabilities, the mean, and the variance without needing the full probability distribution.
Imagine a vending machine for statistics. Instead of snacks, it dispenses information about a random variable. The PGF is this machine. You don't press a button for a specific probability. Instead, you perform mathematical operations: looking at the coefficient of gives you , differentiating and setting gives you the mean, and a different formula involving derivatives gives you the variance. It's a compact, powerful tool that holds all the key information in one place.
- 1
Define the PGF for a discrete random variable as .
- 2
Extract probabilities by finding the coefficient of in the expansion of , or by using the formula .
- 3
Calculate the mean and variance using derivatives evaluated at : and .
- 4
For a sum of independent variables, , find the PGF of the sum by multiplying the individual PGFs: .
Explore the concept
Use the live diagram and synced steps — play it or tap a step card to walk through.
Key formulas
Tap any symbol to reveal exactly what it means and its units.
Tap a symbol — great for exam definitions
Tap a symbol — great for exam definitions
Tap a symbol — great for exam definitions
Tap a symbol — great for exam definitions
Full topic notes
Formal explanation with the rigour you need for the exam.
Defining the Probability Generating Function
For a discrete random variable that takes non-negative integer values , its Probability Generating Function, denoted , is defined as a power series where the coefficients are the probabilities. The variable is a 'dummy' variable whose exponent 'carries' the value of the random variable.
The PGF is defined for discrete random variables taking values in .
The coefficient of in the expansion of is precisely .
Substituting into the PGF gives , which is a useful check.
Finding Probabilities, Mean and Variance from a PGF
The PGF is not just a fancy way to write down probabilities; its true utility comes from the properties we can extract using calculus. By differentiating the PGF and evaluating at specific values of , we can find probabilities, the mean, and the variance.
E(X) = G_X'(1)
Var(X) = G_X''(1) + G_X'(1) - [G_X'(1)]^2
Probabilities: The coefficient of is . Alternatively, , where is the -th derivative of evaluated at . For , this gives , , and .
Mean (Expected Value): The mean is found by differentiating once and evaluating at .
Variance: The variance requires the first and second derivatives, both evaluated at .
Remember the key difference: derivatives at give you probabilities, while derivatives at give you moments (mean and variance). A very common mistake is to mix these up. Always double-check which value of you should be substituting.
Sums of Independent Random Variables
One of the most significant advantages of PGFs is in dealing with the sum of independent random variables. If we want to find the distribution of , where and are independent, finding the PGF of is remarkably simple.
If and are independent discrete random variables, and , then the PGF of is the product of the PGFs of and :
This property is extremely useful. By finding the PGF of the sum, we can often identify the resulting distribution if it matches a standard PGF. This avoids the more complex process of convolution.
Worked examples
See the formulas applied — reveal one step at a time, like the exam.
A discrete random variable has the probability distribution given by , , and . Find the probability generating function of .
- 1
By definition, . We sum over the possible values of : 1, 2, and 3. Substituting the given probabilities: This is the PGF for the random variable . As a check, note that .
The number of defects in a length of cloth is a random variable with PGF given by . Find: (i) The probability of there being exactly 2 defects. (ii) The mean number of defects. (iii) The variance of the number of defects.
- 1
(i) To find , we need the coefficient of in the expansion of . This is a binomial expansion. The term in is given by . Coefficient = . So, .
Let and be two independent random variables. Let . Use probability generating functions to find the distribution of .
- 1
First, we recall the PGF for a Poisson distribution. If , its PGF is .
How it all connects
The big idea sits in the middle — tap a linked idea to explore the link.
Tap a linked idea to see how it connects back to the main topic — that connection is what examiners reward.
Glossary
Try to recall each definition before you reveal it.
Quick check
Answer in your head first — then tap to check. No pressure.
Revision flashcards
Flip the card. Test yourself before the exam.
What is the definition of the Probability Generating Function (PGF) for a discrete random variable ?
. It's a power series in a dummy variable , where the coefficient of is the probability .
Key takeaways
Review these before you close the topic — retrieval beats re-reading.
- ✓
The PGF is defined for discrete random variables taking values in .
- ✓
The coefficient of in the expansion of is precisely .
- ✓
Substituting into the PGF gives , which is a useful check.
Practice — then mark it
The whole point: a real Cambridge question, marked mark-by-mark.
Practice Questions
Practice Questions
Extra simulations & links
PhET, GeoGebra and other curated tools — open in a new tab.
Frequently asked
Checkpoint
One marked question is worth ten re-reads — close the loop before you move on.
Reading it isn’t knowing it — prove it.
Before you move on: do Practice Questions on paper, snap a photo, and get examiner-style feedback on exactly where you win and lose marks.