Lecture Notes for IEOR 4106
Classes
- Tuesday, January 20: Problems from Chapter 1.
Probability Review. Chapter 1. First topic: Conditional Probability.
- Thursday, January 22: A large number of coin tosses.
More Probability Review. Section 2.7. The central limit theorem.
- Tuesday, January 27: Grundlagen (Foundations).
Even More Probability Review: Chapters 2 & 3: Random variables.
- Thursday, January 29: Our friends.
Final Probability Review. Section 2.6: Moment generating functions and other transforms.
- Tuesday, February 3: Markov Mouse.
Chapter 4. Introduction to Markov chains.
- Thursday, February 5: more Markov chains.,
Still Chapter 4.
- Tuesday, February 10: even more Markov chains.
A Markov chain example in finance.
- Thursday, February 12: reversibility.
Section 4.8.
- Tuesday, February 17: Review of 2007 first midterm exam.
Chapter 4: End of discrete-time Markov chains.
- Thursday, February 19: FIRST MIDTERM EXAM This covers Chapters 1-4. Open book.
- Tuesday, February 24: The Magic Distribution.
Chapter 5. The exponential Distribution. A concise summary
of basic properties of the exponential distribution and the Poisson process.
- Thursday, February 26: Gone Fishing.
Chapter 5. Introduction to the Poisson process. Solutions.
- Tuesday, March 3: Pooh and the broken copiers. Introduction to continuous-time Markov chains.
Chapter 6. Extra Lecture Notes on CTMCs.
- Thursday, March 5: The DJ Barbershop. Birth-and-death processes, special CTMC's.
- Tuesday, March 10: Staffing a service system.
Nonhomogeneous Poisson process, staffing and the infinite-server queue, Chapter 5.
-
The Physics of The Mt/G/infty Queue,
by Steven G. Eick, William A. Massey and Ward Whitt, Operations Research, vol. 41, No. 4, 1993, pp. 731-742.
See Figure 1. Look at Section 1 up to Remark 1 (about one full journal page).
-
Server Staffing to Meet Time-Varying Demand,
by Otis B. Jennings, Avishai Mandelbaum, William A. Massey and Ward Whitt, Management Science, vol. 42, No. 10, 1996, pp. 1383-1394.
(Optional: an application of the Mt/G/infty queue to staffing)
- Thursday, March 12: the infinite-server queue
- MARCH 16-20: SPRING BREAK
- Tuesday, March 24: reversibility and networks of queues
- Thursday, March 26: review of the 2007 midterm
- Tuesday, March 31: review of the 2005 midterm
- Thursday, April 2: SECOND MIDTERM EXAM This covers Chapters 5-6. Open book.
- Tuesday, April 7: The DMV.
Problem 2 on the exam.
- Thursday, April 9: Life as a traffic cop.
Chapter 7. renewal theory.
- Tuesday, April 14: Driving back and forth.
Chapter 7. more renewal theory.
- Thursday, April 16: The inspection paradox.
Chapter 7. renewal theory ad nauseam.
- Tuesday, April 21: Patterns.
Chapter 7. renewal theory ad absurdam.
- Thursday, April 23: BM basics.
Chapter 10. Introduction to Brownian motion and martingales.
- Tuesday, April 28: BM, Gambler's Ruin and Martingales
Chapter 10. more BM and MGs. Supplementary notes on MGs.
- Thursday, April 30:
Staggering to the finish line: Chapter 10. even more BM and MGs.