theory, discrete-time Markov chain, continuous-time Markov chain, and martingale in turn And Brownian
motion and other Markov processes.
After completing this course, students should understand and master the basic concepts and conclusions
of stochastic processes; master the definition and nature of conditional expectations, master several equivalent
definitions of Poisson processes, master the update process and limit theorem, and be able to make judgments
proficiently Each type of discrete-time Markov chain can analyse the homogeneity and Markov property of
continuous-time Markov chain according to actual problems, grasp the definition of martingale and stopping
time and the convergence theorem, and grasp the definition and simple properties of Brownian motion ,
Understand the definitions and related concepts of other Markov processes.
(如面向本科生开放,请注明区分内容。 If the course is open to undergraduates, please indicate the
difference.)
理论课程,课堂讲授为主
Theoretical courses, mainly in teaching
教学内容
Course Contents
(如面向本科生开放,请注明区分内容。 If the course is open to undergraduates, please indicate the
difference.)
准备知识:概率、随机变量举例、数学期望、特征函数和概率极限定
理、随机过程
Introduction: probability, examples of random variables, mathematical
expectations, characteristic functions and probability limit theorems, random
processes
Poisson 过程:计数过程和泊松过程、泊松流、复合泊松过程、条件泊松
过程
Poisson process: counting process and Poisson process, Poisson flow,
compound Poisson process, conditional Poisson process
更新理论:N(t)的分布、极限定理、更新定理及其应用、延迟更新过
程、更新报酬过程、再现过程、平稳点过程
Renewal theory: distribution of N(t), limit theorem, renewal theorem and its
application, delayed renewal process, renewal reward process, recurrence
process, stable point process
离散时间 Markov 链:马氏链及其转移概率、Chapman-Kolmogorov 方
程、K-C 方程、极限定理、类之间的转移和赌徒破产问题、分支过程、
Markov 链的应用、时间可逆的 Markov 链、半 Markov 过程
Discrete-time Markov chain: Markov chain and its transition probability,
Chapman-Kolmogorov equation, KC equation, limit theorem, transfer between
classes and gambler bankruptcy problems, branching process, Markov chain
application, time reversible Markov chain, semi-Markov process
连续时间 Markov 链:连续时间马氏链、泊松过程是马氏链、生灭过
程、Kolmogorov 微分方程、极限概率、时间可逆性、倒向链 排队论的
应用、一致化
Continuous-time Markov chain: continuous-time Markov chain, Poisson
process is Markov chain, birth and death process, Kolmogorov differential
equation, limit probability, time reversibility, reverse chain Application of
queuing theory, unification