This self-contained reference for statisticians and engineers in system and control theory, analyzes the effect of convergent recursive estimation algorithms and stochastic approximation on the dependent noise case and the classic independent case. It discusses control and adaptive control problems related to recursive estimation, and introduces the combined probabilistic and differential equation method of data analysis.