"Between Certainty and Uncertainty" is a one-of-a-kind short course on statistics for students, engineers and researchers. It is a fascinating introduction to statistics and probability with notes on historical origins and 80 illustrative numerical examples organized in the five units: chapter 1 Descriptive Statistics: compressing small samples, basic averages - mean and variance, their main properties including God's proof; linear transformations and z-scored statistics; chapter 2 Grouped data: Udny Yule's concept of qualitative and quantitative variables, grouping these two kinds of data, graphical tools, combinatorial rules and qualitative variables, designing frequency histogram, direct and coded evaluation of quantitative data, and significance of percentiles. Chapter 3 Regression and correlation: geometrical distance and equivalent distances in two orthogonal directions as a prerequisite to the concept of two regression lines, misleading in interpreting two regression lines, derivation of the two regression lines, Was Hubble right? Houbolt's cloud, What in fact measures the correlation coefficient?; chapter 4 Binomial distribution: middle ages origins of the binomials; figurate numbers and combinatorial rules, Pascal's Arithmetical Triangle, Bernoulli's or Poisson Trials? John Arbuthnot curing binomials, how Newton taught S. Pepys probability, Jacob Bernoulli's Weak Law of Large Numbers and others; chapter 5 Normal distribution and binomial heritage: tables of the normal distribution, Abraham de Moivre and the second theorem of de Moivre-Laplace.