Probability is a mathematical framework for representing uncertainty about events, outcomes or quantities. It assigns numerical values between zero and one to events under a specified probability model, with zero representing an impossible event under the model and one representing an event that is certain under the model. Probability is fundamental to statistics because statistical inference concerns uncertainty about populations, parameters, observations and hypotheses. The meaning of a probability depends on the framework being used and the event or model to which the probability refers.
Basic probability uses concepts such as sample spaces, events, outcomes, complements, unions and intersections. The probability of an event is determined by the structure of the specified model. For mutually exclusive events the probability of their union is the sum of their individual probabilities. The complement of an event has probability equal to one minus the probability of the event. Conditional probability describes the probability of one event given that another event has occurred. These concepts provide the foundation for more complex probability calculations and statistical models.
Independence is an important probability concept. Two events are independent when information about the occurrence of one does not change the probability assigned to the other within the specified model. Independence is different from mutual exclusivity because mutually exclusive events with positive probability cannot be independent. Conditional probability can be expressed through the relationship between joint and conditional probabilities, and Bayes theorem provides a formal method for updating probabilities when new evidence is observed. Bayesian reasoning is widely used in statistics, diagnostics, scientific inference and decision analysis.
Probability can be interpreted in several ways. A frequentist interpretation associates probability with long run relative frequency under repeated comparable conditions, while a Bayesian interpretation can treat probability as a degree of uncertainty about a proposition or parameter given available information. These interpretations lead to different conceptual understandings of statistical quantities even when they use related mathematical machinery. Probability models can also be used objectively as descriptions of random mechanisms without requiring a single philosophical interpretation. The distinction matters because statements about probability must be understood in relation to the model and inferential framework being used.
Probability distributions describe how probability is allocated across possible values of a random variable. Discrete distributions assign probabilities to countable outcomes, while continuous distributions use probability density functions and assign probability to intervals rather than individual points. Important distributions include the binomial, Poisson and normal distributions, although many other distributions are used for specialised applications. Parameters of a distribution determine characteristics such as location, spread and shape. Choosing an appropriate distribution requires understanding the data generating process and the assumptions of the statistical model.
Probability is used to quantify uncertainty in statistical estimation and hypothesis testing. Confidence intervals, prediction intervals, likelihood methods and many hypothesis tests rely on probability models. In a frequentist framework a confidence interval does not mean that a particular fixed parameter has a specified probability of lying inside the calculated interval in the ordinary interpretation. Instead the method is designed to achieve a specified long run coverage probability under its assumptions. In Bayesian analysis, posterior probabilities can directly represent uncertainty about parameters conditional on the model and prior information. These distinctions are important when interpreting statistical statements.
Probability is also used in practical fields including medicine, insurance, engineering, finance, genetics, computing, meteorology and risk analysis. Diagnostic testing illustrates conditional probability because the probability that a person has a condition given a positive test is not generally identical to the probability that the test is positive given the condition. Base rates, sensitivity, specificity and prevalence all influence interpretation. Similar principles apply to many real world situations where people incorrectly confuse the probability of evidence given a hypothesis with the probability of the hypothesis given the evidence.
Probability models have limitations because they depend on assumptions about possible outcomes, independence, distributions, parameters and data generating processes. A mathematically correct calculation can still be inappropriate if the underlying model does not represent the situation adequately. Probability does not eliminate uncertainty or guarantee that a particular event will occur simply because it has a high probability. It provides a formal framework for reasoning under uncertainty. Good probabilistic analysis therefore requires clear definitions, appropriate assumptions, relevant data and careful interpretation of what the calculated probability actually describes.
