The DO Loop

Analytics

Find out how analytics, from data mining to cognitive computing, is changing the way we do business

Rick WicklinMay 4, 2020 0

SAS programmers sometimes ask about ways to perform one-dimensional linear interpolation in SAS. This article shows three ways to perform linear interpolation in SAS: PROC IML (in SAS/IML software), PROC EXPAND (in SAS/ETS software), and PROC TRANSREG (in SAS/STAT software). Of these, PROC IML Is the simplest to use and

English

Analytics

Rick WicklinApril 29, 2020 1

How many imputations are enough?

Recently I read an excellent blog post by Paul von Hippel entitled "How many imputations do you need?". It is based on a paper (von Hippel, 2018), which provides more details. Suppose you are faced with data that has many missing values. One way to address the missing values is

English

Analytics | Programming Tips

Rick WicklinApril 27, 2020 2

The circular law for eigenvalues

I've previously written about how to generate points that are uniformly distributed in the unit disk. A seemingly unrelated topic is the distribution of eigenvalues (in the complex plane) of various kinds of random matrices. However, I recently learned that these topics are somewhat related! A mathematical result called the

English

Analytics | Data Visualization

Rick WicklinApril 22, 2020 1

Visualize the case fatality rate for COVID-19 in US counties

A previous article describes the funnel plot (Spiegelhalter, 2005), which can identify samples that have rates or proportions that are much different than expected. The funnel plot is a scatter plot that plots the sample proportion of some quantity against the size of the sample. The variance of the sample

English

Analytics | Data Visualization

Rick WicklinApril 20, 2020 5

Use a funnel plot to visualize rates: The case fatality rate for COVID-19 in North Carolina counties

Death is always a difficult topic to discuss, and death has been in the news a lot during this tragic coronavirus pandemic. Many news stories focus on states, counties, or cities that have the most cases or the most deaths. A related statistic is the case fatality rate, which is

English

Analytics | Data Visualization

Rick WicklinApril 1, 2020 6

Estimates of doubling time for exponential growth

During an epidemic, such as the coronavirus pandemic of 2020, the media often shows graphs of the cumulative numbers of confirmed cases for different countries. Often these graphs use a logarithmic scale for the vertical axis. In these graphs, a straight line indicates that new cases are increasing at an

English

Analytics | Programming Tips

Rick WicklinMarch 16, 2020 2

Predict a random integer: The tradeoff between bias and variance

Books about statistics and machine learning often discuss the tradeoff between bias and variance for an estimator. These discussions are often motivated by a sophisticated predictive model such as a regression or a decision tree. But the basic idea can be seen in much simpler situations. This article presents a

English

Analytics

Rick WicklinMarch 11, 2020 7

Polygons, pi, and linear approximations

Recently, I saw a graphic on Twitter by @neilrkaye that showed the rapid convergence of a regular polygon to a circle as you increase the number of sides for the polygon. The author remarked that polygons that have 40 or more sides "all look like circles to me." That is,

English

Analytics | Data Visualization

Rick WicklinFebruary 26, 2020 0

The binormal model for ROC curves

The ROC curve is a graphical method that summarizes how well a binary classifier can discriminate between two populations, often called the "negative" population (individuals who do not have a disease or characteristic) and the "positive" population (individuals who do have it). As shown in a previous article, there is

English

Analytics | Data Visualization

Rick WicklinFebruary 17, 2020 2

Visualize collinearity diagnostics

A previous article shows how to interpret the collinearity diagnostics that are produced by PROC REG in SAS. The process involves scanning down numbers in a table in order to find extreme values. This can be a tedious and error-prone process. Friendly and Kwan (2009) compare this task to a

English

Blogs

Blogs

Analytics