About this blog
Rick Wicklin, PhD, is a senior researcher in computational statistics at SAS and is a principal developer of PROC IML and SAS/IML Studio. His areas of expertise include computational statistics, statistical graphics, and modern methods in statistical data analysis. Rick is author of the book Statistical Programming with SAS/IML Software.
Follow @RickWicklin on Twitter.
The curious case of random eigenvalues
I’ve been a fan of statistical simulation and other kinds of computer experimentation for many years. For me, simulation is a good way to understand how the world of statistics works, and to formulate and test conjectures. Last week, while investigating the efficiency of the power method for finding dominant [...]
Post a Comment Generate a random matrix with specified eigenvalues
In a previous post I showed how to implement Stewart’s (1980) algorithm for generating random orthogonal matrices in SAS/IML software. By using the algorithm, it is easy to generate a random matrix that contains a specified set of eigenvalues. If D = diag(λ1, …, λp) is a diagonal matrix and [...]
Post a Comment Generating a random orthogonal matrix
Because I am writing a new book about simulating data in SAS, I have been doing a lot of reading and research about how to simulate various quantities. Random integers? Check! Random univariate samples? Check! Random multivariate samples? Check! Recently I’ve been researching how to generate random matrices. I’ve blogged [...]
Post a Comment The curse of dimensionality: How to define outliers in high-dimensional data?
After my post on detecting outliers in multivariate data in SAS by using the MCD method, Peter Flom commented “when there are a bunch of dimensions, every data point is an outlier” and remarked on the curse of dimensionality. What he meant is that most points in a high-dimensional cloud [...]
Post a Comment Creating symmetric matrices: Two useful functions with strange names
Covariance, correlation, and distance matrices are a few examples of symmetric matrices that are frequently encountered in statistics. When you create a symmetric matrix, you only need to specify the lower triangular portion of the matrix. The VECH and SQRVECH functions, which were introduced in SAS/IML 9.3, are two functions [...]
Post a Comment Use the Cholesky transformation to correlate and uncorrelate variables
A variance-covariance matrix expresses linear relationships between variables. Given the covariances between variables, did you know that you can write down an invertible linear transformation that “uncorrelates” the variables? Conversely, you can transform a set of uncorrelated variables into variables with given covariances. The transformation that works this magic is [...]
Post a Comment Random number seeds: Only the first seed matters!
The other day I encountered the following SAS DATA step for generating three normally distributed variables. Study it, and see if you can discover what is unnecessary (and misleading!) about this program: data points; drop i; do i=1 to 10; x=rannor(34343); y=rannor(12345); z=rannor(54321); output; end; run; The program creates the [...]
Post a Comment How to lie with a simulation
In my article on Buffon’s needle experiment, I showed a graph that converges fairly nicely and regularly to the value π, which is the value that the simulation is trying to estimate. This graph is, indeed, a typical graph, as you can verify by running the simulation yourself. However, notice [...]
Post a Comment Simulation of Buffon's needle in SAS
Buffon’s needle experiment for estimating π is a classical example of using an experiment (or a simulation) to estimate a probability. This example is presented in many books on statistical simulation and is famous enough that Brian Ripley in his book Stochastic Simulation states that the problem is “well known [...]
Post a Comment The great Christmas gift exchange revisited
One aspect of blogging that I enjoy is getting feedback from readers. Usually I get statistical or programming questions, but every so often I receive a comment from someone who stumbled across a blog post by way of an internet search. This morning I received the following delightful comment on [...]
Post a Comment