About this blog
Rick Wicklin, PhD, is a senior researcher in computational statistics at SAS and is a principal developer of PROC IML and SAS/IML Studio. His areas of expertise include computational statistics, statistical graphics, and modern methods in statistical data analysis. Rick is author of the book Statistical Programming with SAS/IML Software.
Follow @RickWicklin on Twitter.
Vectorized computations and the birthday matching problem
The birthday matching problem is a classic problem in probability theory. The part of it that people tend to remember is that in a room of 23 people, there is greater than 50% chance that two people in the room share a birthday. But the birthday matching problem is also [...]
Post a Comment Defining banded and triangular matrices: Another approach
Sometimes in matrix computations you need to obtain the values of certain submatrices such as the diagonal elements or the super- or subdiagonal elements. About a year ago, I showed one way to do that: convert subscripts to indices and vice-versa. However, a tip from @RLangTip on Twitter got me [...]
Post a Comment How to compute Mahalanobis distance in SAS
I recently blogged about Mahalanobis distance and what it means geometrically. I also previously showed how Mahalanobis distance can be used to compute outliers in multivariate data. But how do you compute Mahalanobis distance in SAS? Computing Mahalanobis distance with built-in SAS procedures and functions There are several ways to [...]
Post a Comment Avoid unnecessary IF-THEN statements in loops
Way back when I learned to program, I remember a computer instructor explaining that an IF-THEN statement can be a relatively slow operation. He said “If a multiplication takes one unit of time, an IF statement requires about 70 units.” I don’t know where his numbers came from, or even [...]
Post a Comment Evaluate polynomials efficiently by using Horner's scheme
Polynomials are used often in data analysis. Low-order polynomials are used in regression to model the relationship between variables. Polynomials are used in numerical analysis for numerical integration and Taylor series approximations. It is therefore important to be able to evaluate polynomials in an efficient manner. My favorite evaluation technique [...]
Post a Comment Multithreaded = more productive
When I write SAS/IML programs, I usually do my development in the SAS/IML Studio environment. Why? There are many reasons, but the one that I will discuss today is the fact that the application is multithreaded and supports multiple programming workspaces. The advantages of multiple programming workspaces I am always [...]
Post a Comment Solving linear systems: Which technique is fastest?
I’ve previously described ways to solve systems of linear equations, A*b = c. While discussing the relative merits of the solving a system for a particular right hand side versus solving for the inverse matrix, I made the assertion that it is faster to solve a particular system than it [...]
Post a Comment Complex assignment statements: CHOOSE wisely
This article describes the SAS/IML CHOOSE function: how it works, how it doesn’t work, and how to use it to make your SAS/IML programs more compact. In particular, the CHOOSE function has a potential “gotcha!” that you need to understand if you want your program to perform as expected. What [...]
Post a Comment Do you really need to compute that matrix inverse?
The SAS/IML language provides two functions for solving a nonsingular nxn linear system A*x = c: The INV function numerically computes the inverse matrix, A-1. You can use this to solve for x: Ainv = inv(A); x = Ainv*c;. The SOLVE function numerically computes the particular solution, x, for a [...]
Post a Comment Pre-allocate arrays to improve efficiency
Recently Charlie Huang showed how to use the SAS/IML language to compute an exponentially weighted moving average of some financial data. In the commentary to his analysis, he said: I found that if a matrix or a vector is declared with specified size before the computation step, the program’s efficiency [...]
Post a Comment