As we discussed last week, the forecasting process is often contaminated by individuals whose input makes the forecast worse. Sometimes this is intentional. For example, if I'm tired of hearing customers complain about out-of-stocks on retail shelves, I'll try to drive up the forecast so that more inventory will be
I was inspired by Chris Hemedinger's blog posts about his daughter's science fair project. Explaining statistics to a pre-teenager can be a humbling experience. My 11-year-old son likes science. He recently set about trying to measure which of three projectile launchers is the most accurate. I think he wanted to
I’m sure you will all agree that a programmer’s favorite task is to maximize efficiency thus enhancing performance. Dear reader, in this blog post I’ll share my best programming practices so that you can benefit from what I typically show my students in class. At the end I’d like to
I don't know much about the SQL procedure, but I know that it is powerful. According to the SAS documentation for the SQL procedure, "PROC SQL can perform some of the operations that are provided by the DATA step and the PRINT, SORT, and SUMMARY procedures." Recently, a fellow blogger,
Pete Lund has been an active leader with SAS Global Forum for many, many years. This year he is the Section Chair for the brand new Social Media & Networking Section (being a Social Media Specialist, I personally cannot wait for this track). Pete provided us with some feedback about
If you are a statistical programmer, sooner or later you have to compute a confidence interval. In the SAS/IML language, some beginning programmers struggle with forming a confidence interval. I don't mean that they struggle with the statistics (they know how to compute the relevant quantities), I mean that they
A recurring theme of The Business Forecasting Deal (both this blog and the book) is that forecasting is a huge waste of management time. This doesn't mean that forecasting is pointless, irrelevant, or entirely useless in running our organizations. It only means that the amount of time, money, and human
The Flowing Data blog posted some data about how much TV actors get paid per episode. About a dozen folks have created various visualizations of the data (see the comments in the Flowing Data blog), several of them very glitzy and fancy. One variable in the data is a categorical
I've known several people who were raised during the Great Depression, and I've observed that they are very mindful of waste. My wife's grandmother used to save plastic bags, twist ties, and relatively clean aluminum foil for potential reuse in the household -- because such materials were once scarce. The
Suppose that you want to create a matrix in SAS/IML software that has a special structure, such as a tridiagonal matrix. How do you do it? Or suppose that you want to find elements of a matrix A such that A[i,j] satisfies a certain condition. How do you get the
Brian Whittington mentioned last month that government is innovating, and at great speed. Based on what I’ve seen in our line of work with state and local governments around the country in the past year, I have to agree. In the face of today’s daunting fiscal challenges, state and local
If you tell my wife that she's married to a statistical geek, she'll nod knowingly. She is used to hearing sweet words of affection such as You are more beautiful than Euler's identity. or My love for you is like the exponential function: increasing, unbounded, and transcendental. But those are
The Winter 2011 issue of Foresight is now available. Here is Editor Len Tashman's preview: This issue of Foresight—our 20th since the journal’s genesis in 2005—begins with a new feature, Joe and Simon Sez. Joe is Joe Smith of Dean Foods and author of three valuable Foresight articles on forecast
In a previous blog post, I described the rules for a tic-tac-toe scratch-off lottery game and showed that it is a bad idea to generate the game tickets by using a scheme that uses equal probabilities. Instead, cells that yield large cash awards must be assigned a small probability of
Because of this week's story about a geostatistician, Mohan Srivastava, who figured out how predict winning tickets in a scratch-off lottery, I've been thinking about scratch-off games. He discovered how to predict winners when he began to "wonder how they make these [games]." Each ticket has a set of "lucky
We're just under two months away from SAS Global Forum 2011, and I'm feeling pretty good. Oops, I shouldn't have said that. That's going to come back to bite me, I'll bet. But I've already checked off so much on my to-do list! First, I got myself invited to attend.
I enjoyed the Dataists' data-driven blog on the best numbers to choose in a Super Bowl betting pool. It reminded me of my recent investigation of which initials are most common. Because the Dataists' blog featured an R function that converts Arabic numerals into Roman numerals, the blog post also
The other day, someone asked me how to compute a matrix of pairwise differences for a vector of values. The person asking the question was using SQL to do the computation for 2,000 data points, and it was taking many hours to compute the pairwise differences. He asked if SAS/IML
I'm not supposed to be working on this blog post right now. I've stayed late at the office under the pretense of working on "the book." It's the book about creating custom tasks for SAS Enterprise Guide, and I've been working on it for quite a while. I enjoy writing
On Friday, I posted an article about using spatial statistics to detect whether a pattern of points is truly random. That day, one of my colleagues asked me whether there are any practical applications of detecting spatial randomness or non-randomness. "Oh, sure," I replied, and rattled off a list of
When you pass a matrix as an parameter (argument) to a SAS/IML module, the SAS/IML language does not create a copy of the matrix. That approach, known as "calling by value," is inefficient. It is well-known that languages that implement call-by-value semantics suffer performance penalties. In the SAS/IML language, matrices
Millions of Americans will be gathering around the television this Sunday to watch Super Bowl XLV. They'll gather in bars and private homes, prepare billions of calories worth of snacks, and root for their favorite teams. But if you're looking for an alternate form of entertainment, why not watch "New
Last week I generated two kinds of random point patterns: one from the uniform distribution on a two-dimensional rectangle, the other by jittering a regular grid by a small amount. My show choir director liked the second method (jittering) better because of the way it looks on stage: there are
One of my New Year's resolutions is to learn a new area of statistics. I'm off to a good start, because I recently investigated an issue which started me thinking about spatial statistics—a branch of statistics that I have never formally studied. During the investigation, I asked myself: Given an
Last week I presented a SAS Talks session for SAS programmers using SAS Enterprise Guide 4.3. It was well attended, which pleased me. You never know how it's going to go with a webinar. People register and sign in, but they are at their desks in their offices/cubicles/homes where distractions
SAS Global Forum, with its long standing history, continues to be the hub and melting pot of brain-stimulating concoctions and eureka moments for SAS users across the globe! This year the magic continues in Las Vegas, at Caesars Palace from April 4 – 7. This series, Snapshot of the Best
I've never met Sy Truong face-to-face. (That will be one of the top items on my SAS Global Forum 2011 to-dos.) I’ve talked with him on Twitter and enjoyed his blog so much that I listed it in an edition of the SAS Tech Report. I’ve even talked with him
As Cat Truxillo points out in her recent blog post, some SAS procedures require data to be in a "long" (as opposed to "wide") format. Cat uses a DATA step to convert the data from wide to long format. Although there is nothing wrong with this approach, I prefer to
I sing in the SAS-sponsored VocalMotion show choir. It's like an adult version of Glee, except we have more pregnancies and fewer slushie attacks. For many musical numbers, the choreographer arranges the 20 performers on stage in an orderly manner, such as four rows of five singers. But every once
I have recently had the great opportunity to be a part of a very special project called the North Carolina Bio-Preparedness Collaborative (NCB-Prepared) It is a public-private partnership that includes the University of North Carolina at Chapel Hill (UNC), North Carolina State University, and SAS, with support from the US
