Way back when I learned to program, I remember a computer instructor explaining that an IF-THEN statement can be a relatively slow operation. He said "If a multiplication takes one unit of time, an IF statement requires about 70 units." I don't know where his numbers came from, or even
I have a love-hate relationship with spreadsheet data. I am interested in finding data to analyze, and if it arrives in the form of a spreadsheet, I'll take it. And I like to deliver results and reports, but often my constituents ask for it as a spreadsheet that they can
As SAS user Marje Fecht said "We all want a 'SAS programming assistant' to help us complete our jobs more quickly." Fecht, Senior Partner at Prowerk Consulting, then went on to say "In her book SAS Macro Programming Made Easy, Second Edition, Michele Burlew encourages us to take advantage of the SAS
The American Association of State Highway Transportation Officials recently released a top 10 list of transportation issues that will be “talked, written or tweeted and legislated about” in 2012. As expected, funding constraints and Congressional action on reauthorization appear on the list but the group also notes that natural disaster
Unlike prior versions of SAS OLAP technology, 9.2 provides more options for maintaining and refreshing OLAP cubes. With this comes some discussion about what each one does alone, and how pairing these techniques really provides SAS OLAP Server Administrators and cube developers a cornucopia of OLAP options. PROC OLAPOPERATE Remember
A variance-covariance matrix expresses linear relationships between variables. Given the covariances between variables, did you know that you can write down an invertible linear transformation that "uncorrelates" the variables? Conversely, you can transform a set of uncorrelated variables into variables with given covariances. The transformation that works this magic is
Some ideas sound great (combining chocolate with peanut butter) and turn out great (Reese's Peanut Butter Cup). Some ideas sound great (getting a face lift) but turn out bad (Kenny Rogers, Greta Van Susteren). Some ideas sound bad (a Run-DMC / Aerosmith duet) but turn out great ("Walk This Way"). Some ideas sound bad (letting
Have you ever wanted to run a sample program from the SAS documentation or wanted to use a data set that appears in the SAS documentation? You can: all programs and data sets in the documentation are distributed with SAS, you just have to know where to look! Sample data
Have you noticed the annoying stock art they put on The BFD blog header? All I can think of is "If those idiots only used SAS Forecast Server, they wouldn't have to draw graphs all over their window panes just to do forecasting." It must really p.o. the housekeeping staff at that
My colleague, Steve Serrao, just published a blog post on the proliferation of varied law enforcement approaches and their related phraseologies. After reading, I concur – hence, this blog’s title. I am not a huge fan of the term “predictive policing”. While others may love it and live it, and
We call it the "metadata profile", but really it's like a telephone number that connects you to your SAS environment. Just as a telephone number has component parts (country code, area code, exchange), the metadata profile contains information that allow you to "dial in" to your SAS servers. This information
In two previous blog posts I worked through examples in the survey article, "Robust statistics for outlier detection," by Peter Rousseeuw and Mia Hubert. Robust estimates of location in a univariate setting are well-known, with the median statistic being the classical example. Robust estimates of scale are less well-known, with
The other day I encountered the following SAS DATA step for generating three normally distributed variables. Study it, and see if you can discover what is unnecessary (and misleading!) about this program: data points; drop i; do i=1 to 10; x=rannor(34343); y=rannor(12345); z=rannor(54321); output; end; run; The program creates the
Recently, I had a discussion with a user concerning the volume of imagemap data generated for an interactive, web-based visual contain a large number of graphs. The large amount of imagemap data was causing problems with the current version of their web browser. The graphs consisted of either bar charts
Ten years ago I spent some time in women's undergarments*, as Director of Forecasting at Sara Lee Intimate Apparel (now Hanesbrands). Sure, it sounds glamorous -- product posters on our office walls, quarterly runway shows of new products, and partying with the full-figured Playtex models (some of whom were fuller than I figured).
So many of us struggle with this mountain. In fact, 68.27% of us get within sight of reaching the summit (while 95.47% of us are at least on a perceivable slope). We run, walk, crawl and sometimes slide our way uphill (from one direction or the other) until we finally
In a previous blog post on robust estimation of location, I worked through some of the examples in the survey article, "Robust statistics for outlier detection," by Peter Rousseeuw and Mia Hubert. I showed that SAS/IML software and PROC UNIVARIATE both support the robust estimators of location that are mentioned
We’ve just published Chris Olsen’s Teaching Elementary Statistics with JMP, which offers the latest research on best practices and how JMP can facilitate teaching statistics. To mark the book’s publication, we asked Chris to tell us the top three things every elementary statistics student should know. Statistics is about numbers
Love can make a person do bad, dangerous, stupid, and irresponsible things. Love of country can make a politician stray from his wife. Love of Pepsi can make a pop musician lose his hair in a pyrotechnics-gone-bad commercial. Love of acting can make academy award winners accept starring roles in Ishtar. And for
Note: as this is a popular topic, I've added a few notes with minor updates, including a link to a popular how-to tutorial video. In case you missed it, the first maintenance release for SAS 9.3 was recently released. Because we're all friends here, you may call it "SAS 9.3M1"
I was on vacation when a family member sidled up to me. "Rick, you're a statistician..." he began. I knew I was in trouble. He proceeded to tell me the story of Joseph "Newsboy" Moriarty, a New Jersey mobster who rose to prominence and became known as the bookie who
The single most costly employee benefit for any organization is health insurance, and the price is going up. From 2003-2009, the costs per hour worked for employee health insurance increased from $1.03 to $2.00. These costs continue to increase from 5%-7% per year. The reality is that employee health insurance costs will continue
Many cities and counties are taking the lead of private industry and developing 311 call centers to consolidate incoming calls for service and information requests from citizens. The business advantages are clear: Citizens have one number to call for service and information rather than having to waste time searching for
All too often an unspeakable tragedy leads to a needed policy or operational change through a newly-realized criminal justice system gap. While we continually work to minimize existing gaps, the reality is that as law enforcement evolves, so does the crime and so do the criminals. In recognition of those
Statistical programmers often need mathematical constants such as π (3.14159...) and e (2.71828...). Programmers of numerical algorithms often need to know machine-specific constants such as the machine precision constant (2.22E-16 on my Windows PC) or the largest representable double-precision value (1.798E308 on my Windows PC). Some computer languages build these
I encountered a wonderful survey article, "Robust statistics for outlier detection," by Peter Rousseeuw and Mia Hubert. Not only are the authors major contributors to the field of robust estimation, but the article is short and very readable. This blog post walks through the examples in the paper and shows
This morning I logged onto my e-mail at 6:45 AM to learn that SAS was ranked as the No. 3 Best Company to Work For. No. 3 is not as high as No. 1. But it's very, very close. Perhaps even barely distinguishable, in the larger scheme of things. I
An issue that SAS/GRAPH users have wrestled with in the past has been how to put tick marks at irregular intervals on their axes. In PROC GPLOT, if you specify irregular intervals using the ORDER option on the AXIS statement, the procedure’s axis kicks into a “discrete” mode, where the
The Winter 2012 issue of Foresight is now available. Here is Editor Len Tashman's preview: --------------------------- Our last two issues featured Steve Morlidge’s Guiding Principles for managing an organization’s forecasting process. You can see the summary table of these principles on page 31. With this issue, we continue their development
In my recent article on simulating Buffon's needle experiment, I computed the "running mean" of a series of values by using a single call to the CUSUM function in the SAS/IML language. For example, the following SAS/IML statements define a RunningMean function, generate 1,000 random normal values, and compute the
