I often blog about the usefulness of vectorization in the SAS/IML language. A one-sentence summary of vectorization is "execute a small number of statements that each analyze a lot of data." In general, for matrix languages (SAS/IML, MATLAB, R, ...) vectorization is more efficient than the alternative, which is to
For Parent’s Weekend this year, I needed to choose a restaurant for dinner in my son’s college town. Our extended family was attending the college football game and spending the weekend with our son. Before making my decision, I searched the internet for all the restaurants located within a reasonable
♦We learned this week that SAS is ranked #4 on Fortune's 100 Best Companies to Work For in 2015. This makes six straight years ranking in the top four (including twice at #1). ♦The March/April 2015 issue of Analytics Magazine includes a SAS company profile by my colleague Kathy Lange. As
You may be intrigued to know how the average person compares to a gold medal winning Olympic athlete when it comes to things like height, body mass, resting heart rate, arm span, body fat etc. Or, perhaps more frightening, how you measure up? I know this will resonate with my
Public educators have increasingly been told to produce the “workforce of the future.” States are striving for alignment between what students learn and the jobs that ultimately will be available to them. This alignment is critical for students so they have the right skills and knowledge to excel at college
In my previous post, I showed how to approximate a cumulative density function (CDF) by evaluating only the probability density function. The technique uses the trapezoidal rule of integration to approximate the CDF from the PDF. For common probability distributions, you can use the CDF function in Base SAS to
Does your forecast look like a radio? No? Then don't treat it like one. A radio's tuning knob serves a valid purpose. It lets you make fine adjustments, improving reception of the incoming signal, resulting in a clearer and more enjoyable listening experience. But just because you can make fine adjustments to
When I saw Robert Kosoro's cool ZIPScribble map, I knew I had to create a SAS version - and of course I had to add a few enhancements along the way.... I was perusing some of the examples on dadaviz.com, and Kosoro's ZIPScribble map caught my attention. It wasn't a particularly useful
One of the common traps I see data quality analysts falling into is measuring data quality in a uniform way across the entire data landscape. For example, you may have a transactional dataset that has hundreds of records with missing values or badly entered formats. In contrast, you may have
You might be surprised at how many movies and TV shows are made in North Carolina - especially within the last few years. This blog provides a SAS graph that will make the list of films even easier to read! A recent story by the Tar Heel Traveler, and an exhibit
In The Princess Bride, one of my favorite movies, our hero Westley – in an attempt to save his love, Buttercup – has to navigate the Fire Swamp. There, Westley and Buttercup encounter fire spouts, quicksand and the dreaded rodents of unusual size (RUS's). Each time he has a response to the
Somebody once said that relationships are not easy. Well now they are—in SAS 9.4, at least! SAS objects have inherent relationships and dependencies, and a change to one element can often have an impact on one or many related objects. For example, for SAS Visual Analytics reports to work as
As a personal trainer, one of the top comments I hear from clients is that they want to “tone up.” Some even go as far to tell me which area of their body needs said toning. What they’re really saying is that they want more muscle and for that
Evaluating a cumulative distribution function (CDF) can be an expensive operation. Each time you evaluate the CDF for a continuous probability distribution, the software has to perform a numerical integration. (Recall that the CDF at a point x is the integral under the probability density function (PDF) where x is
Warranties have a long - and some might say - interesting past. But the future is even brighter. New technologies and data sources are transforming our understanding of field quality, enabling deeper insights into product performance and customer preferences. These breakthroughs are accelerating the quest to reduce defects and satisfy customers.
Many of us have schedules packed so tight we don’t have room to eat a meal sitting down much less read a novel or go for a long walk. With work, family, friends and other commitments, our days, weeks and months speed by us. It is easy to get caught
In my last post, I pointed out that an uninformed approach to running queries on top of data stored in Hadoop HDFS may lead to unexpected performance degradation for reporting and analysis. The key issue had to do with JOINs in which all the records in one data set needed
Financial institutions are mired with large pools of historic data across multiple line of businesses and systems. However, much of the recent data is being produced externally and is isolated from the decision making and operational banking processes. The limitations of existing banking systems combined with inward-looking and confined data practices
This year I am expecting SAS Global Forum to be one of the biggest and best ever! The SAS Global Users Group makes changes and enhancements each year at SAS Global Forum based on the feedback we receive from SAS users. And I am pleased to be the first to
Small data is akin to algebra; big data is like calculus.
Last week I received a message from SAS Technical Support saying that a customer's IML program was running slowly. Could I look at it to see whether it could be improved? What I discovered is a good reminder about the importance of vectorizing user-defined modules. The program in this blog
From the pressures of a highly competitive marketplace to changing economic conditions, to the evolution of the distribution network - the challenges facing the hospitality are many and varied. In this video, SAS asked a panel of experts to share their views on the issues that will challenge the hospitality
Does your week start on Sunday or Monday? Do you have a promotional product you would like to see at the top of your list? Do you have a particular order in which you like to view your regions? Custom sorting is now possible with SAS Visual Analytics 7.1. The
I recently wrote about how to overlay multiple curves on a single graph by reshaping wide data (with many variables) into long data (with a grouping variable). The implementation used PROC TRANSPOSE, which is a procedure in Base SAS. When you program in the SAS/IML language, you might encounter data
My Performance Validation team in SAS R&D is constantly working with our partners to test how their storage arrays work with SAS. In late 2014, we finalized several papers that discuss how a mixed analytics workload performs on several storage arrays. While doing this testing, we also listed lessons-learned in
In the movie Big, a 12-year-old boy, after being embarrassed in front of an older girl he was trying to impress by being told he was too short for a carnival ride, puts a coin into an antique arcade fortune teller machine called Zoltar Speaks, makes a wish to be big,
For years, saturated fat has been blamed for high cholesterol levels and heart attacks. This overemphasis on reducing fat intake led many people to start substituting high carbohydrate, high sugar, processed foods for fats - bye, bye eggs, hello fat-free cookies!
Data. To a statistician, data are the observed values. To a SAS programmer, analyzing data requires knowledge of the values and how the data are arranged in a data set. Sometimes the data are in a "wide form" in which there are many variables. However, to perform a certain analysis
Despite an increase in the availability of data in the federal government over the past few years, data and analytics could be doing even more for federal agencies. A strategic approach to managing and analyzing the data is needed. And, like many technology challenges – that’s a people problem. A
I’m not a seasoned business traveler so I generally plan to arrive extra early and leave a little late to avoid any last-minute stress. The problem with all that stress-avoidance is that I often have extra time on my hands and am stuck with finding ways to entertain myself. What
