A colleague asked me an interesting question: I have a journal article that includes sample quantiles for a variable. Given a new data value, I want to approximate its quantile. I also want to simulate data from the distribution of the published data. Is that possible? This situation is common.
Today it is common knowledge that a classroom teacher is the single largest in-school influence on student academic growth[1]. So when South Carolina received ESEA flexibility in July, 2012, the State Department of Education immediately began an initiative empowering teachers to increase their own effectiveness. Known as the Educator Evaluation System
Recently, a user posed a question on how to plot stacked frequencies on a time axis. The data included frequencies of different viruses by week. The data is modified to preserve confidentiality and is shown below. The user's first instinct was to use a bar chart with stacked groups. This works for automatically computing frequencies
Principle 11: Risk management reports should be distributed to the relevant parties while ensuring confidentiality is maintained. Early in 2013, the Basel Committee on Banking Supervision (BCBS) issued guidelines for banks regarding risk data aggregation and reporting. Known collectively as BCBC 239, these principles were designed to ensure that banks
I've pointed out in the past that in the SAS/IML language matrices are passed to modules "by reference." This means that large matrices are not copied in and out of modules but are updated "in place." As a result, the SAS/IML language can be very efficient when it computes with
In 1965's Subterranean Homesick Blues, Bob Dylan taught us: You don't need a weatherman / To know which way the wind blows In 1972's You Don't Mess Around with Jim, Jim Croce taught us: You don't spit into the wind By combining these two teachings, one can logically conclude that:
Let’s be honest. When well planned, a SAS Grid Computing platform as the basis for a shared, highly available, high-performance analytics environment can pay for itself many times over. However, it is critical that your overall objectives and computing environment be well understood for you to achieve success with your
Today is my 500th blog post for The DO Loop. I decided to celebrate by doing what I always do: discuss a statistical problem and show how to solve it by writing a program in SAS. Two ways to parameterize the lognormal distribution I recently blogged about the relationship between
This probably won't surprise any of my regular readers: "SAS custom tasks" is one of my favorite topics to talk about. Since 2007, I've written blogs about how you can use custom tasks to extend SAS Enterprise Guide and the SAS Add-In for Microsoft Office. I've shared lots of examples,
Our tradition from Foresight’s birth in 2005 has been to feature a particular topic of interest and value to practicing forecasters. These feature sections have covered a wide range of areas: the politics of forecasting, how and when to judgmentally adjust statistical forecasts, forecasting support systems, why we should
In 1990, the North Carolina General Assembly created the Sentencing and Policy Advisory Commission to evaluate sentencing laws and policies and recommend any modifications necessary to achieve policy goals. As part of the mandate, the General Assembly required the Sentencing Commission to develop a correctional population simulation model. The model
From managing excess DVD inventory to optimizing digital distribution channels, Hollywood’s supply chain transformation in the last decade has been massive. Knowing this background, and having spent a good part of my life surrounded by the entertainment industry, I was intrigued and inspired by the recent Entertainment Supply Chain Academy
SAS software can be used for many things - here's how you could use it to help save endangered sea turtles! You've seen SAS used to track endangered wildlife by the shape of their footprints, and help run Texas Parks & Wildlife. Now, how about tracking the movements of (and thereby helping
There are thousands of kitchen gadgets on the market designed to make cooking easier, quicker and more efficient. However, most of these gadgets serve one specific purpose and take up prime kitchen real estate. After a few uses they end up being thrown in the back of a drawer or
Nonlinear optimization routines enable you to find the values of variables that optimize an objective function of those variables. When you use a numerical optimization routine, you need to provide an initial guess, often called a "starting point" for the algorithm. Optimization routines iteratively improve the initial guess in an
Now, the Star-Belly Sneetches Had bellies with stars. The Plain-Belly Sneetches Had none upon thars. - from "The Sneetches", by Dr. Seuss Recently a user on the SAS-L mailing list had this challenge: "I would like to display stars in a table (created by PROC REPORT) based on variable values.
This is part 3 of a blog series on how Lubbock Independent School District (Lubbock ISD) uses SAS® EVAAS to improve teaching and learning by promoting self-reflection and aiding instructional and administrative decision-making. This is done in a district that, in the past decade, has experienced dramatic increases in the percentage
When teaching statistics, it is often useful to produce a normal density plot with shading under the curve. For example, consider a one-sided hypothesis test. An alpha value of .05 would correspond to a Z-score cutoff of 1.645. This means that 95% of a standard normal curve falls below a
Really! I did a double-take last week when a conference chair told me that there’s grant money available for students, faculty and SAS junior professionals but few have applied. In one case, there were no applications submitted. We're hoping this is just a temporary glitch, a holdup resulting from too-busy schedules
This is part 2 of a blog series on how Lubbock Independent School District (Lubbock ISD) uses SAS® EVAAS to improve teaching and learning by promoting self-reflection and aiding instructional and administrative decision-making. This is done in a district that, in the past decade, has experienced dramatic increases in the
During Opening Session at this year’s Pharmaceutical SAS Users Group (PharmaSUG) conference, attendees heard from teacher Heather Poland and two of her 14 year-old students. These special guests were representatives of Perkins K-8, a San Diego middle school classroom (7th and 8th grade) that is struggling with illiteracy. Located less
In many areas of statistics, it is convenient to be able to easily construct a uniform grid of points. You can use a grid of parameter values to visualize functions and to get a rough feel for how an objective function in an optimization problem depends on the parameters. And
It was almost two weeks ago that I got started making a display for lab tests for a subject, based on a graph I saw on the web for an article on this blog. This graph is a part of a larger panel display of the lab values for a
How Internal Communications got into the video business. Everybody loves video. Well, maybe not everybody, but judging by the popularity of YouTube and the ubiquity of Web videos in general, I’d have to conclude that a mighty large chunk of the population loves – or at least likes – it.
➤ DISCLOSURE! In June 2018 Google introduced changes to the way it handles its Maps platform. They now require API key in order to embed a map, plus Google Maps "projects" must now be associated with a billing account. Unless these new Google rules are met, Google maps described in
Just getting back from PharmaSUG 2014 in San Diego. The conference was great, both inside and outside. The organizers ordered up some great weather for the Padres game and also for dinner on the flight deck of the Midway Carrier. Our focus here being on graphics, we were all extremely gratified by the presentations in
Oil companies are being forced to explore in geologically complex and remote areas to exploit more unconventional hydrocarbon deposits. New engineering technology has pushed the envelope of previous upstream experience. No guidebook existed on how computing methodologies can contribute to E&P performance at reduced risk. Until now. A new book
I can’t believe that it has been almost two months since SAS Global Forum in Washington DC! As always, I was reinvigorated and came back with even more ideas on how to improve the way that we do things, apply new lessons and try some things out – along with
Improving teacher effectiveness is no simple task. Whether a part of a formal evaluation system or for formative feedback, looking at student growth data can be a valuable part of the development process for teachers and administrators. Lubbock Independent School District (Lubbock ISD) uses SAS® EVAAS to improve teaching and
In my book Simulating Data with SAS, I specify how to generate lognormal data with a shape and scale parameter. The method is simple: you use the RAND function to generate X ~ N(μ, σ), then compute Y = exp(X). The random variable Y is lognormally distributed with parameters μ
