CandleStick Chart

A HighLow plot is very popular in the financial industry, often used to track the periodic movement of a stock or some instrument or commodity.  The CandleStick Chart is one specific type of high low plot, purportedly originating in Japan for tracking of financial instruments in the rice trade.

Creating a Candlestick Chart using SGPLOT procedure is very straightforward using the Highlow plot statement.   In the data shown on the below, I have extracted the data for one stock, and set the group based on whether the stocked closed higher or lower than the open.  Also based on the same criteria, I have set the Highcap or Lowcap variables to FilledArrow or missing.  For example, if the stock closed higher than open, Gain='Up', Highcap='FilledArrow and LowCap is missing.  V1 and V2 contain the low and high values for Open and Close variables.


CandleStickGray2The graph on the right shows the classical Candlestick Chart.  The Open and Close interval is displayed using a filled region.  Line segments (shadows) are drawn to the High and Low values for each day.  The fill color is white when Close > Open, and gray otherwise.    Click on the graph for a higher resolution image

I have created this graph with the SGPLOT procedure using the HighLow plot statement.  This statement comes in two Orientations and two Types.  The syntax for the statement is as follows:

     highlow X=var High=var Low=var / Type=LINE | BAR Highcap=var Lowcap=var;
     highlow Y=var High=var Low=var / Type=LINE | BAR Highcap=var Lowcap=var;

Here we have used the "Vertical" orientation by setting X=Date.  High and Low variable determine the vertical extents of the bar.  Using Y=var sets the orientation to horizontal, and High and Low variables determine the horizontal extents of the bar.  This is useful for a Adverse Event Timeline  graph or my take on the Swimmer Plot.   For more details on the plot statement and its uses, see the previous article HighLow Plot.  In this graph I have used the following features:

  1. A HighLow plot of Type=LINE to draw the High-Low interval.
  2. A HighLow plot of Type=BAR to draw the filled region displaying the Open-Close interval.
  3. The second HighLow Low=V1 and High=V2 and Group=Gain to color the bar appropriately.
  4. I have used a discrete attributes map to define the colors for "Up" and "Down" values of gain.

SAS 9.4 Code for CandleStick Chart:

title 'Monthly Stock Price';
proc sgplot data=stock dattrmap=attrmap;
  highlow x=date low=low high=high / type=line;
  highlow x=date low=v1 high=v2 / type=bar group=gain 
          lineattrs=(color=black) name='a' attrid=Mono;
  yaxis label='Price' grid;
  xaxis display=(nolabel);
  keylegend 'a' / location=inside position=bottom;

CandleStick2The graph on the right is a color version of the same graph, using a green shade for Gain='Up' and a red shade for Gain='Down'.  The discrete attribute map is defined with two IDs, one for the monochrome graph, and one for the color graph.  All I have to do is flip the attrid in the HighLow Bar statement.  Legend is moved inside the graph area at the bottom since empty space exists.

CandleStickCap2Note the data set also contains the HighCap and LowCap variables.  Each has a value of "FilledArrow" or missing based on the gain.  We have use these columns to make each bar have an arrow pointing up or down appropriately.  Note, some intervals are too small to draw an arrow.  In such cases the arrow is dropped.  This is where we need your feedback.  Would you like to see an option where an arrow is always drawn to indicate the direction regardless of the size of the interval?

CandleStickGrayCap2The traditional graph with directional arrows is shown to the right.

Full SAS Code:  CandleStick2

Post a Comment


Many users of SGPLOT and GTL know how to mix and match various plot statements to create graphs, sometimes in ways not originally intended.  You are also aware that you can go a step beyond, and use these systems to create completely non-standard graphs such as the Spiral Plot, the Polar Graph, the Euler Diagram and more.Data2

The other day I was asked to create a diagram.  I created a simple one with the SGPLOT procedure, with four nodes, and three links.  The four nodes A, B, C and D have the (x, y) positions shown in columns Xn and Yn.  The three links have ids of 1, 2 and 3.  These are drawn using the Series plot, each having 4 points, with first starting at right of the "From" node and ending at the left of the "To" node.  Two additional intermediate points are provided.  The "Node" and "Link" data is merged into the table shown on the right.


DiagramLineThis data is plotted using the SGPLOT procedure, using a series plot to draw the links, and scatter plot to draw the nodes and the node ids.  Graph is shown on the right.  SGPLOT program is shown below, some options are trimmed to fit.  Please see linked file at the bottom for the full program.

proc sgplot data=diagram dattrmap=attrmap;
series x=xl y=yl / group=id name='b';
scatter x=xn y=yn / group=node datalabel=node
keylegend 'b' / linelength=20;

DiagramSmoothWe can use the SmoothConnect option to avoid the sharp angles as shown on the right.  Note, this result is less than satisfactory, as the curves are required to pass through each of the points in the data.  This causes the curves to bend in the opposite direction of the curve as can be seen at the start of each link near node A.  The three links are not co-linear at the start.  Also, at each penultimate node, the curve bends the other way, as can be seen in the blue link to the left of the node.

DiagramBezierNow, for a diagram, it is not really necessary that the link pass through each of the intermediate nodes.  Those are merely there to set a path for the links.  Only the start and end of the path must be on the first and last point.

In the graph on the right we get the desired effect.  Here, each link starts and ends in the right point, but the curve does not necessarily pass through the intermediate points.  The points are used as "control points' to compute a quadratic Bezier Spline.  Then we use the series plot to draw the spline.

BezierSplineThe graph on the right shows the spline curve and the control points.  The original series plot points are used as the control points for the spline.  The spline starts out as a straight line segment from the 1st vertex half way to the 2nd vertex.  Now, from this point, a quadratic curve is calculated to the point half way between the next line segment.  This continues for all the remaining segments, till we reach the half way point of the last segment.  Then, the last segment is again a straight segment to the final vertex.

The benefit of this computation is that the curve is always at a tangent to the first and last segments, thus ensuring the slope of those segments.  Here, we want them to be horizontal.  The portion of the curve in between goes smoothly from one segment to the next.  The program includes the BezierMacro() that computes the points for the quadratic Bezier Spline given the original control points.  For more details, see this WikiPedia page on Quadratic Splines.

SeriesWhile I was in Beijing, the Chinese terms we learned the quickest were "Mien" for noodles, and other derivatives like "Jiruo Mien" for Chicken Noodles.  It was essential to know this at a minimum to order food at Mr. Lee's, the local fast food place.  Here are my versions of the graphs for the "Dry Noodles" and the "Wet Noodles", given the original data.  Click on the graph for a higher resolution image.

The programs below were written using some SAS 9.4 graph features, but these are not essential for this use case.  You can run it at SAS 9.3, and just remove the offending options.

Noodle_Graph_5_20SAS 9.4 Programs: 

Macro:  BezierMacro

Diagram:  Diagram

Noodle:  NoodleGraph

At the right is another use case with longer series plots to draw the response curves by treatment.

Noodle_Graph_10_20Note:  Bezier curves may NOT be appropriate where the curve needs to pass through each point, but can be useful where the points for the series plot are control points to draw a smooth curve.


Post a Comment

PharmaSUG-China 2014

PharmaSUG-ChinaThe Third PharmaSUG-China conference was held in Beijing last week, and I had the pleasure to attend this excellent conference along with a record number of attendees.

On Thursday, I presented two 1/2 day seminars on ODS Graphics.  One titled "Advanced Topics in GTL" and another titled "Complex Clinical Graphs using SAS".  The attendees were eager to learn and the sessions included much discussion, which is always a lot of fun.

The opening session included a presentation of using JMP Clinical for analysis of clinical data. DemographicsThe presentation included a graph of Study Demographics.  Later in the afternoon, I thought it would be appropriate to create the same graph in my presentation on ODS Graphics Designer. The graph is shown on the right.

Friday and Saturday were filled with many presentations on interesting topics in the Programming Techniques and Coder's Corner sections, especially from a graphics perspective.  Conference proceedings are now available.

GrowthThe afternoon also included an excellent presentation on the Essentials of PDV by Arthur Li and Napoleon Plot by Kriss Harris.    Unfortunately, the papers are not available on the proceedings page at this time.

Rajesh Moorakonda, Singapore Clinical Research Institute presented a paper on Monitoring Child Growth that included graphs that plot the anthropometric parameters on a growth chart using the GPLOT procedure as shown on the right.

Anno_SurvivalThe Saturday session included the "Coder's Corner" section which included many interesting papers including a fair share of papers on graphics techniques.

In my presentation titled "Annotate Your SGPLOT Graphs" I presented the basic techniques for annotating an SGPLOT graph using the SGAnnotation data set.   I demonstrated how to add a table of subjects at risk by class to a survival plot.  The paper contains the details on how to make this graph.

Cancer_HeatMapDebpriya Sarker of SAS Institute Pune, presented his paper on "Plotting Against Cancer:  Creating Oncology Plots using SAS".  This paper included the techniques for creating many graphs used in the analysis of data for Oncology, such as the HeatMap depicting correlations for Genes and Drugs.

Huashan Huo, PPD Beijing  presented the paper on "Using SAS SG Procedures to Create and Enhance Figures in Pharmaceutical Industry".  This paper included multiple graphs created using ODS Graphics Designer, GTL and SG Procedures, including the graph of Median of Lipid Profile over time, where the authors added alternate vertical bands to clearly indicate the results for specific days of the study.



Great_Wall_SanjayPresentations were done on "I am Legend" by Kriss Harris showing ways to create a stand alone legend for cases where the legend can get too big to fit in a graph and "Programming Figures beyond SGPLOT and GTL" where the author showed ways to create graphs beyond what can be directly created using SGPLOT or GTL plot statements.  Unfortunately, the papers for these are not available on the web page.

Beijing afforded a great venue for the conference.  A bustling city of historical and modern elements, it provides numerous attractions, ranging from the 2000 year old Great Wall to the majestic Forbidden City to the ultra-modern National Center for the Performing Arts.



Post a Comment

Binary Response Graph

Often we need to plot the response values for binary cases of a classifier.  The graph below is created to simulate one seen at web site of the shock index for subjects with or without a pulmonary embolism.  In this case, the data is simulated for illustration purposes only.

PulmonaryBox_93There are two levels for the classifier for presence of pulmonary embolism, "Absent" and "Present". The response values are plotted as a box plot.  I call this graph the "Binary Response Graph" as I could not find the common name for such a graph.  I would be happy if someone can provide the industry standard name for such a graph.

SAS 9.3 code for box plot:

proc sgplot data=Pulmonary;
  vbox shock / category=pulmonary boxwidth=0.2 fillattrs=(color=lightblue);
  yaxis display=(noticks nolabel noline) min=0 max=2 grid;

Note in the graph, the two class values "Absent" and "Present" are placed on the x axis with an offset of 1/2 the midpoint spacing on each side on the axis.  This is the standard placement of category (aka midpoint) values along a discrete axis for plots like Bar Charts, Box Plots and so on.

PulmonaryScatter_93Now, let us plot the mean, the 5th and the 95th percentile for the same data using the scatter plot.  I used the MEANS procedure to compute the mean, P5 and P95 values to create the data set for the graph shown on the right.  Note, something different happened here with the placement of the category values on the x axis.

Aside:  In this graph I have used two scatter plots just to simulate the filled and outlined mean marker. With SAS 9.4, this can be done with an option.  Click on the graph for a high resolution image.

SAS 9.3 code for scatter plot:

proc sgplot data=Pulmonary;
  scatter x=pulmonary y=mean / yerrorlower=p5 yerrorupper=p95 
          markerattrs=(symbol=circlefilled color=black);
  scatter x=pulmonary y=mean / 
          markerattrs=(symbol=circlefilled color=lightblue size=6);
  yaxis display=(noticks nolabel noline) min=0 max=2 grid;

In the graph above, the category values are displayed at the ends of the axis, with an offset of half the size of the marker at each end of the axis.  This is the standard behavior of the scatter plot on any type of axis.  Setting x axis Type=Discrete does not make any difference.  While we noticed this behavior, we could not change it because the scatter plot is the most extensively used plot type and such a change would create too many problems for many graphs.

However, in such cases, it is often desirable to get the discrete axis behavior similar to the first graph shown above.  How can we get that?  Well, as usual, there are multiple (simple) ways to get the result we want.

PulmonaryScatterHighLow_93First, recall we can (and are) using layers of plots to create the graph.   I can place a high low plot of the same data prior to the scatter plot.  The high low plot prefers a Bar Chart like category axis, and placing it first makes it the "Primary" plot, thus forcing the x axis to its liking and forcing other plots to follow its lead.

The high low plot also does not force a baseline of zero on the y axis, like the bar chart does.  So, it is the ideal choice in this case.  The low and high values of the high low plot are the same (mean), so a dot is drawn at this location that is overdrawn by the scatter marker. Note, the resulting graph is now the way we want as shown above.

SAS 9.3 code for scatter plot with high low:

proc sgplot data=Pulmonary;
  highlow x=pulmonary low=mean high=mean;
  scatter x=pulmonary y=mean / yerrorlower=p5 yerrorupper=p95 
          markerattrs=(symbol=circlefilled color=black);
  scatter x=pulmonary y=mean / 
          markerattrs=(symbol=circlefilled color=lightblue size=6);
  yaxis display=(noticks nolabel noline) min=0 max=2 grid;

PulmonaryScatterGroup_93Another way to achieve a similar result is to use a "dummy" group variable on the scatter plot with GroupDisplay=Cluster.  This forces the axis to what we want as shown on the right.

SAS 9.3 code for scatter plot with cluster group:

proc sgplot data=Pulmonary;
  scatter x=pulmonary y=mean / yerrorlower=p5 yerrorupper=p95 group=pulmonary
          groupdisplay=cluster markerattrs=graphdatadefault
  yaxis display=(noticks nolabel noline) min=0 max=2 grid;

Full SAS 9.3 code:  Pulmonary_93

Post a Comment

New Graphics Features in SAS 9.4M2 - Part 2

For far too long we have been using the venerable Scatter Plot to do the work of placing text strings in the graph.  For far too long we have used the Scatter Plot or the Block Plot to place axis aligned text in the graphs.   It is time to move on.

When we started down the ODS Graphics path over 10 years ago, little did we know how often we would need to do the above.  Almost every clinical graph needs text placed judiciously in the graph.  With SAS 9.4, we released the Axis Table to simplify the task of placing axis aligned text.  Now with SAS 9.4M2, we release the TEXTPLOT for general purpose text placement in a graph.

The Text Plot renders text in the graph in various different ways.  Freed from the Scatter plot, we can specialize this plot to render text in ways that did not make sense with the scatter plot.  Here is the basic syntax:

textplot x=var y=var text=var / group=var colorresponse=var sizeresponse=var;

TextPlotThis new statement makes it possible to create graphs with text alone, or add text in different ways to your graph.  Here are some examples.

Simple text plot:  In this case, we use the basic options on the text plot to display the name of each person in the class data set positioned by Height and Age classified by the variable 'Sex'.

Size_RespText Plot with Size and Color Response: In this example, the font size of the name of each person is proportional to the values in the variable used for the Size Response role.  The color of the text string is determined by the Color Response role.  In this case, both size and color are determined by the same variable "Weight".  Click on the graph for a higher resolution image.  You will also notice in the larger version that the text has a soft "backlight".  This helps in discerning text that has a color close to the background color, like the yellow text.

BMI_CurvesBut the Text Plot goes beyond such features to support rotated text, aligned to the 9 compass directions as shown in the graph on the right.  In this case, we have displayed the standard BMI curves as bands, and want to label them along the top.  Using horizontal text can be a problem for narrow bands.  So, in this case I have specified an angle of rotation independently for each string in the column.

To render rotated text, you can specify an angle of rotation in degrees for each string separately.  This works quite well in most cases, but in this case it can be a problem as the slope of the curve can change based on the aspect ratio of the graph.  So, specifying the angle in data coordinates instead of screen coordinates may work better.  We will be sure to add an option to do that soon.

BMI_NamesClearly, you can overlay markers on the BMI curves to display the values for each subject in a study.  One could use the scatter plot to display the value for each subject, but here we have use the Text Plot itself.

Finally, certain things are harder to do, where you need to know the exact dimensions of the text being rendered. For example, I was attempting to see how far I can get creating a "Word Cloud" graph using the Text plot.  I can size and color each string by a response value based on some statistic (say number of occurrences), and place a string where I want.  But, only the Java rendering code knows the exact string box sizes, which vary for each string.  I cannot know where a string ends for proportional fonts to exactly position the next string.

WordCloudGCalligraphyCRBottomAs an exploration of what could be possible, we created a feedback mechanism to allow the user to know the exact size of a text string (for any given font, weight, size or style).  The renderer can write this information to a file on disk, which can be read back by the user.  Now, using a two pass process, you can create a perfect word cloud yourself as shown on the right.

In the example on the right, I first rendered all the text strings with the correct size, font and style, but all at (x, y) = (0, 0).  We added a mechanism (still under development) to write the actual bounding box of each string in pixel and data space into a csv file.  I read back this information using proc import, and merged the text box information with the original data.  Now, I ran a data step to position each string in sequence, wrapping to the next line when I have reached the end of the data space.

WordCloudCalligraphicThe benefit here is you can implement your own specific algorithm to lay out the strings once you know their exact dimensions.  Instead of a linear word cloud, you could do a circular layout, starting from the middle.  Or, turn the text sideways to fit them closer like some of the examples on the web.  Here is the same data (with different size values) as a grouped word cloud.

So, we are looking for some feedback from you.  Do you see use cases in your work where you could use this information to layout strings exactly where you need? Would knowing the exact pixel dimensions of something rendered in a graph help you control some aspects of the graph?   Please chime in with your opinions to help us determine if such a "feedback loop" could be useful and how you could leverage it.

SAS 9.4M2 Text Plot Code:  TextPlot

Post a Comment

New Graphics Features in SAS 9.4M2 - Part 1

SAS 9.4 maintenance release M2 was released early in August.  This release contains some exciting new features in GTL and SG Procedures.  In this article, I will describe some of the new options added to the existing plot statements.  Note, I will use the SG examples here, but these are also available in GTL.

Color_Response_SkinBubble Plot with Response Color:  The bubble plot now supports color response role, so you can color each bubble by a color that represents the level as shown in the graph on the right.  A gradient legend is also displayed by default.  Bubble labels can be displayed at one of the nine locations around the bubble.  Color response role is also supported for Scatter and Polygon plot.  In addition, a new GradLegend statement is added to display the color gradient.

The bubble plot supports both discrete and interval axis for both X and Y axis.  In this case, both the size and the bubble color are based on the frequency variable N, previously computed using the MEANS procedure.  Data skin is used to enhance the bubble rendering.

Box_WhiskerBox Whisker Percentile:  This is a feature often requested by users to control the percentile of the whiskers in the box plots.  A new option WhiskerPct=number is supported, where number is between 0 and 25.  The graph on the left uses WhiskerPct=1, thus displaying the 1st and 99th percentile whiskers.  Jittered markers can be overlaid on a box plot, and a new JitterWidth option is added to control the spread of the jittered markers.

VBarParm with Stacked Groups:  Stacked groups were previously disallowed in SGPLOT due to the complexity of getting uniform axes across BY variables.  Now, this has been added.

VBarParm_StackedSegment labels are also added both to VBar/HBar and VBarParm/HBarParm.  This allows us to display the labels for each segment of the bar (stacked or clustered) in the center of the bar.  DataLabels can still be displayed at the top.  SegmentLabelFitPolicy allows you to control whether the labels are clipped if they do not fit in the space.  Here, the policy=none, so labels are all displayed.

Grouped Histograms and Fill Type:   Another user requested feature is the grouped histogram and density plots.  Earlier, you could create Comparative Histograms using overlay of two variables, like Systolic and Diastolic in the SASHELP.HEART data set.  Now, you can do the same if these are group levels in the data set.

Grouped_HistogramIn this example, I have reformatted the heart data into a "grouped" structure, using Type=Systolic / Diastolic, with the BP column keeping the value.  Now, I can set the role GROUP=Type to create the histogram shown on the right.

Note, I have taken the liberty of using the new FillType=Gradient option to get a different aesthetic look for the Histogram.  Normally, one does not use such an option for histograms, but I used it mainly to avoid making another example with bar chart.  The gradient is an Alpha gradient, not a color gradient, so more of the backdrop shows through near the bottom.  In this case, it allows the shorter bins of the other group to show through, as can be seen near X=100.  This type of gradient fill is available for histograms and bar charts.

Line color, Line Pattern, Marker color and Marker Symbol groups are now added to the Series Plot.  This is a useful feature as explained in earlier articles on Spaghetti Plots.   Many more little features and enhancements have been added, too numerous to enumerate here.  You can review these in the Online Doc for SAS 9.4 and maintenance releases.

In the next article, I will discuss the whole new statement called TextPlot that has been added to both GTL and SG.

 Full SAS 9.4M2 program for new features:  SAS_94M2_Features


Post a Comment

Histograms on Log Axis

Often there are questions from users on creating histogram using a Log X axis.  One such question came up this weekend, where a user wanted a histogram of her data using log axis.  Before we get into her specific case, let us first clarify what we may want to see when we say "Histogram on Log Axis".  This could mean one of these two cases:

1.  Histogram of the linear values, displayed on a log x axis.  This histogram has equal width bins in linear data space.  When displayed on a log axis, the bins are drawn with varying pixel width.

Histogram_Cars_Log_AxisUsing the data set, the first case on the right shows a histogram of the original data in linear space, on a LOG x axis.  Note, each bin represents the same amount of the data, but the widths of the bins in pixels are reducing as we go to the left due to the log axis.

proc sgplot;
  histogram mpg_city;
  xaxis type=log;

Histogram_Cars_Log_Data2.  Histogram of the transformed values.  A transformed variable is used instead of the original variable.  Now, each bin has equal pixel width,  representing the transformed data.

On the right is a graph of the log transformed data on a default axis.  First, we create a new data column logMpg=Log10(mpg_city).  Then use logMpg as the analysis variable for the histogram. This will create the graph shown here, where each bin is now has a constant pixel size.  Note the x axis tick values and axis label.

data cars;

proc sgplot data=cars;
  histogram logMpg / fillattrs=graphdata1

Histogram_Cars_Log_Data_2In the graph on the right we have replaced the x- axis values (log scale) with their respective untransformed linear values at equal spacing using the ValuesDisplay option.  A tick value is displayed at each value provided in the Values option, but the actual text displayed is from the valuesDisplay option.  Axis label is now "MPG".

proc sgplot data=cars;
  histogram logMpg / fillattrs=graphdata1;
  xaxis fitpolicy=none valueattrs=(size=7) values=(0.90 1 1.3 1.47 1.6 1.7 1.78 1.85 1.90 1.954 2)
               valuesdisplay=(" " "10" "20" "30" "40" "50" "60" "70" "80" "90" "100") label='MPG';

Discussing with experts here at SAS, the second and third graphs above have more practical uses instead for the first one.  Often users wan to see if their data, or some transform, has a normal distribution.  So, it is useful to view the histogram of the transformed data.  Then, subsequent processing can be done on the transformed data.  It turns out that the user who asked the original question about using the Log axis  also really wants the last case shown above.

Now, let us talk about using TYPE=LOG on the x axis.  Often, in this case when the data has a range of over 2 or 3 orders of magnitude, you may see a Note in the log saying:

NOTE: Log axis cannot support zero or negative values in the data range. The axis type will be changed to LINEAR.

This happens despite the fact at all the data is positive and is a bit confusing.  What is going on is that the histogram is computing the BinStart and BinWidth values internally, and the default numbers can cause the lower edge of the first bin to have a negative x value.  This is the reason for the warning if you then ask for TYPE=log.   If you must set the TYPE=Log and get the graph like the first one above, make sure your BinStart and BinWidth combination satisfy the following criteria:

         zero < BS-BW/2 < min value in data

Full SGPLOT program:  

Post a Comment

More on Spaghetti Plots

In her article Creating Spaghetti Plots Just got Easy, Lelia McConnell has provided us a glimpse into some new useful features in the SAS 9.4M2 release.  The term Spaghetti plots generally refers to cases where time series plots have to be  identified by multiple group classifications.  The support for the GroupLC and GroupLP options, among others make it easy to create such graphs.

The key point to note here is that the GROUP variable is used to decide which observations in the plot should be connected.  So, the group variable should provide the finest grain classification for the series in the plot.  Normally, each individual series is rendered using one of the GraphData elements from the style, providing unique attributes to each series.

Spaghetti_GTLHowever, if multiple series in the graph represent one specific value from another classifier, such as treatment or study, we can provide higher classification roles using the GroupLC  (GroupLineColor) or GroupLP (Group Line Pattern), etc., as shown in the graph on the right.  In this example, the simulated data represents the adoption rate over time for some item classified by location (color) and year (pattern) using the following code for the SERIES plot statement:

series x=x y=y / group=id lineattrs=(thickness=2 pattern=solid)
grouplc=Location grouplp=year smoothconnect;

This graph, along with other graphs using SAS 9.4M2 features are shown in the samples in the Graph Focus page on the SAS Support web site.  Now that SAS 9.4M2 is released (Aug 5), we will be adding more samples demonstrating the features at this location.

Many of you who do not yet have the SAS 9.4M2 release are asking, what does this do for me?  Well, there is good new.  While this feature has now been included in the SGPLOT procedure, it has always been available in GTL. Here is the GTL code you can use at SAS 9.4.  Note the use of the subpixel and itemsize options.

proc template;
  define statgraph MultiClassSeries;
    begingraph / subpixel=on;
      entrytitle 'Adoption Rate over Time by Location and Year';
      layout overlay / yaxisopts=(offsetmin=0.1);
        seriesplot x=x y=y / group=id name='a' lineattrs=(thickness=2) 
                             linecolorgroup=Location linepatterngroup=year;
        discretelegend 'a' / title='Location:' type=linecolor location=inside 
             valign=bottom halign=right;
        discretelegend 'a' / title='Year:' type=linepattern location=inside 
             valign=bottom halign=left itemsize=(linelength=30px);

You can also run this with SAS 9.3, except for the subpixel and itemsize option.  Remove those, and you are good to go.

SAS 9.4 GTL code:  Spaghetti

Post a Comment

Creating Spaghetti Plots Just Got Easy

This article is by guest contributor Lelia McConnell, SAS Tech Support.

Creating Spaghetti Plots Just Got Easy

Sample 38076: “Response by patient and treatment group” illustrates how to generate a spaghetti plot using the SGPLOT procedure.  Sample 40255: “Plot of study results by treatment group” illustrates how to generate a spaghetti plot with PROC SGPLOT prior to SAS® 9.4 TS1M2.  In both samples, a custom style template is necessary in order to get the desired results.

Beginning in SAS 9.4 TS1M2, spaghetti plots are easier than ever to create, thanks to the SGPLOT and SGPANEL procedures and new syntax that was added to the Graph Template Language (GTL).

First, let’s look at how to generate this graph using GTL.  The following options were added to the SERIESPLOT statement in SAS 9.4 TS1M2:

  •  LINECOLORGROUP= column|expression
  • LINEPATTERNGROUP= column|expression
  • MARKERSYMBOLGROUP= column|expression
  • MARKERCOLORGROUP= column|expression

DataIn addition, the TYPE= option was added to the DISCRETELEGEND statement, giving you the ability to include any or all of the grouping information in your legend.  Here are the values for the TYPE= option:


Let’s now generate a spaghetti plot using GTL.  Data sample is shown on the right.


Spaghetti_GTLproc template;
  define statgraph grouping;
      entrytitle 'Study Results by Treatment Group';
     layout overlay;
        seriesplot x=time y=results/ group=subject
               linecolorgroup=trt_group name='grouping';
        discretelegend 'grouping' / type=linecolor;

proc sgrender data=one template=grouping;

 In the code above, notice that a separate line is to be drawn for each value of the variable SUBJECT and that the line color is determined by the values of the variable TRT_GROUP.    This program can be found in Sample 52962: “Create a spaghetti plot with the Graph Template Language (GTL).”

Now let’s create this same graph using PROC SGPLOT.

The following options were added to the SERIES statement in PROC SGPLOT and PROC SGPANEL:

  • GROUPLC - equivalent to LINECOLORGROUP in GTL

In addition, the following values are now supported in the TYPE option in the KEYLEGEND statement:

  • FILL
  • LINE

Spaghetti_SGThe following sample code illustrates how to produce a spaghetti plot with PROC SGPLOT:

proc sgplot data=one;
  title 'Study Results by Treatment Group';
  series x=time y=results / group=subject
               grouplc=trt_group name='grouping';
  keylegend 'grouping' / type=linecolor;

This program can be found in Sample 52964: “Create a spaghetti plot with the SGPLOT procedure.”

Full SAS 9.4M2 code: Spaghetti  

Post a Comment

Epidemic Curve Graph

A few weeks back I wrote an article on Grouped Timeline for creating a stacked timeline for onset of different virus.  The idea in that article was to display a stacked needle on a time axis using a HighLow plot. Such graphs are also referred to as EPI or Epidemic Curve Graphs.

ByDate_93In that article, I restricted the weeks in the year for onset to 52, and plotted each value on the equivalent location on a time axis.  That all works fine, but really, an year will have 53 weeks for onsets as shown in the graph on the right. Gaps are shown where the data is missing.

The problem is that a start or end week of the year may have smaller number of days.   This causes the bars (with fixed width) for these weeks to be overlapped by neighboring weeks.  Click on the graph to see this in the higher resolution image.  You will see near "Jan 2014", the bar for week 53 of 2013 is overlapped by the bar for week 1 of 2014.  This will happen if the X axis is a real time axis, and week 53 has only 1 or 2 days in it.

ByYearWeek2_93Another way to address this is to draw a BAR graph by the YearWeek variable.  This variable is a combination of the year and week values so as to avoid values form the two different years from being consolidated into one bar, as shown on the right.

Such a graph is easier to make, as the bar chart already does stacked groups using GROUP=Virus.  The X axis is suppressed, and the week values are shown below each bar using another overlaid bar chart.  If you click on the graph for a higher resolution image, you will notice that in this case (as expected) the axis is discrete, and only the weeks that are present in the data are displayed, without gaps for the missing weeks.  A bar or a gap for week 16 is not displayed in the graph.

Let us see if we can get the best of both worlds.  First, let us create a data set that has all weeks in the data with missing response values for the frequency.  Then, we merge this with the actual data.  This ensures all weeks are present in the data and are represented in the graph either with data or a gap.

Virus_BarChartLabelBelow93SAS 9.3 version of this graph is shown on the right.  Click on the graph for a higher resolution image and you will see that all weeks are now represented, with gaps where there is no data.  Week 53 and week 1 are not overlapped, and can be seen distinctly.  However, it is clear that the axis is not a scaled time axis, but is discrete, so the 53 weeks will take up more space than a real year on a time axis.  Also, the 53rd week may have less number of days, but has the same width as all other bars.

Epidemic_GTL_94The final graph is created using SAS 9.4 GTL, and I have added some labeling to indicate the year for the data.  Click on the graph for a higher resolution view.  I believe this should be doable with SG, but I ran into an issue with bar labels that needs investigation.

I used a reference line with scatterplot markercharacter to display the boundary between the 2013 and 2014 data.

Epidemic_Block_GTL_94As usual with SG or GTL, there are other ways to display such demarcation as shown in the graph on the right.

SAS 9.3 program: EPI_93

SAS 9.4 program: EPI_94

Data: Test_dataset

Post a Comment