Posts Tagged ‘ Statistical Thinking ’

Dimension reduction: Guidelines for retaining principal components

August 2, 2017
By

Last week I blogged about the broken-stick problem in probability, which reminded me that the broken-stick model is one of the many techniques that have been proposed for choosing the number of principal components to retain during a principal component analysis. Recall that for a principal component analysis (PCA) of

The post Read more »

Tags: , ,
Posted in SAS | Comments Off on Dimension reduction: Guidelines for retaining principal components

A quantile definition for skewness

July 19, 2017
By

Skewness is a measure of the asymmetry of a univariate distribution. I have previously shown how to compute the skewness for data distributions in SAS. The previous article computes Pearson's definition of skewness, which is based on the standardized third central moment of the data. Moment-based statistics are sensitive to

The post Read more »

Tags: , ,
Posted in SAS | Comments Off on A quantile definition for skewness

Winsorization: The good, the bad, and the ugly

February 8, 2017
By

On discussion forums, I often see questions that ask how to Winsorize variables in SAS. For example, here are some typical questions from the SAS Support Community: I want an efficient way of replacing (upper) extreme values with (95th) percentile. I have a data set with around 600 variables and

The post Read more »

Tags: , ,
Posted in SAS | Comments Off on Winsorization: The good, the bad, and the ugly

Goodness-of-fit tests: A cautionary tale for large and small samples

November 28, 2016
By

In the classic textbook by Johnson and Wichern (Applied Multivariate Statistical Analysis, Third Edition, 1992, p. 164), it says: All measures of goodness-of-fit suffer the same serious drawback. When the sample size is small, only the most aberrant behaviors will be identified as lack of fit. On the other hand,

The post Read more »

Tags: , ,
Posted in SAS | Comments Off on Goodness-of-fit tests: A cautionary tale for large and small samples

Sampling variation in small random samples

November 23, 2016
By

Somewhere in my past I encountered a panel of histograms for small random samples of normal data. I can't remember the source, but it might have been from John Tukey or William Cleveland. The point of the panel was to emphasize that (because of sampling variation) a small random sample

The post Read more »

Tags: , ,
Posted in SAS | Comments Off on Sampling variation in small random samples

What is loess regression?

October 17, 2016
By

Loess regression is a nonparametric technique that uses local weighted regression to fit a smooth curve through points in a scatter plot. Loess curves are can reveal trends and cycles in data that might be difficult to model with a parametric curve. Loess regression is one of several algorithms in

The post Read more »

Tags: , ,
Posted in SAS | Comments Off on What is loess regression?

Coverage probability of confidence intervals: A simulation approach

September 8, 2016
By

The article uses the SAS DATA step and Base SAS procedures to estimate the coverage probability of the confidence interval for the mean of normally distributed data. This discussion is based on Section 5.2 (p. 74–77) of Simulating Data with SAS. What is a confidence interval? Recall that a confidence

The post Read more »

Tags: , ,
Posted in SAS | Comments Off on Coverage probability of confidence intervals: A simulation approach

Weighted percentiles

August 29, 2016
By

Many univariate descriptive statistics are intuitive. However, weighted statistic are less intuitive. A weight variable changes the computation of a statistic by giving more weight to some observations than to others. This article shows how to compute and visualize weighted percentiles, also known as a weighted quantiles, as computed by

The post Read more »

Tags: , ,
Posted in SAS | Comments Off on Weighted percentiles

Welcome!

SAS-X.com offers news and tutorials about the various SAS® software packages, contributed by bloggers. You are welcome to subscribe to e-mail updates, or add your SAS-blog to the site.

Sponsors





Dear readers, proc-x is looking for sponsors who would be willing to support the site in exchange for banner ads in the right sidebar of the site. If you are interested, please e-mail me at: tal.galili@gmail.com
SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. ® indicates USA registration.