Recently, I am working on coding in SAS for a set of regularized regressions and need to compute trace of the projection matrix:
S=X(X'X + \lambda I)^{-1}X'.
Trace of the project matrix S is a key concept in modern regression analysis. For example, ...
Read more »
Tags: data mining, predictive modeling, PROC CORR, PROC REG, PROC SCORE, R
Posted in SAS | Comments Off
Recently, I am working on coding in SAS for a set of regularized regressions and need to compute trace of the projection matrix:
S=X(X'X + \lambda I)^{-1}X'.
Wikipedia has a well written introduction to Trace @ here.
Trace of the project matrix S i...
Read more »
Tags: data mining, predictive modeling, PROC CORR, PROC REG, PROC SCORE, R
Posted in SAS | Comments Off
Recently, I am working on coding in SAS for a set of regularized regressions and need to compute trace of the projection matrix:
$$ S=X(X'X + \lambda I)^{-1}X' $$.
Wikipedia has a well written introduction to Trace @ here.
To obtain the inverse of ...
Read more »
Tags: data mining, predictive modeling, PROC CORR, PROC REG, PROC SCORE, R
Posted in SAS | Comments Off
Low Rank Radial Smoothing using GLIMMIX , a semiparametric approach to smooth curves . Specifying TYPE=RSMOOTH option in RANDOM statement, we can implement this spline smooth approach. The bast thing is that for future scoring, data preparation...
Read more »
Tags: predictive modeling, PROC GLIMMIX, PROC PRINCOMP, PROC SCORE, SVD
Posted in SAS | Comments Off
Using SAS to implement Regularized Discriminant Analysis .
Read more »
Tags: PROC CORR, PROC DISTANCE, PROC PRINCOMP, PROC SCORE
Posted in SAS | Comments Off
Partial Least Square is one of several supervised dimension reduction techniques and attracts attention in recent years. In the one hand, PLS is able to generate a series of scores that maximize linear correlation between dependent variables and inde...
Read more »
Tags: PROC FACTOR, PROC PLS, PROC SCORE
Posted in SAS | Comments Off
In the 2010 SASware Ballot®, a dedicated PROC for Randomized SVD was among the options. While an official SAS PROC will not be available in the immediate future as well as in older SAS releases, it is fairly simple to implement this algorithm using ...
Read more »
Tags: predictive modeling, PROC FASTCLUS, PROC PRINCOMP, PROC SCORE, SVD
Posted in SAS | Comments Off
Kernel method is a very useful technique in data mining that is applicable to any algorithms relying on inner product . The key is applying appropriate kernel function to the inner product of original data space.
I show here SAS/STAT+BASE ex...
Read more »
Tags: kernel, PCA, predictive modeling, PROC CORR, PROC PRINCOMP, PROC SCORE
Posted in SAS | Comments Off