Because I began my SAS career in the Publications division, I like to think that I have a keen eye when it comes to SAS documentation. When I first visited the SAS 9.4 online documentation, I immediately noticed that it had a different look. Examine the image below; can you […]
Category: SAS
NOTE: Macros Newness in 9.4 and 9.3 (MCOVERAGE)
The SAS macro language is almost as old as SAS itself (who knows exactly?) so you’d think the need to add new functionality would have ceased – particularly with the ability to access most DATA step functions through %sysexec. But apparently not…SAS …
Test drive for PROC HADOOP and Pig
PROC HADOOP is available since SAS 9.3M2, which bridges a Windows client and a Hadoop server. The great thing about this procedure is that it supports user-defined function. There are several steps to apply this procedure.
- Download Java SE and Eclipse on Windows
Java SE and Eclipse are free to download. Installation is also fairly easy. - Make user-defined function on Windows
The most basic user-defined function is an upper-case function for a string that wraps Java’s native str.toUpperCase() function. Pig’s manual has [detail descripton][1] about it. - Package the function as JAR
There is a wonderful video tutorial on YouTube. Make sure that version of the [Pig API][2] with the name such as pig-0.12.0.jar on Windows is the same to the one running on the Hadoop. -
Run PROC HADOOP commands
# pig_code
A = load 'test3.txt' as (f1: chararray, f2: chararray, f3: chararray, f4: chararray, f5: chararray);
describe A;
register myudfs.jar;
B = foreach A generate myudfs.UPPER(f3);
dump B;Then we can run the SAS codes with PROC HADOOP. Subsequently one field f3 of the text file on HDFS is capitalized.filename cfg "C:\tmp\config.xml";
filename code "C:\tmp\pig_code.txt";
proc hadoop options=cfg username="myname" password="mypwd" verbose;
pig code=code registerjar="C:\tmp\myudfs.jar";
run;
NOTE: Metadata-Bound Libraries for Dummies
As I said in yesterday’s My 2013 Top Ten article, I think that metadata-bound libraries (introduced in V9.3 maintenance 2) are one of the most significant SAS enhancements for some time. It seems SAS’s Chris Hemedinger agrees. Read his Closing the “LIB…
Analytics Companies Using SAS in India
Analytics Companies Using SAS in India
My 2013 Top Ten
Last week I published the ten blog articles that scored most hits over the last 18 months. That was “your” top ten. I thought I’d offer an alternative top ten by listing the articles that I most enjoyed writing or which I personally thought were of the…
Turing Pardoned!
In December 2012 I wrote of my family’s visit to Bletchley Park in Central England. Bletchley has a remarkable history and we enjoyed discovering its contribution to computer science along with that of Alan Turing.In the article, I mentioned the tragic…
2013 in review
I am certainly not one to decline when someone offers to write a blog entry for me. Here, courtesy of the stats monkeys at WordPress is the annual report for the AvocetSolutions.com blog: And here’s an excerpt: A New York City subway train holds 1,200 people. This blog was viewed about 6,600 times in 2013. […]