Did you know that 17 of the 20 biggest hotels in the U.S. are in Las Vegas? Everything in Sin City seems larger than life — so it makes sense that we would host one of the largest analytics conferences right in the middle of the action. We know the [….
SAS Administration: Process Data Faster in RDBMS by Buffering the Data in Memory
By default, accessing third party relational databases can be very slow if not configured properly. I recently started using PostgreSQL 9.1, an open source database, to store high volumes of data for my SAS Global Forum 2013 paper. At first it was taking forever to load up data because SAS was inserting 1 row at a time into the database table. After adding a simple option my data processing was off to the races! Buffering Options The SAS INSERTBUFF and READBUFF options will improve ODBC and OLE DB libraries dramatically. By default these are set to 1 and 250 rows respectively for ODBC connections. Other third party databases, such as Oracle, DB2, or MS SQL Server, will probably benefit as well but I have not been able to test. Setting these buffer sizes tells SAS how many rows to buffer in memory before processing. Using the LIBNAME Option These options can be added to the LIBNAME statement to set the buffering sizes for all processing done on tables within the library. Ideally if you have the SAS Metadata server running, your SAS Administrator should set these options through the Data Library manager in SAS Management Console. If you are […]
The post SAS Administration: Process Data Faster in RDBMS by Buffering the Data in Memory appeared first on Business Intelligence Notes for SAS® BI Users.
A custom tasks book: by the numbers
Milestone achieved: I’ve completed the final chapter of Creating Custom Tasks for SAS Enterprise Guide using Microsoft .NET and turned it over to SAS Press for editing and production. It’s scheduled to be available in early 2013. I committed to writing this book nearly 5 years ago. I’ll engage in […]
Two SAS AF Utilities: LogFilter and Format Viewer
Nice to have (and easy to follow, both tested in Windows 7 with SAS 9.3M1 while they were both written in lower version of SAS):
1. LogFilter: a SAS log checker by rtsl
http://www.ratcliffe.co.uk/rest_logfilt.htm
2. A SAS format viewer by Frank Poppe
h…
Open question in 1937…short SAS program today
John D. Cook posted a story about Hardy, Ramanujan, and Euler and discusses a conjecture in number theory from 1937. Cook says, Euler discovered 653,518,657 = 158^4 + 59^4 = 134^4 + 133^4 and that this was the smallest [integer] known to be the sum of two fourth powers in […]
R for SAS, SPSS, Stata Users Workshop Redesigned
My workshop R for SAS, SPSS and Stata Users has been popular over the years, but it’s time for an overhaul. A common request has been to simplify it, so I have moved data management to a separate 4-hour workshop, … Continue reading →