Data Access - Statewide Planning and Research Cooperative System (SPARCS)

The SPARCS program data processing remediation effort is complete!

The SPARCS program will begin processing data requests, starting with previously approved requests and then moving to recently approved requests. If you were approved for CY 2018 data, your extract will contain CY 2018 data.

The SPARCS program has a new data request file transfer system!

Starting in December, we will reach out to data requestors next in the queue to receive their data extracts. When we contact you, we will provide details for a new data file transfer system called Aspera that the SPARCS program will be using (instead of CDs!). Please be on the lookout for this information.

If you have any questions about your data extract, please contact sparcs.requests@health.ny.gov.

SPARCS Data Access

SPARCS offers three levels of data access: public, limited, and identifiable. Public use data is openly available. Limited or identifiable data requires the submission of an application.

Public Use Data

Public use data contains de-identified data consisting of basic record-level detail. This data does not contain protected health information (PHI) under HIPAA.

Public use data can be obtained through the Health Data NY website, which provides access to de-identified data consisting of basic record-level detail.

Limited and Identifiable Data

Limited data contains indirect identifiers that are deemed identifiable according to HIPAA standards. Limited data requests are reviewed by SPARCS Operations staff.

Identifiable data pertains to a particular individual's facility stay which, if disclosed, would constitute an unwarranted invasion of personal privacy, as stipulated in Department regulations, Title 10, NYCRR 400.18. Identifiable requests are reviewed by the data review group.

To apply for limited and identifiable data, download and complete the SPARCS Limited and Identifiable Data Request Form (DOH-5132) from the forms page. Form DOH-5132 replaces previous forms DOH-4385 and DOH-4395.

Data Governance Committee

The Data Governance Committee (DGC) is responsible for reviewing identifiable data requests. For further information:

Data File Transfer System

The SPARCS program uses IBM's Aspera to transmit approved SPARCS extract. For more information on how to download the Aspera plugin:

Data Use Resources

Data Release Notes

Output Data Dictionaries

Reference Table

Mapping Document

SAS Read-in Programs

The following are SAS read-in programs for each of the 14 SPARCS tables in the new data layout.

For data received November 15, 2018 and forward:
Claim Table
Condition Code Table
Diagnosis Table
DRG Table
Location Table
NDC Table
Occurrence Table
Occurrence Span Table
Payor Table
Procedure Table
Provider Table
Race Table
Revenue Table
Value Code Table

The following are SAS read-in programs for inpatient and outpatient files. If you are using a completely un-encrypted file, please contact us for an alternate version of the program.

For data received on or after October 1, 2014:
For data received prior to October 1, 2014: