Use of Live Customer Data in Application Testing Still Widespread

• By James E. Powell
• 02/08/08

A survey released by Compuware Corporation and the Ponemon Institute shows "an overwhelming majority of organizations surveyed risk compromising critical information by using actual customer data for the development and testing of applications."

The report, The Insecurity of Test Data: The Unseen Crisis, said that 62 percent of companies surveyed use actual customer data instead of disguised data when testing applications. Of those companies, 89 percent use customer files and 74 percent use customer lists. The report notes that live data often includes "employee records, vendor records, customer account numbers, credit card numbers, Social Security numbers, and other credit, debit, or payment information."

Developers may believe that test data is immune from privacy threats because they are testing in a non-production environment, but the survey pointed out that such environments are usually less secure than their production counterparts. It also noted that testing data may be exposed to such unauthorized sources as in house testing staff, consultants, partners, and offshore personnel. More than half (52 percent) of respondents said they outsource their application testing, and 49 percent of those respondents shared live data with the outsourced company.

"For many organizations, large customer data files represent an easy, cheap source of data to use when testing applications, but this process introduces a huge element of risk to the challenge of maintaining the integrity of sensitive information, particularly when third parties and offshore resources are involved," said Larry Ponemon, chairman and founder of the Ponemon Institute. "This study points to a need for greater awareness and accountability over how sensitive data is used within organizations. Common practices as they relate to all uses of live data must be evaluated to assess risk, and safeguards implemented to ensure data security."

The survey reported that half of the organizations using actual customer data in testing don't protect that information. Some 897 IT professionals participated in the survey; they averaged 10 years of experience.

Among the other findings:

• Half (50 percent) of respondents have no way to know if the test data had been compromised;

• More than four in 10 respondents (41 percent) do not protect live data they use when developing software;

• More than a third (38 percent) were unsure if the live test or development data used in their organization had had been lost or stolen; and
  

• More than one-fourth of respondents (26 percent) didn't know who was responsible for protecting test data--26 percent thought it was the development team, 21 percent thought the testing organization was responsible.

"Few people realize how much is at risk during the development and testing of applications," said John Williams, senior vice president, product solutions, Compuware. "All ... organizations ... have an obligation to protect the privacy of consumer data. To eliminate the test data security risk, an increasing number of our clients are using our Test Data Privacy solution that provides them with an automated, repeatable process for creating safe and effective test data."