Data Quality Campaign

{{Short description|American nonprofit organization}}

{{primary sources|date=February 2014}}

The Data Quality Campaign (DQC) is a nonpartisan, nonprofit advocacy organization launched in the United States in 2005 to improve the quality, accessibility and use of data in education.{{cite web|title=Data Quality Campaign Launched at Data Summit|date=25 May 2006 |url=http://www.achieve.org/data-quality-campaign-launched-data-summit|publisher=Achieve}}

Overview

{{Education in the U.S.}}

The Data Quality Campaign was founded in 2005, by Aimee Guidera and 10 founding partners as a national collaborative effort to encourage states to improve the collection and use of high-quality education data, and implement state longitudinal data systems to measure student achievement.{{cite web|title=Our Team: Aimee Guidera|url=http://www.dataqualitycampaign.org/who-we-are/our-team/a-guidera|publisher=Data Quality Campaign|access-date=2013-09-11|archive-date=2013-09-05|archive-url=https://web.archive.org/web/20130905221314/http://dataqualitycampaign.org/who-we-are/our-team/a-guidera/|url-status=dead}} It focused on its 10 Essential Elements of Statewide Longitudinal Data Systems. During this time, the campaign was managed by the National Center for Educational Achievement (NCEA).{{cite web|title=About Us|url=http://www.nc4ea.org/about-us/|publisher=National Center for Education Achievement|access-date=2013-11-12|archive-url=https://web.archive.org/web/20140113080520/http://www.nc4ea.org/about-us/|archive-date=2014-01-13|url-status=dead}}

By 2009, many states had implemented data systems but few were utilizing them to their full potential. The organization shifted focus to its 10 State Actions to Ensure Effective Data Use. Around the same time, the NCEA was being acquired by ACT, Inc. in 2007, and the Data Quality Campaign became a fully independent nonprofit organization in 2011.{{cite web|title=Data Quality Campaign Welcomes New Chairman and Members to Board of Directors|url=http://www.dataqualitycampaign.org/node/815/|archive-url=https://archive.today/20131115021901/http://www.dataqualitycampaign.org/node/815/|url-status=dead|archive-date=2013-11-15|publisher=Data Quality Campaign}}

Today, the Washington, DC–based organization leads a partnership of nearly 100 organizations.{{cite web|title=Fact Sheet|url=http://www.dataqualitycampaign.org/files/DQC%20Fact%20Sheet%20May%202013.pdf|publisher=Data Quality Campaign|access-date=2013-09-11|archive-url=https://web.archive.org/web/20140517115616/http://www.dataqualitycampaign.org/files/DQC%20Fact%20Sheet%20May%202013.pdf|archive-date=2014-05-17|url-status=dead}}{{cite web|title=Campaign Seeks to Dispel Common Core Data Mining Claims|url=http://www.sunshinestatenews.com/story/data-quality-campaign-attempts-dispel-common-core-data-mining-claims|publisher=Sunshine State News|access-date=2013-09-11|archive-url=https://web.archive.org/web/20130912232003/http://www.sunshinestatenews.com/story/data-quality-campaign-attempts-dispel-common-core-data-mining-claims|archive-date=2013-09-12|url-status=dead}}{{cite web|title=Who We Are|url=http://www.dataqualitycampaign.org/who-we-are/|publisher=Data Quality Campaign|access-date=2013-09-11|archive-date=2013-09-06|archive-url=https://web.archive.org/web/20130906000152/http://dataqualitycampaign.org/who-we-are|url-status=dead}}

10 Essential Elements

When the Campaign was launched, part of its mission was to promote 10 essential elements of a longitudinal data system to see a student's academic growth and the contribution of specific programs.

The elements are:{{cite web|title=10 Essential Elements|url=http://www.dataqualitycampaign.org/your-states-progress/10-essential-elements/|publisher=Data Quality Campaign}}{{cite web|title=10 Essential Elements Critical to Longitudinal Data Systems: How California Stacks Up|url=http://www.everychildprepared.org/docs/appendixj.pdf|publisher=Every Child Prepared}}{{cite web|title=Data Quality Campaign's Ten Essential Elements and State Actions|url=http://www.ode.state.or.us/superintendent/priorities/dqc---10-essential-elements-and-actions.pdf|publisher=Ohio Department of Education|access-date=2013-09-11|archive-date=2015-09-08|archive-url=https://web.archive.org/web/20150908075230/http://www.ode.state.or.us/superintendent/priorities/dqc---10-essential-elements-and-actions.pdf|url-status=dead}}

1. Student Identifier: A unique statewide student identifier that connects student data across key databases across years

2. Student Info: Student-level enrollment, demographic, and program participation information

3. Matching Student Test Records: The ability to match individual students' test records from year to year

4. Untested Student Info: Information on untested students and the reasons they were not tested

5. Teacher/Student Data Link: A teacher identifier system with the ability to match teachers to students

6. Transcript Data: Student-level transcript information, including information on courses completed and grades earned

7. College Readiness Scores: Student-level college readiness test scores

8. Graduation/Dropout Data: Student-level graduation and dropout data

9. P-12/Postsecondary Records Match: The ability to match student records between K-12 and higher education systems {{Cite web|last=Fitzgerald|first=Dylan|title=Data Quality Campaign|url=https://dataqualitycampaign.org/|access-date=2020-06-15|website=Data Quality Campaign|language=en-US}}

10. Data Audit System: A state data audit system assessing data quality, validity, and reliability

The DQC continued to promote and monitor states' progress in establishing these elements until 2011. In September 2009, all 50 states agreed to implement the 12 America COMPETES Elements, which include DQC's 10 elements and today, states report that information to the Department of Education.

10 State Actions

DQC has identified 10 state actions to help ensure that states use the information available to them. Every year since 2010, it surveys states' progress through the Data for Action survey.{{cite web|title=10 State Actions|url=http://www.dataqualitycampaign.org/your-states-progress/10-state-actions/|publisher=Data Quality Campaign}}{{cite web|title=Many Missing Pieces|url=http://www.newamerica.net/sites/newamerica.net/files/policydocs/NAF_ManyMissingPieces.pdf|publisher=New American Foundation|access-date=2013-09-11|archive-date=2014-01-15|archive-url=https://web.archive.org/web/20140115034410/http://newamerica.net/sites/newamerica.net/files/policydocs/NAF_ManyMissingPieces.pdf|url-status=dead}}

The actions are:

1. Link Data Systems: Link State K-12 data systems with early learning, postsecondary education, workforce, social services, and other agencies(currently in development)

2. Sustained Support: Create stable, sustained support for robust state longitudinal data systems

(not yet achieved)

3. Governance Structures: Develop governance structures to guide data collection, sharing, and use

4. Data Repositories: Build state data repositories (e.g. data warehouses) that integrate student, staff, financial, and facility data

5. Timely Access to Data: Implement systems to provide all stakeholders with timely access to the information they need while protecting student privacy

6. Individual Progress Reports: Create progress reports with individual student data that provide information educators, parents and students can us to improve student performance

7. Aggregate Progress Reports: Create reports that include longitudinal statistics on school systems

and groups of students to guide school-, district-, and state-level improvement efforts

8. Research Agenda: Develop a purposeful research agenda and collaborate with universities,

researchers, and intermediary groups to explore the data for useful information (currently in

development)

9. Professional Development: Implement policies and promote practices, including professional

development and credentialing, to ensure educators know how to access, analyze, and use data

appropriately (partially implemented – professional development is fully implemented; state not

involved in credentialing process)

10. Raise Public Awareness: Promote strategies to raise awareness of available data and ensure that

key stakeholders, including state policymakers, know how to access, analyze, and use the

information

Data for Action

The Data for Action (DFA) is an annual survey of all 50 states, Washington, D.C. and Puerto Rico on their progress toward implementing DQC's 10 State Actions. Each year, DQC invites each state's Governor's office to participate in the survey and uses their responses to analyze which state actions have been implemented in each state. Beyond the 10 state actions, the DFA also includes questions on other data issues and attempts to identify best practices in the field.{{cite web|title=About Data for Action|url=http://www.dataqualitycampaign.org/your-states-progress/about-data-for-action/|publisher=Data Quality Campaign}}

=DFA 2010=

In 2010, not all states had yet implemented all 10 Essential Elements, so the 2010 DFA also measured states' progress on those, as well as the 10 State Actions. The 2010 DFA results showed that 24 states had implemented all 10 Essential Elements but all states had committed to implement them by September 2011.{{cite web|title=Data for Action 2010|date=22 February 2011 |url=http://www.coreeducationllc.com/blog2/data-for-action-2010/|publisher=Core Education}} None of the states had implemented all 10 State Actions and 17 states could not link student and teacher data, while 11 states could not link K-12 data to postsecondary data. Based on these results, DQC concluded that while states were making progress in data collection, they were not using that data to improve student achievement, because the data could not be linked across different education systems and was not available to stakeholders . To combat these issues, DQC identified 5 state priorities for the upcoming year:/>{{cite web|title=Do States Use Data to Improve Student Learning?|date=18 October 2016 |url=http://www.centerdigitaled.com/policy/Do-States-Use-Data-to-Improve-Student-Learning.html|publisher=Center for Digital Education}}

  • Fulfill the 50-state commitment to implement the 10 Essential Elements by September 2011.
  • Link K-12 with early childhood, postsecondary and workforce data to answer critical policy questions.
  • Provide teachers, students and parents with access to longitudinal student-level data.
  • Share data about teacher impact on student achievement with educator preparation institutions.
  • Enact statewide preservice policies, including certification and licensure, and program approval, to build educator capacity to use data.

=DFA 2011=

The results of the 2011 DFA revealed that states were still struggling with actually using the data that they collected. Most tellingly, the two State Actions that were most difficult for states to implement were Actions 5 and 9. Action 5 deals with making the data accessible to all stakeholder, including parents and teachers, while Action 9 deals with providing educators with the skills necessary to access the data and use it to help students.{{cite web|title=New Data Quality Campaign Report: The Hard Work Remains|url=http://www.quickanded.com/2011/12/new-data-quality-campaign-report-the-hard-work-remains.html|publisher=The Quick and the Ed|access-date=2013-09-17|archive-url=https://web.archive.org/web/20130718042627/http://www.quickanded.com/2011/12/new-data-quality-campaign-report-the-hard-work-remains.html|archive-date=2013-07-18|url-status=dead}} Based on its analysis of the 2011 DFA, DQC issued its "Game-Changing Priorities for States," to accelerate the implementation of the 10 State Actions. The priorities were:{{cite web|title=Report: 4 Keys to Educational Data Systems|url=http://thejournal.com/articles/2012/01/19/report-4-keys-to-educational-data-systems.aspx|publisher=THE Journal}}

  1. Taking public input and identifying important policies that "will inform the development, implementation, and evaluation of the state’s data efforts"
  2. Among K-12, pre-K, higher education, and workforce data governance bodies, establishing "decision-making authority" for tackling issues of data use
  3. Reporting teacher effectiveness data to the schools that prepared them
  4. Continuing to address the needs of end users by determining whether existing tools are effective and fixing or refining them when they are not

=DFA 2012=

The results of the 2012 Data for Action survey revealed that only 10 states had implemented 8 or 9 of the 10 State Actions. While 35 states had the policies and funding to support a data system, only 5 made sure that it was accessible and usable for various stakeholders.{{cite web|title=Data Access for Education Stakeholders|url=http://www.districtadministration.com/article/data-access-education-stakeholders|publisher=District Administration}} Based on the results, DQC determined that this may partly be due to the fact that while legislation may allow states to collect the data, it often makes it difficult for them to actually share the data with important stakeholders, like educators and parents. Based on these findings, DQC concluded that it is time to change the culture surrounding data use in education and get the data into the hands of people who need it most, like parents in teachers. To help, they issued five recommendations to guide states in 2013:{{cite web|title=Time To Focus on Helping People Use Education Data|url=http://thejournal.com/Articles/2012/11/15/Time-To-Focus-on-Helping-People-Use-Education-Data-Says-Data-Quality-Campaign.aspx?Page=2|publisher=THE Journal}}

  • To implement a high-quality teacher-student data link, including a statewide "teacher of record" definition, a roster verification system, and the ability to link multiple educators per student per course.
  • To develop a feedback loop to share teacher performance data with teacher preparation programs.
  • To provide educators with access to timely data they can use to personalize instruction and push their own professional development.
  • To focus professional development on helping teachers use data effectively.
  • To develop teacher licensing and program approval policies that include having instructors prove they possess data literacy.

Advocacy

DQC spoke out in favor of the Strengthening Education through Research Act (H.R. 4366; 113th Congress), a bill to amend and reauthorize the Education Sciences Reform Act of 2002 and authorize the appropriation of $615 million for fiscal year 2015 and $3.8 billion over the 2015-2019 period to support federal educational research, statistical analysis, and other activities.{{cite web|title=CBO - H.R. 4366|url=http://www.cbo.gov/publication/45300|publisher=Congressional Budget Office|accessdate=6 May 2014}}{{cite web|last=Yochum|first=Kristin|title=Strengthening Education through Research Act plans to modernize SLDS program|url=http://www.dataqualitycampaign.org/blog/2014/04/strengthening-education-through-research-act/|publisher=Data Quality Campaign|accessdate=7 May 2014|date=3 April 2014|archive-url=https://web.archive.org/web/20150317211530/http://dataqualitycampaign.org/blog/2014/04/strengthening-education-through-research-act/|archive-date=17 March 2015|url-status=dead}}

Publications

In addition to the yearly reports that DQC publishes based on the DFA, they also have a number of other publications, including one entitled "What Every Parent Should be Asking about Education Data" co-produced with the National PTA.{{cite web|title=What Parents Should Know about Education Data|url=http://www.studentsfirst.org/blog/entry/what-parents-should-know-about-education-data|publisher=Student First|access-date=2013-09-19|archive-url=https://web.archive.org/web/20130831110708/http://www.studentsfirst.org/blog/entry/what-parents-should-know-about-education-data|archive-date=2013-08-31|url-status=dead}}

Other publications include, "Myth Busters: Getting the Facts Straight about Education Data", and a guide about communicating about issues associated with data collection and use in education [https://web.archive.org/web/20150405025923/http://dataqualitycampaign.org/files/Communications%20Toolkit.pdf "Let’s Give Them Something to Talk About: Tools for Communicating the Data Message."]

DQC Founding Partners

See also

References

{{Reflist}}