Overview and key findings: Data dashboards

Written by Mica Pollock, Jedd Cohen, and Josh Wairi for the dashboard project, with initial dashboard development by local technologist Seth Woodworth with Evan Burchard, and final development for piloting by David Lord of San Diego

Click here for the Summary on this project; click here for the Expanded story on this project.

Communication we hoped to improve

What aspect of existing communication did we try to improve, so that more people in Somerville could collaborate in young people's success? How’d it go?

(Who was involved in the project and how was time together spent? What did the project accomplish?)

In an era when you can log on to any computer and get quick updates from friends, shouldn't the people who need to see basic data in order to serve young people be able to see it immediately?

Quantitative measures or summary data about young people (e.g., students' absences; their credits; a report card) never show "the whole child": eportfolios can help with that. But such basic measures still provide information crucial to the process of tracking student progress, and they do tend to predict things like graduating or “dropping out.”

Unfortunately, access to the data systems needed to provide this info varies widely among districts. Some districts and schools that can afford it are investing in sophisticated data systems made by private companies. Resource-strapped districts and schools often can’t afford to. And when districts do have online data display tools, they typically aren't designed by educators or parents to be as useful as possible. In Somerville, teachers and administrators said they couldn’t easily view or sort patterns in student data because that data was buried in different “fields” in the student information system (SIS), which Somerville couldn’t afford to replace.

We - local researchers and a teacher (Wairi), and several local technologists - have been working with the teachers' families, related afterschool providers, and two principals (with the ongoing advice of central administration in the Somerville School District), to meet the need for a user-friendly, affordable way to view lots of student data in one place. The result of our work is a suite of three “data dashboards” - open source web applications designed to let family, teachers, principal, and afterschool providers view data they need to see quickly, to support them in communication about each student’s success. We'll be piloting two of the three - for administrators and teachers - in Somerville this winter, 2012. The code for these two and for the third view, for families, is linked at the end of this page, available to anyone.

Considering who usefully sees what data on children has been core to the dashboard project so far. Guided by a collaborative design process that drew on representatives of all the community stakeholders above, Somerville technologists Seth Woodworth and Evan Burchard created the core of three views: an “admin view” for principals, which shows data on all students in the school; a “teacher view,” which shows a teacher data on the students in his or her class; and an “individual view,” designed to link teachers, afterschool providers, and families in communication about the details of an individual student’s profile. Our plan has been to pilot each of these views at Somerville’s Healey School this fall: 5th grade teacher (and author) Josh Wairi and his parents have wanted to pilot the individual and teacher views, and Principal Purnima Vadhera has wanted to pilot the admin view. Technological development went slower than we hoped -- always an issue in making tools from scratch, especially on a budget -- and so we'll end our Phase 1 by piloting the first two of these three views. David Lord, a fabulous young developer in San Diego, has finished the views for us for free.

We felt that it was crucial to collaborate with the Somerville community to design open-source educational tools that link the partners in young people’s education in regular communication about their learning. Here are the main reasons:

A gap in student data equals a gap in service.

Principals Vadhera and DeFalco, teacher Josh Wairi, and various students we talked to in our other pilots all mentioned instances where a student “fell through the cracks” because of a piece of missing data -- for example, a student who received an unexpectedly poor grade at the end of the semester, with the parent, the homeroom teacher, or the administrator surprised by the news. These main partners also described how seeing new patterns, and faster, could support timely interventions -- from MCAS accommodations to targeted academic support.

One-Stop Shopping: It seems crucial to be able to see different kinds of student data at the same time, in a single display.

To clarify: Somerville, like a typical district, already has a “student information system” - a database that stores or “warehouses” student information. The issue is that such data have been hard for people to view quickly all in one place. Many schools as well as afterschool programs do not have easy tools for quickly displaying basic information to multiple partners at once, for putting that data all in one place for viewing, or letting them sort the data for patterns. Our "dashboards" have been designed to sit on top of the student information system for easy viewing OF data. In Somerville, while the data on these "dashboards" all exist in Somerville's student info system, lots of people still talked about the need to improve data display for parents and students, teachers, afterschool providers, and administrators.

The dashboards are designed to be automatically updated: Each week, the district's chief of data can send us updated data files, and when we receive them, they can be automatically uploaded into our dashboards.

In Somerville, administrators have had to send data analysis requests to a central office (filled with great staff!) and the staff would send patterns back to them. Or, teachers had to create their own Excel spreadsheets or printouts and analyze them by hand. Administrators also told us of time wasted in meetings as staff flipped through multiple folders or drawers to find data; further, staff wasted lots of time preparing for meetings by trying to analyze by hand the patterns across such data sources.

The data was inaccessible for other reasons, too: when they could access the student information system with a password, many parents and some teachers had a hard time understanding the way the system displayed data, and the data is only in English. And finally, the data display couldn't easily launch a conversation between the people in a student's life: many viewers (e.g, parents) cannot comment ON the data in the student information system, but can only view it.

Finally, even in districts that have created expensive data display systems, often the problem is getting staff to actually use the system. So, we wanted to try to design tools to community specifications.

Here was another key piece of our logic in designing dashboards for Somerville from scratch: Rather than suggesting that Somerville buy a tool "off the shelf," we decided to develop an open source data viewing tool because we figured an open source tool (made with "free to modify" software modifiable by any skilled programmer anywhere) could save Somerville and other districts lots of money.

Open source data tools could save schools across the country significant costs, IF design goes fast enough, IF community users are ready to use the tools, and IF tech support for open source tools remains available locally.

Others had offered to make Somerville data-viewing tools for hundreds of thousands of dollars, and then require tens of thousands of dollars for annual upkeep. We figured that with our grant, we could work with a local technologist to develop an open source tool to educators' and parents' specifications; any next district or developer could then have the software for their own use.

Our logic: If open source development produces a free tool, districts don't have to buy the product itself or renew the license to use it. Those using free tools only have to pay for services (upkeep and troubleshooting the tool), which can be a fraction of the cost. Our local technologist Seth put it this way: “Take the quarterly profit of a company like Blackboard INC (Quarter 1, 2010) and break it down into services and license fees. In just one quarter, Blackboard made only $7.3 million in services [tech support], but made $93.7 million dollars in 'product revenues' (licenses to run their software). In the K-12 context, a freely available and documented open source competitor to store-bought communication tools would free up a lot of money back to US schools.”

Districts also pay lots of money for store-bought, "off the shelf" dashboard tools and then find them unused by the community. We wanted to try to build something to community specifications instead.

Based on a model created in Excel by Healey dad Greg Nadeau, and designed in partnership with Principals Jason DeFalco and Purnima Vahdera and teacher Josh Wairi during the 2010-2011 school year, the admin and teacher view dashboards we made are designed to provide quick views for teams of teachers and administrators to compare students in a group and discern patterns. All data fields are visible on one screen, so there is no need to click through multiple windows to view the desired data (as users do to see data in the district's student information system). Viewers can sort up to three columns at a time simply by clicking at the top of each while holding down the shift key. Whereas the admin view lists all students in the school, the teacher view presents similar information for a single class of students. Here is the admin view, with fictional data to maintain confidentiality:

NewAdminDash.jpg

Our individual view (below) is designed to be used by educators, parents, and afterschool providers; it complements the "admin" and "teacher views" with additional student data that was identified by Healey parents, students, afterschool providers, and teachers as being especially relevant to their communications with each other.

Importantly to the OneVille Project, this "individual view" also is designed to give parents and afterschool provider viewers the chance to comment ON the data and send these comments to the teacher's email inbox, sparking an exchange that can continue over email or in person. The screens have a minimum of extra words, to enable translation for piloting. Here is the individual view’s final page, where viewers can review and submit their comments:

Note the tabs for viewing other pages at the top of the screenshot. The images below show the pages connected to each of these tabs, covering grades, test scores, attendance, and teacher summary comments.

In creating the individual view, we drew on a data display model from the New Visions schools in New York (http://www.hfrp.org/var/hfrp/storage/fckeditor/File/9thGradeTracker.pdf) combined it with Somerville’s locally designed K-6 report card, and worked with teacher Josh Wairi and his families (with advice from his students and afterschool providers) to integrate everyone’s insights into the testable product.

Our goal in fall 2011-12 has been to pilot and tweak these three tools with a group of interested educators, administrators, families, students, and afterschool providers. We have all wanted to now explore the ways these tools actually can support information-sharing and conversation among all these people, in meetings, one-to-one interactions, and email-based conversations about the data.

In all this, we've encountered the core problem with designing and creating tools from scratch, to community specifications and on a budget: relying on individual technologists rather than large companies. While our local technologist worked to produce tools to community specifications, he went too slowly, leaving us unable to pilot the dashboard. We were fortunate to find another technologist, David Lord, based in San Diego, to finish the admin and teacher dashboard views for free. Although he is not available to provide long-term technical support to the Somerville Schools for free, he has made these two views ready for a short pilot.

Even if the tools don't seed in Somerville in the end, the open source code can support next efforts at free educational data displays for districts or programs too often spending fortunes on storebought tools. Our entire Ford grant would have been eaten up in buying Somerville a tool off the shelf. Instead, we have added a tool to the “kit” by producing an open source dashboard and code next developers can modify. Still, we note that the OneVille projects in which we used preexisting tools – Google sites or wikispaces for eportfolio software, and texting software like Google Voice – seeded the most longstanding local change most quickly and actually got people communicating.

We note that professional (more expensive) open source developers able to produce tools more quickly, or local technologists on larger budgets, might provide more immediately ready open source infrastructure for schools and districts. For example, after the same local young technologist struggled to complete our Parent Connector Network hotline, the hotline was finally made rapidly by Leo Burd, a new colleague at MIT's Center for Civic Media who specialized in such open source tools and was inspired enough by the Parent Connector project that he did it for free.

Our work, and our ¡Ahas!

What was the basic groundwork needed to support the current work? How did the project change and grow over time? At this point, what are our main ¡Ahas! about improving communications in public education? What communication and implementation ¡Ahas! and turning points did we have over time?

Our main ¡Ahas! over time have been these:

¡Aha! A gap in student data equals a gap in service.

¡Aha! One-Stop Shopping: People say it's crucial to be able to see different kinds of student data at the same time, in a single display.

¡Aha! Open source data tools could save schools across the country significant costs, IF design goes fast enough, IF community users are ready to use the tools, and IF tech support for open source tools remains available locally.

¡Aha! The families whose children most need assistance are often the hardest to reach with technology, but they are also the most in need of such rapid access to information. Rather than say parents "won't use" technology, how about training?

Communication and implementation ¡Ahas!, and turning points!

We had many ¡Aha! in sequence on this project over two years. To read the full story of the efforts that gave us these ¡Ahas!, click here!

In addition to our Main ¡Ahas! about data dashboards, we had other key discoveries along the way:

¡Aha! In addition to having the ability to quickly see and sort such basic data, diverse partners in young people’s lives need supports to communicate ABOUT basic data.

¡Aha! Many parents welcome an invitation into a conversation with their child’s teachers, and even if these parents are unfamiliar with technology, these parents often see technology as an opportunity for connection, rather than an obstacle.

Our products: Concrete communication improvements and next steps

Throughout the design process, we’ve gotten feedback from parents, teachers, and administrators about the dashboards’ potential value. In recent interviews, for example, several immigrant parents emphasized the way the individual view dashboard could spark parent involvement: Smiling, one said, "Parents are not just left out of the school. With this, you are bringing them in, sucking them into the school curriculum!"

In a recent planning meeting with OneVille staff, Principal Vadhera described the value of the integrated dashboard tools, in contrast to the old system of requesting info from many different people: “Right now, in just five minutes, I have seen a complete picture of the kid. Without even checking in with folks [other staff]. Normally, I would have to wait for them to get back to me, and bring charts and graphs to meetings. What a great way to launch conversation.”

Purnima and Josh both suggested that the dashboards could enhance teamwork among educators at Healey: In staff team meetings, access to each view could allow teachers and administrators to collaboratively assess a student’s needs, design targeted interventions, and, if desired, record their plan by submitting it as subject-specific comments that get archived in the homeroom (lead) teacher’s email.

The families whose children most need assistance are often the hardest to reach with technology, but they are also the most in need of such rapid access to information. Rather than say parents "won't use" technology, how about training? We’d need to continue training outreach on the dashboards during a pilot phase, because we face the same challenges with the individual view as anyone working to enhance collaboration around students across barriers of income, racial/ethnic background, language difference and tech literacy. Not all parents have home access to computers and internet (though phones with internet access are increasingly popular), and some parents are not functionally literate in their home language. These communication barriers block parents from understanding data even if it is on paper or shared verbally; technology training at least offers parents skills for checking data on demand.

While we may not pilot the dashboard in a broad way this fall, our plan stands to work this year with the Healey PTA to create a model of basic computer and email training run by parents for other parents who need this support. Our goal was to link this training to the dashboard training for parents; instead our hook will be the school's new, parent-created schoolwide listserv. We’ve already established a computer in the PTA room, available for parent use at prescheduled times, and we've established daily availability of the computer lab in the local housing project. We’ll be reaching out in particular to parents in Mr. Wairi’s new class about how to support them to access the Internet.

The ultimate lesson here involves the timeline of software development, and the risks associated with community-based design research if one is literally designing a new technological tool from scratch. Developing a software application from scratch means lots of work on the developer's end without immediate use by the community partner, unless major funding remains to keep modifying the product over time. The reality is that the young local technologist who created these products to community specifications went too slowly, on our limited budget, to create a financially sustainable tech solution for Somerville. We might lose confidence in local open source development, but the reality is that a tool for easily seeing data "all in one place" otherwise will not exist in Somerville due to the expense of "off the shelf" tools. We're optimistic that even if not right now in Somerville, another community and next developer can pick up right where we left off, rather than starting from scratch like we did. That's how open source development works, in fact. The code for these dashboard products is now available online and free to the next developer (see Technological How-Tos in Overview and key findings ).

Questions to Ask Yourself if You’re Tackling Similar Things Where You Live

What big issues would we recommend others think about in their own attempts to improve communications in public schools? Contact us to talk more!

Here are some questions to ask yourself if you want to tackle similar things in your school:

➢Can everyone who needs to get and share important progress information, get and share it when they need to?

➢If not, what barriers are in the way and how can those be overcome?

➢To support young people, what “data” should show up on any data display, and why?

➢What data isn’t found in any “student information system” but should still be known?

➢What infrastructure would support actual conversations ABOUT "data," between the people who share young people? Which conversations should happen in person and which could be supported online? Could you do an experiment to test which works for what?

➢Is your district spending tons of money on data display tools to get basic data in front of people?

➢ If so, how might low cost tech development or professional development on the tools you already have support such information-sharing?

➢ ***How can you ensure resources for ongoing tech modifications and tech support after you have developed your initial tool?

Technological how-tos

Here's where we describe "how to" use every tool we used, so that others could do the same. We also describe "how to" make every tool we made!

Admin/Teacher View Source Code (written in the Django framework)

Individual View Source Code (written in the Ruby on Rails framework)

Since the individual view is not quite complete, and since we want to fully communicate our vision to future developers, here are links to the complete information for this tool:

Here is the link to the application as it currently stands.

Here is the login info: email: mary@oneville.org

password: marypassword

and here is a link to the list of remaining to-dos that would optimize its usefulness.

Click here for the Summary on this project; click here for the Expanded story on this project.