About Jilliam Joe

This author has not yet filled in any details.
So far Jilliam Joe has created 5 blog entries.

Case Study: Teach For America (Greater Chicago-Northwest Indiana)

Our work with TFA-GCNI resulted in tangible insights into the effectiveness of the programs in driving key outcomes and areas of demonstrated improvement and opportunities for development. Keep reading to discover how we provided third-party evaluation to support continuous program improvement and impact evaluation. Our work with TFA-GCNI resulted in tangible insights into the effectiveness of the programs in driving key outcomes and areas of demonstrated improvement and opportunities for development. Keep reading to discover how we provided third-party evaluation to support continuous program improvement and impact evaluation. WHO THEY ARE: TFA has played an instrumental role in Chicago’s story of progress by finding and supporting diverse and equity-oriented leaders working at all levels of the education system. From the classroom to school leadership to the non-profit and public sector ecosystem that supports students and schools, we know that our network has been a force for change. Today, our network of 3,400 teachers, school leaders, and advocates impact one-third of the population of students in public schools in Chicago. Our corps members and alumni are brave, innovative, equity-minded leaders working alongside students and families to achieve an equitable education [...]

By |2023-07-22T15:13:37+00:00July 22, 2023|Case Study|Comments Off on Case Study: Teach For America (Greater Chicago-Northwest Indiana)

Case Study: The Learning Accelerator

We collaborated with TLA researchers to develop and deliver three measurement instruments. Our focus was to develop measurement instruments that were reliable and action-oriented. Also, we led early validity research with TLA's team to study the structural properties of two of those instruments. Keep reading to discover the solutions we created with The Learning Accelerator's small but capable research team. We collaborated with TLA researchers to develop and deliver three measurement instruments. Our focus was to develop measurement instruments that were reliable and action-oriented. Also, we led early validity research with TLA's team to study the structural properties of two of those instruments. Keep reading to discover the solutions we created with The Learning Accelerator's small but capable research team. WHO THEY ARE: The Learning Accelerator (TLA) is building a world in which each student receives the effective, engaging, and equitable education they need to reach their full and unique potential. TLA is a national nonprofit. Its focus is accelerating individual, organization, and sector learning to transform K-12 education. Now in their 10th year of operation, they’re working alongside educators across the nation. Their primary goal is to advance [...]

By |2023-07-22T14:52:34+00:00July 22, 2023|Case Study|Comments Off on Case Study: The Learning Accelerator

Smart Risks, Big Pay-offs

I celebrated a financial win for one of my clients yesterday. It was a win that was months in the making. As I considered the path we took to get here, one theme came to mind: big pay-offs don't just happen in psychometrics. They take vision, smart planning, clear communication, and a team of competent people who are willing to execute that vision with excellence. Let me give you a little background. Last year my client was challenged with reducing scoring costs for a maturing large-scale portfolio assessment. Anyone who works in psychometrics and with performance-based assessments, particularly those that require human judgment, understands that there are no clearance racks here. It's plain ol' expensive to train and employ people to score complex tasks without bias and in a way that is consistent with scoring guidelines. Let's not mention the price tag that goes along with the systems that support scoring (e.g., software development, master coding, training build). Did I say this is expensive? So, my client and I were tasked with finding creative ways to reduce costs while at least maintaining the quality of the score outcomes. We had to put on our Supergirl capes. Tenet 1 of big pay-offs: Do [...]

By |2017-02-21T16:47:38+00:00February 21, 2017|Uncategorized|Comments Off on Smart Risks, Big Pay-offs

A “Psychome…” who?

psy·cho·me·tri·cian \-mə-ˈtri-shən\ "I measure psychological constructs." Okay... "I measure things about people that are latent" [Insert hand motions]. Okay..."I work on standardized tests...in education." Describing what I do for a living to family and friends can be challenging. The blank stares and gentle nods sometimes reduces my spiel to, "I measure stuff." That really doesn't capture the importance of the work people like me engage in every day. So, give me a few minutes to explain. Let's start with an example that we all can wrap our heads around: a doctor's visit. When you pay a visit to your doctor's office, your vital signs are usually the first to be measured: weight, height, blood pressure, and temperature. Now, consider the instruments used to take your vitals - a scale for weight and a thermometer for temperature, for example. Each instrument had to be designed specifically for its corresponding vital sign. Ever tried weighing yourself with a blood pressure cuff? Probably not. Your body's response to these instruments gives the physician a picture of your general health. The exam isn't limited to what can be measured with a physical instrument, though. Your doctor may ask questions to explore factors that influence [...]

By |2017-02-14T02:49:53+00:00February 14, 2017|Uncategorized|Comments Off on A “Psychome…” who?

Why “Measure by Design”?

My first full-time position after graduate school was with a major testing company. The kinds of highly nuanced research problems, politics, and policies that I faced in this environment were all new and scary as a dark alley. There were project budgets to estimate, research staff to manage, (sometimes shifting) deadlines to meet, limited resources, and real consequences for real people (shout out to all the data simulators). The director of my research group, who quickly became a mentor and friend, shared this bit of wisdom: projects fail in their execution largely because of bad design. Projects and programs fail to meet expectations because someone failed to think around the corners – they under-budgeted, under-powered, or understaffed the venture. I have designed and reviewed dozens of studies, assessments, and survey instruments since then. In every case, the time spent designing and planning was essential to the quality of its execution and outcome. Poorly designed research and assessments remind me of this hilarious moment from the Cosby Show:   Bad design. Awful execution. Failed expectations. It is my passion to partner with researchers and organizations to help them realize their measurement or research goals, and alleviate the frustration that comes when [...]

By |2015-12-16T15:37:55+00:00December 15, 2015|Uncategorized|Comments Off on Why “Measure by Design”?
Go to Top