Manager, Program Evaluation

New York Road Runners | New York, New York

Job Summary

This role is designed to increase the quality, value, and impact of our youth and community programs through rigorous management, measurement, and resulting recommendations. Driving the highly collaborative outcome management process throughout the organization, exceptional skills in leadership, communication, and data collection and analysis are required. This job presents a unique opportunity to become a prominent member of NYRR’s strategy team, helping to assess and shape our nationally-recognized programs in youth running and fitness.

http://www.nyrr.org/about-us/careers

Responsibilities

Data Collection

  • Define business and technology requirements for data collection across multiple platforms and workflows
  • Design and build new data entry screens, views, queries, and reports, ensuring all business requirements are met; perform usability and data validation testing
  • Develop intuitive training manuals, lead user trainings, create user accounts, and provide ongoing technical support
  • Coordinate cross-functionally the development and implementation of technology tools
  • Collect data on stakeholder experiences and opinions
  • Develop, test, and administer data tools (surveys, interviews focus groups, etc.) to key program stakeholders

Data Analysis and Reporting

  • Clean and merge data from multiple sources
  • Create technical documentation outlining data sources and data extraction protocols
  • Execute quantitative (descriptive statistics, means testing, and multivariate analysis, e.g. ANOVA) and qualitative analysis (e.g. analysis of observation, focus group, interview, and textual data) to track progress against key program milestones and outcomes
  • Identify and pursue areas for additional analysis
  • Present results in a communicative, digestible and visually appealing way that is appropriate for internal and external report audience(s), including tables, graphs, and maps
  • Provide accurate and timely responses to ad hoc data and analysis requests from various NYRR departments
  • Communicate programmatic insights to senior leadership, board, and other NYRR constituents
  • Support program managers in communicating successes and areas for improvement to frontline staff and key program partners

Research

  • Ensure compliance with all NYC DOE Institutional Review Board (IRB) requirements (including administration of staff training and fingerprinting, administration of consent/assent forms, maintenance of data privacy and security measures, submission of research results, etc.); complete IRB application for research as required
  • Advance knowledge sharing within the health and wellness field by presenting research at industry conferences
  • Work with external researchers as opportunities arise to collaborate on health and wellness investigations
  • Work with other individuals and teams at NYRR on research projects as the need arises

Strategic Collaboration

  • Nurture a culture of continuous learning: help motivate and support staff, in conjunction with the Senior Vice President of YCS, the Senior Manager of Program Development, and other members of senior leadership, to do the hard work of reflecting on what is and isn’t working, and adapting/problem solving to improve outcomes for the children we serve
  • Serve as a key resource and strategic thought partner to senior leadership throughout the organization
  • Lead process of conceptualizing and executing revisions to existing outcome frameworks and tools, as necessary

Qualifications

  • Minimum undergraduate degree in quantitative field and/or successful completion of relevant coursework in statistics, analytics, and/or program evaluation (must be able to conduct ANOVA analysis on pre-/post-survey data, present the data in a visually compelling and digestible way for a non-technical audience, and interpret the results for our team)
  • 3-4 years of experience with quantitative/qualitative data analysis, including at least one year in a leadership role
  • Demonstrated leadership capabilities
  • Exceptional analytical and strategic cognitive skills
  • Outstanding communication and collaboration skills, including the ability to work both independently and across multiple departments/functions
  • Excellent organizational skills and the ability to manage multiple projects simultaneously
  • Strong ability to translate data into practical, actionable insights and recommendations for program managers
  • Proficiency with Microsoft Excel, Word, and PowerPoint
  • Heart, humor and an appreciation for the value of physical fitness and NYRR's mission
  • Interest in running and/or fitness a plus

Requirements/Other

Preferences:

  • Experience with outcome management
  • Demonstrated competency in organizational change management
  • Experience related to youth services and/or fitness programming
  • Familiarity with the NYC Department of Education