Knology Anual Report lo7

practical social science for a better world % 2019 Annual Report Photo by Adam Solomon on Unsplash practical social science for a better world Table of contents 3 Welcome from Leaders 5 Critical Thinking 7 Inform & Shape Actions 9 Embody DEAI 11 Strengthen Alliances 13 Refine Our Model 15 Finance Report 20 2019 Knology Team 21 2019 Publications Knology is a non-profit research institute working to empower change-makers with interdisciplinary social science research so they can create a society where all people live to their greatest potential in harmony with a thriving biosphere © 2020 Knology Ltd. tel: (347) 766-3399 40 Exchange Pl. Suite 1403 New York, NY 10005 tel: (442) 222-8814 3630 Ocean Ranch Blvd. Oceanside, CA 92056 2 Annual Report 2019 3 Annual Report 2019 practical social science for a better world For Knology, 2019 was a year of transition Eight years after founding, our transdisciplinary model for pursuing practical social science to advance the public good has gained traction. We started our year with a reinvigorated spirit and a goal of positioning our work for greater success. We dedicated the first half of the year to taking stock of our successes and regrets, seeking feedback from our core partners, and revisiting how we could play a more useful role in creating a better world. John Fraser, PhD AIA President & CEO Joanna Brucker, Ed.M. Chief Operating Officer Leonard Singh, MBA Chair, Board of Trustees We heard from our partners that our value is the ability to situate our work at the broad systems level even when we're working on a single program. We're solution-oriented, which means we pursue our research with a clear eye to how results will be applied. Partners also appreciate that we work as a connector of ideas, people and organizations. We focus equally on research and our commitment to writing accessible stories to ensure our research is in the hands of professionals who can effect change. The process helped us learn that we need to expand our founding practice areas. We spent the year developing a strategy to integrate two new cross-cutting research programs into our framework: a focus on the individual mental processes that drive human behavior, and the policies and structures that constrain or permission interactions in our society. The result is our new model that we outline in the following pages. In the fall of 2019, we completed an extensive process to use the feedback from our partners to redefine our brand and announce our new name: Knology. This was a rather massive investment in pro bono support by a variety of great legal minds and designprofessionals, as well as trademark and communications specialists. Thanks to their effort, we ended the year with filing our new name and rebranding as Knology. We believe our new name, logo, and design strategy captures the joyful inquisitive nature of our team, and clear-eyed practical social science. The following pages are organized according to our new strategic plan, with each section highlighting one of our research areas. At the close of 2019, we were a financially secure non-profit ready to take on even bigger challenges. 4 Annual Report 2019 Critical thinking Use diverse perspectives to challenge the status quo and navigate the great social issues of our time. 5 Annual Report 2019 practical social science for a better world The challenges we face as a society are complex, stemming from multiple sources and exacerbated by many factors. The solutions to these problems must also be nuanced. Knology was founded with a transdisciplinary vision, where we draw from a variety of disciplinary perspectives to study and untangle problems. On the ground, the process can look messy, with researchers debating seemingly disparate approaches to use in any given project. But we are committed to this approach because we believe that the interaction between diverse perspectives makes Knology's team stronger and generates meaningful results. We are able to move past the symptoms and get to the heart of a social issue. The result? Our partners have the tools they need to clearly understand the factors at play and design equitable solutions. Photo by Tom Barrett on Unsplash Culture A Nationwide Study of Competencies Needed for Library Public Programming Public programs have become an increasingly important fixture in US libraries. They offer the public opportunities to develop job skills, socialize, learn how to access information, and much more. But two things were previously unclear: what skills are needed to develop and run such programs, and how do library professionals acquire those skills? With funding from the Institute of Museum and Library Services, we partnered with the American Library Association on a long-term initiativethe National Impact of Library Public Programs Assessment (NILPPA)to solve this puzzle so that the professional field and universities can support this important work. The diverse perspectives of our research teamincluding anthropology, psychology, human rights, and moreas well as input from more than 1,200 library professionals themselves, made this study possible. Our transdisciplinary study was the first to identify a set of unique competencies for library public program professionals. The findings could inform curricula for library training and professional development programs. Read more about the study in the white paper and in an article in the Journal of Education for Library and Information Science here. Read more about the study here 6 Annual Report 2019 Inform & shape action Equip leaders with social science research for evidence-based decisions and meaningful action. 7 Annual Report 2019 2019 practical social science for a better world At Knology, our mission is to provide practical social science for a better world. As we refined our approach as a research non-profit in 2019, it became clear that the kernel of our goal is simple, yet powerful: practical social science. It means that social science research can and should be for everyone, not only locked behind paywalls and kept in ivory towers. It takes more investment from researchers and writers to tell compelling and accessible stories about rigorous social science research for a broader audience. With our new name and updated approach to talking about our research, we are doing just that. The news-style website at Knology.org launched in 2019 is designed to publish our studies in ways that explain how professionals can put the research to work. We also publish our data openly on our own site's archive and National Science Digital Library, as well as contribute to public databases. This year, we started to see success with this approach and anticipate that there are great things to come. Photo courtesy of PBS NewsHour Student Reporting Labs Photo courtesy of EdGE @ TERC Media Making Sure Educational Games Work for Teachers In 2019, we worked on two National Science Foundation-funded research studies focused on equipping education professionals with information to support their teaching in the classroom. Both studies were done in collaboration with the Educational Gaming Environments group at TERC, a leading organization in education research. These studies explored the use of educational games, which are a great way to teach critical thinking and problem-solving skills to learners of many ages. This research focused on Zoombinis, an educational game developed by EdGE@TERC. Specifically, we studied teaching materials and the impact of the game on student learning. We showed that incorporating Zoombinis into the classroom helped teachers broaden participation in two key ways that can be useful for game designers: First, they could personalize the difficulty of tasks for each student. Second, some of the students who excelled at playing the game had struggled in other learning contexts, highlighting the value of using different learning modalities in classrooms. See more about these findings in our report. The second study was a collaboration within an NSF-funded research-to-practice partnership focused on computational thinking. Based on our experience, we published some of the key ingredients to making partnerships between educators and researchers work well. 8 Annual Report 2019 Embody DEAI Strive to integrate principles and practices of diversity, equity, access, and inclusion. 9 Annual Report 2019 practical social science for a better world Justice has always been foundational for our organization. In 2019, Knology's staff and Board formalized this principle as a strategic goal to embody and practice diversity, equity, access, and inclusion (DEAI). To make this aspiration concrete, we developed working definitions of each DEAI component, and outlined goals for three levels of our organization: our workforce (our staff, fellows, and Board), work place (the procedures and culture within our offices), and work community (the partners and research participants we interact with). Key components of this process included recognizing and embracing the multiple identities that all people have, and acknowledging that the aspiration enshrined in the components of DEAI is a lifelong goal we must always work toward. We believe that operationalizing principles of DEAI is an ethical responsibility, one which will also strengthen our research methods and practices. As part of our commitment to transparency, we published our goal and definitions on our website. Read more at https://knology.org/ethics. Photo courtesy of Children & Nature Network Photo by ArkanSONO Wellness Supporting Programs Focused on Inclusion Historically, some career paths have been intentionally or unintentionally structured to reinforce opportunity for certain groups of people based on their privileges. In 2019, we studied efforts to help students from diverse socioeconomic backgrounds and who identify as Black, African American, and people of color develop awareness of biomedical careers, as well as access career paths in STEM and health fields. We joined researchers at the University of Arkansas to study the impacts of a National Institutes of Health-funded program called ArkanSONO. In partnership with Little Rock School District, this program is testing a model for using new, portable ultrasound technology to promote biomedical health careers to diverse students so that the workforce more accurately reflects the US population. Our evaluation investigated how hands-on learning in a real-life health professional environment can have a profound and positive effect on high school students' interests and goals. We also found that learning in a socially supportive environment, as well as interactions with medical students and health professionals, are key factors in engaging students. ArkanSONO is just one project that demonstrates the connection between Knology's commitment to DEAI and real-world practice. 10 Annual Report 2019 Strengthen alliances Invest in people and organizations working toward a common good. 11 Annual Report 2019 practical social science for a better world We have always invested in longstanding collaborations with likeminded partners. In 2019, it became clear that what sustains these collaborations is the focus on shared ideas and working together for a common good. The underlying themes of some of these alliances became the foundation of Knology's new approach: idea-focused initiatives central to each of our research areas. In our Biosphere work, our longtime collaboration with the New England Aquarium informed our Climate Resilience initiative. In our Media research area, our thriving partnership with news teams at WETA / PBS NewsHour has driven our initiative called The New News. Our partnerships with the American Library Association and the Association of Children's Museums inspired our Cultural Institutions & a Thriving Society initiative within our Culture research. The issues that we and our partners work on are complex and require input from various perspectives. Collaborating with multiple organizations around these shared ideas ensures that the solutions we provide are replicable with benefits for society as a whole. Partnerships are central to our model because we recognize that we're more powerful together. Photo by Johanna Montoya on Unsplash Photo by JP Valery on Unsplash Biosphere Supporting Coalition-Building This year, we were proud to take part in the Waterfront Alliance's Resilience Taskforce. The Taskforce was conceived as a large-scale, consensus-building effort to identify key policy and investment needs to build the New York-New Jersey region's resilience to climate change. The Waterfront Alliance and their partners convened a diverse working group to do soincluding residents, leaders in business, labor community and justice advocates, volunteer organizations, scientists, environmental advocates, design professionals, and policy makers. Knology supported this work by co-facilitating three planning meetings, engaging over 300 individuals. We worked with Waterfront Alliance and the Taskforce Co-Chairs to identify the goals of each gathering and develop interactive activities to advance those ideas. At each convening, we helped the Taskforce members set expectations for respectful collaboration and facilitate dialogue around setting priorities. Ultimately, the work of the Taskforce laid the groundwork for the birth of Rise to Resilience, a coalition and campaign for policy change and resilience investments. Find out more at https://rise2resilience.org 12 Annual Report 2019 Refi ne our model Cultivate our collaborative philosophy to make our model resilient and replicable. 13 Annual Report 2019 practical social science for a better world This year was a watershed moment for our organization. We scrutinized every component of our work, asking what we should pursue and the best ways to do it. This ambitious process resulted in a new name and a fresh approach to our work. As we became Knology, we realigned our mission, vision, and set of strategic goals; these pieces formed the backbone of our planning for what the organization should look like moving forward. We conceived of two new research areasBehaviors and Systemswhich conceptualize a spectrum ranging from individual actions to societal structures. These research areas have given us a new framework for pursuing research in our original areas of Culture, Biosphere, Wellness, and Media. Our new website puts forward our vision for practical social science research in a web-first format, where we strive to publish details of our studies in ways that are accessible to professionals working in a variety of sectors. The Knology website also gave us the opportunity to reimagine our data publishing to support the National Science Digital Librarysee our Archive for more information. In parallel, our team engaged in two critical internal processes: a Board development initiative and series of planning meetings focused on diversity, equity, access, and inclusion policies and procedures. All of these components have strengthened our ability to work toward societies thriving together with the natural systems on which we all depend. Photo by Tom Barrett on Unsplash Photo by Jim Strasma on Unsplash Behaviors Systems Putting Research Areas to Work The complexity of societal issues requires nuanced and rigorous study. In 2019, we launched two new research areas. Behaviors research focuses on repeated interactions among individuals that generate widespread social outcomes, while Systems research attends to sets of interrelated rules and practices that form our institutions and societal structures. Right away, we saw the power of incorporating these two lenses into Knology's work. In our National Science Foundation-funded study of STEM learning for the third wave of the Why Zoos & Aquariums Matter initiative, we investigated the role of trust in how the public thinks about and interacts with these institutions. From a Behaviors perspective, we identified new dimensions of people's trust in zoos and aquariums. From a Systems perspective, we studied how zoo and aquarium audiences overall can be organized into clusters according to dimensions of trust. Combined, this research will help zoos and aquariums understand how to better engage with their audiences in STEM learning while continuing to support their conservation agendas. This short video describes the results of the WZAM initiative. 14 Annual Report 2019 Financial stability Annual Report 15 2019 practical social science for a better world Photo by Alexander Schimmeck on Unsplash Statement of Financial Position Year ended December 31, 2019, 2018, and 2017. After eight years of operation, we decided to invest in Knology's future success with a full rebrand that involved updating our design, approach, and online presence. As a major capital investment, the rebranding process was an ambitious fiscal undertaking that required an extraordinary effort on the part of our Board and staff. External factors also played a role in the challenges we faceda United States government shutdown temporarily affected our project work and grant application cycles. Our previous financial planning provided a solid foundation to both support the rebrand initiative and weather volatility in funding sources that are typically steady. We closed the year with modest growth, a positive cash balance and a secured operations budget for 2020. These achievements will enable us to navigate disruptions in the economy to come. As a result, we are proud that in 2019, we remained financially stable and our auditors, PKF O'Connor Davies, once again issued an unmodified opinion. ASSETS Cash Contract service fees receivable Prepaid expenses Security deposit Furniture, equipment & leasehold improvement 2019 $605,802 327,662 1,885 24,670 37,419 $997,438 LIABILITIES AND NET ASSETS Liabilities Accounts payable and accrued expenses Deferred rent expense Loan payable Unearned revenue Total Liabilities Net Assets Unrestricted $121,898 28,267 494,454 644,619 352,819 $997,438 2018 $112,411 342,570 7,557 24,670 25,823 $513,031 2017 $95,441 263,668 11,240 24,375 29,677 $424,401 $86,879 15,777 ---- 31,500 $134,156 $378,875 $513,031 $93,055 ---- ---- ---- $93,055 $331,346 $424,401 16 Annual Report 2019 Statement of Activities Year ended December 31, 2019, 2018, and 2017. Our stability can be attributed to our collaborative strategy for producing social science research for a better world, as well as our growing portfolio of federally funded projects. Of the 35 organizations that we partnered with in 2019, eight were involved in multiple projects as part of long-term research and fundraising initiatives. This cooperative fundraising model broadens the stability of our funding streams, and diversifies our opportunities and the types of funders interested in supporting what we do. Our financial management system was reviewed and approved in 2019 by the National Science Foundation in their Financial Desk Review Process. We are pleased to continue to be able to demonstrate compliance with federal guidelines for grant recipients. Our ongoing compliance was also verified through our Single Audit Process. 17 Annual Report 2019 Distribution of functional expenses REVENUE AND SUPPORT Contract service fees Contributions in-kind Contributions Other income TOTAL REVENUE AND SUPPORT 2019 $1,487,980 64,284 22,270 13,941 1,588,475 EXPENSES Program Services Supporting Services Management and general Fundraising Total Supporting Services Total Expenses Change in Net Assets NET ASSETS Beginning of Year END OF YEAR 1,026,844 475,607 112,080 587,687 1,614,531 (26,056) 378,875 $352,819 2018 $1,439,637 3,844 15,198 10,607 1,469,286 2017 $1,420,941 53,343 29,347 11,647 1,515,278 967,552 374,860 79,345 454,205 1,421,757 47,529 331,346 $378,875 $ 872,730 448,861 71,543 520,404 $1,393,134 122,144 209,202 $331,346 Statement of Cash Flows Year ended December 31. Our rebrand initiative would not have been possible without the contributions of multiple experts and organizations. Design experts were critical to our success: we thank Parle Co. for logo and branding design and Thousand Stars Studio for our website and icon design. We offer our sincere thanks to the following who provided pro bono services: Jon H. Oram and Jason Joffe at Proskauer Rose LLP, L. Danielle Toaltoan and Faith Robinson at Davis Wright Tremaine LLP, Joshua Polacheck, Alyssa Sullivan, and the team at Taproot Foundation. The time and efforts of this incredible group of professionals made our new vision for Knology sing. In September, we launched the Psychology & Our Planet book series, published with Springer Nature, at an official event for New York City's Climate Week. This panel discussion was also an opportunity to showcase our new name and brand. The event was made possible thanks to underwriting from Trust Practice and Risk Management Association (Trust PARMA) a national non-profit organization that supports psychology, mental health, and allied health professionals. We received additional support from Trader Joe's Soho and Essex Crossing, Whole Foods Market Tribeca, and D'Agostino Supermarkets. In 2019, Knology benefited from the non-profit support programs offered by Google, Microsoft, Slack, and Asana. We also thank Qualtrics, our survey software provider, for their support since founding. Cash flows from operating activities Change in net assets Adjustments to reconcile change in net assets to net cash from operating activities Depreciation and amortization Deferred rent Changes in operating assets and liabilities Contract service fees receivable Prepaid expenses Security deposit Accounts payable and accrued expenses Unearned revenue NET CASH FROM OPERATING ACTIVITIES CASH FLOWS FROM INVESTING ACTIVITIES Purchase of equipment NET CHANGE IN CASH AND CASH EQUIVALENTS CASH AND CASH EQUIVALENTS Beginning of Year END OF YEAR 2019 $(26,056) 8,235 12,490 14,908 5,672 -- 35,019 462,954 513,222 (19,831) 493,391 112,411 $605,802 2018 $47,529 2017 $122,144 6,906 15,777 (78,902) 3,683 (295) (6,176) 31,500 20,022 7,215 -- (80,024) (5,277) (9,375) 42,458 (36,021) 10,542 (3,052) 16,970 -- 9,767 95,441 $112,411 85,674 $95,441 18 Annual Report 2019 Distribution of Functional Expenses Distribution of Federal Funding Sources of Revenue 19 Annual Report 2019 2019 Knology Team Knology staff, board members, and audience participants at the Psychology & Our Planet book series event for Climate Week in September 2019. Staff Nezam Ardalan, M.A., Researcher Jena Barchas-Lichtenstein, Ph.D., Researcher Joanna Laursen Brucker, Ed.M., Chief Operating Officer Elizabeth Danter, Ph.D., Researcher Joseph de la Torre Dwyer, Ph.D., Researcher Ian Dougherty, CPA, Chief Financial Officer Martin Feuerstein-Mendik, Intern Shaun Field, M.A., Researcher Kate Flinner, M.A., Manager of Communications John Fraser, Ph.D., AIA, President & CEO Darcey Glasser, Intern Rupu Gupta, Ph.D., Researcher Shivani Ishwar, Intern Olivia Killingsworth, Finance Team Nicole LaMarca, M.A., Researcher Kathryn Nock, B.S., Researcher Rebecca Norlander, Ph.D., Researcher Tawnya Fay Switzer, M.A., Writer Uduak Grace Thomas, M.A., Writer Laura Tietjen, M.A., Researcher & Administrator John Voiklis, Ph.D., Researcher Konstantinos Voiklis, Intern Board of Trustees Leonard P. Singh, Board Chair, Audit Committee Chair Carolyn Gray, Vice-Chair Jenna Hayes, J.D., Secretary Adam Wasserman, J.D., Treasurer Kashif Ahkter, Director Paul Boyle, Ph.D., Director, Research Integrity Officer Robert Davis, DVM, Director Julia Mair, Director Manoj Panjwani, Director Greg Parets, J.D., Director Diana Polak Ph.D. Director Andrea Turner, J.D., Director John Fraser, Ph.D., AIA, President & CEO (ex officio) Research Fellows James Danoff-Burg, Ph.D. Jen Dixon, J.D. MLS Ed Greene, Ph.D. Susan Hannah William Lynn, Ph.D. Kin Kong, Ph.D. Audrey Kremer, Ph.D. Kris Morrissey, Ph.D. Brian J. Plankis, Ed.D Christina Shane-Simpson, M.A., Ph.D. Beverly K. Sheppard, M.A. Shelley Stern, LCSW, Ed.M. 20 Annual Report 2019 2019 Publications Peer-Reviewed Publications Gupta, R., Fraser, J., Rank, S.J., Brucker, J.L. & Flinner, K. (2019). Multi-Site Case Studies About Zoo and Aquarium Visitors' Perceptions of the STEM Learning Ecology, Visitor Studies. DOI: 10.1080/10645578.2019.1661737 Gupta, R. (2019). Just preservation: From vision to reality. Invited commentary in Animal Sentience 27(9). Article available at: https://animalstudiesrepository.org/ animsent/vol4/iss27/9/ Fraser, J., Moussouri, T., Golding, V., & Macalik, J. (2019). Philosophy, art, and social value. Curator: The Museum Journal, 62(1), 5-6. https://doi.org/10.1111/cura.12293 Geiger, N., Gasper, K., Swim, J.K., & Fraser, J. (2019). Untangling the components of hope: Increasing pathways (not agency) explains the success of an intervention that increases educators' climate change discussions. Journal of Environmental Psychology. 66. DOI: https://doi.org/10.1016/j.jenvp.2019.101366 Publications for Professionals NIH 098 - PBS NewsHour: Health Science Literacy Barchas-Lichtenstein, J., LaMarca, N., Feuerstein-Mendik, M., Voiklis, J., Glasser, D. (2019). PBS Health Literacy Topline Report. NewKnowledge Publication #NIH.100.098.08. New York: New Knowledge Organization Ltd. Barchas-Lichtenstein, J., Fraser, J., LaMarca, N., Voiklis, J., Glasser, D. & Thomas, U.G. (2019). Year 3 Evaluation Report. NewKnowledge Publication #NIH.100.098.09. New York: New Knowledge Organization Ltd. NSF 111 - National Network for Ocean & Climate Change Interpretation Voiklis, J., Flinner, K., Fraser, J., Thomas, U.G. (2019). 2018 NNOCCI Network Health Study Report. NewKnowledge Publication #NSF.052.111.35. New York: New Knowledge Organization Ltd. LaMarca, N., Flinner, K., Nock, K., Gupta, R. (2019). NNOCCI 2018 Expert Level Training Pilot Program: Final Evaluation Report. NewKnowledge Publication #NSF.052.111.36. New York: New Knowledge Organization Ltd. NIH 140 - Discover SCIENCE with Dr. Bear Danter, E., Norlander, R.J., Field, S., Ardalan, N., Flinner, K. (2019). Discover SCIENCE with Dr. Bear: Librarian Focus Group Short Results. NewKnowledge Publication #NIH.090.140.02. New York: New Knowledge Organization Ltd. Danter, E., Norlander, R.J., Field, S., & Ardalan, N. (2019). Appendix: Discover SCIENCE with Dr. Bear: Librarian Focus Group Short Results. NewKnowledge Publication #NIH.090.140.02-A. New York: New Knowledge Organization Ltd. Field, S., Norlander, R.J., Danter, E., Ardalan, N., Flinner, K, Nock, K. de la Torre Dwyer, J. (2019). Discover SCIENCE with Dr. Bear: Health Educator Survey Results. NewKnowledge Publication #NIH.090.140.03. New York: New Knowledge Organization Ltd. 21 Annual Report 2019 Field, S., Norlander, R.J., Danter, E., Ardalan, N., Flinner, K., Nock, K., & de la Torre Dwyer, J.T. (2019). Appendix: Discover SCIENCE with Dr. Bear Health Educator Survey Results NewKnowledge Publication #NIH.090.140.03-A. New York: New Knowledge Organization Ltd. Norlander, R.J., Ardalan, N., Danter, E., Field, S., Thomas, U. (2019). Discover SCIENCE with Dr. Bear - Year 2 Evaluation Report: Library-Based Programs. NewKnowledge Publication #NIH.090.140.04. New York: New Knowledge Organization Ltd. Norlander, R.J., Nock, K., Field, S., Ardalan, N., LaMarca, N., Flinner, K., Barchas-Lichtenstein, J. (2019). Discover SCIENCE with Dr. Bear®: Year 2 Evaluation of Dr. Bear®'s Cubs Summer Science Experience. NewKnowledge Publication #NIH.090.140.05. New York: New Knowledge Organization Ltd. NSF 145 - SportsLab:2020 Barchas-Lichtenstein, J., Shane-Simpson, C., Flinner, K., Ardalan, N., Brucker, J.L., Fraser, J., Field, S.,Roberts, S-J., & Nock, K. (2019). Final Evaluation Report: SportsLab:2020. NewKnowledge Publication #NSF.051.145.04. New York: New Knowledge Organization Ltd. Barchas-Lichtenstein, J., Nock, K., Ardalan, N., Voiklis, J., Brucker, J.L., and Flinner, K. (2019). SportsLab: Evaluation for Funding Supplement. NewKnowledge Publication #NSF.051.145.05. New York: New Knowledge Organization Ltd. Barchas-Lichtenstein, J., Nock, K., & Voiklis, J. (2019). Appendix: SportsLab: Evaluation for Funding Supplement. NewKnowledge Publication #NSF.051.145.05-A. New York: New Knowledge Organization Ltd. Barchas-Lichtenstein, J., Fraser, J., Voiklis, J., Field, S., de la Torre Dwyer, J., Feuerstein-Mendik, M. (2019) Topline Report: Post-Harvey Coverage. NewKnowledge Publication #NSF.100.183.07. New York: New Knowledge Organization Ltd. NSF 183 - Experiments in Transmedia Fraser, J., Barchas-Lichtenstein, J., Voiklis, J., Thomas, U.G., LaMarca, N., Nock, K., Flinner, K. & de la Torre Dwyer, J. (2019). Experiments in Transmedia: Studying Techniques for Increasing STEM Content Acquisition by Young Adults: Understanding Early-Career Science News Consumers. Knology Publication #NSF.100.183.08. New York: Knology. Fraser, J., Barchas-Lichtenstein, J., de la Torre Dwyer, J., Voiklis. J. (2019). Appendix: Experiments in Transmedia: Understanding Early-Career Science News Consumers. Knology Publication #NSF.100.183.08-A. New York: Knology. NSF 184 - STEM Matters: Investigating the Confluence of Visitor and Institutional Agendas (WZAM3) Gupta, R., Voiklis, J., Rank, S., de la Torre Dwyer, J., Fraser, J., & Flinner, K. (2019). STEM Learning Ecology: Survey Results. NewKnowledge Publication #NSF.022.184.07. New York: New Knowledge Organization Ltd. Field, S., de la Torre Dwyer, J., Gupta, R., Voiklis, J., Fraser, J., Flinner, K., Nock, K., Barchas-Lichtenstein, J., & Rank, S.J. (2019). Public Discourse about Zoos & Aquariums: Crowdsourced Survey Results. Knology Publication #NSF.022.184.08. New York: Knology. Voiklis, J., Field, S., Gupta, R., Rank, S.J., Fraser, J., Flinner, K., Nock, K., & de la Torre Dwyer, J. (2019). Appendix: Public Discourse about Zoos & Aquariums: Crowdsourced Survey Results. Knology Publication #NSF.022.184.08-A. New York: Knology. Rank, S.J., Voiklis, J., Fraser, J., & Flinner, K. (2019). Research Update: A Matter of Trust. Connect. p. 16. Rank, S.J., Voiklis, J., & Fraser, J. (2019). Trust Matters. Conservation Education Committee Newsletter. 12(2). p. 10. NSF 190 - PBS NewsHour: STEM Student Reporting Labs Fraser, J., Barchas-Lichtenstein, J., LaMarca, N., Voiklis, J., Thomas, U.G., and Flinner, K. (2019). STEM Student Reporting Labs: STEM Engagement through Journalism. Knology Publication #NSF.100.190.07. New York: Knology. Barchas-Lichtenstein, J. (2019). Appendix: STEM Student Reporting Labs: STEM Engagement Through Journalism. Knology Publication #NSF.100.190.07-A. New York: Knology. IML 207 - National Impact of Library Public Programs Assessment Barchas-Lichtenstein, J., Norlander, R., Voiklis, J., Nock, K., Fraser, J., & Danter, E. (2019). Q1 Summary Report: Library Programming Categorization. NewKnowledge Publication #IML.074.207.01.4. New York: New Knowledge Organization Ltd. Barchas-Lichtenstein, J., Norlander, R., Voiklis, J., Fraser, J., Danter, E., & Aromi, J. (2018). Q2 Summary Report: Library Programming Competencies. NewKnowledge Publication #IML.074.207.02. New York: New Knowledge Organization Ltd. Barchas-Lichtenstein, J., Norlander, R.J., Voiklis, J., Nock, K., Fraser, J., & Danter, E. (2019). National Impact of Library Public Programs Assessment: Summative Report. NewKnowledge Publication #IML.074.207.06. Chicago: American Library Association & New Knowledge Organization Ltd. Sheppard, B., Flinner, K., Norlander, R.J., Fournier, M.D. (2019). National Impact of Library Public Programs Assessment: Phase 1, A White Paper on the Dimensions of Library Programs & the Skills and Training for Library Program Professionals. NewKnowledge Publication #IML.074.207.07. Chicago: American Library Association & New Knowledge Organization Ltd. Available at: https://nilppa.org/. NSF 213 - Zoombinis: The Implementation Research Study of a Computational Thinking Game for Upper Elementary and Middle School Learners Barchas-Lichtenstein, J., Brucker, J.L., Voiklis, J., Thomas, U.G., Fraser, J., Shane-Simpson, C., & Field, S. (2019). Cultivating Computational Thinking in Elementary & Middle School Learners. Knology Publication #NSF.051.213.05. New York: Knology. Barchas-Lichtenstein, J., Voiklis, J., Fraser, J., Field, S., Brucker, J.L., Danter, E., & Thomas, U.G. (2019). Appendix: Cultivating Computational Thinking in Elementary & Middle School Learners through Playing Zoombinis. Knology Publication #NSF.051.213.05-A. New York: Knology. NOA 357 - Community Partnership for Resilience LaMarca, N., Gupta, R., & Ardalan, N. (2019). Community Partnership for Resilience: Year 1 Evaluation Report. NewKnowledge Publication #NOA.052.357.01. New York: New Knowledge Organization Ltd. LaMarca, N. (2019). Appendix: Community Partnership for Resilience: Year 1 Evaluation Report. NewKnowledge Publication #NOA.052.357.01-A. New York: New Knowledge Organization Ltd. LaMarca, N., Gupta, R., & Ardalan, N. (2019). Community Partnership for Resilience: Year 2 Evaluation Report. Knology Publication #NOA.052.357.02. New York: Knology. NIH 362 - Mentored Experience to Expand Opportunities in Research version High School Norlander, R.J., Field, S., Nock, K., Ardalan, N., & Thomas, U.G. (2019). METEOR vs HS Year 3 Evaluation Report. Knology Publication #NIH.090.362.03. New York: Knology. EPA 373 - Promoting Education through Action for Conservation of Habitats LaMarca, N., Gupta, R., & Thomas, U.G. (2019). Promoting Education through Action for Conservation of Habitats: Final Evaluation Report. Knology Publication #EPA.052.373.02. New York: Knology. LaMarca, N. (2019). Appendix: Promoting Education through Action for Conservation of Habitats: Final Evaluation Report. Knology Publication #EPA.052.373.02. New York: Knology. NSF 388 - Changemakers: Advancing Community Science Literacy Gupta, R., Nock, K., LaMarca, N., Ardalan, N. (2019). Communities Advancing Science Literacy: Year 1 Evaluation Report. NewKnowledge Publication #NSF.052.388.01. New York: New Knowledge Organization Ltd. LaMarca, N. (2019). Appendix: Communities Advancing Science Literacy: Year 1 Evaluation Report. NewKnowledge Publication #NSF.052.388.01-A. New York: New Knowledge Organization Ltd. Nock, K., LaMarca, N., Ardalan, N. (2019) CASL Community Survey Topline Report. NewKnowledge Publication #NSF.052.388.02. New York: New Knowledge Organization Ltd. NPO 387 - Green Schoolyards for Healthy Communities Initiative Gupta, R., Ardalan, N., LaMarca, N., Glasser, D. (2019). Green Schoolyards for Healthy Communities: Final Evaluation Report. NewKnowledge Publication #NPO.148.397.05. New York: New Knowledge Organization Ltd. LaMarca, N. (2019). Appendix: Green Schoolyards for Healthy Communities: Final Evaluation Report. NewKnowledge Publication #NPO.148.397.05-A. New York: New Knowledge Organization Ltd. IML 415 - Poetry & Science Collaborations in Libraries and Natural History Museums Ardalan, N., Danter, E., & Fraser, J. (2019). Field Work: Poetry Experiences, Science Learning, & Community Anchors. Knology Publication #IML.078.415.03. New York: Knology. Ardalan, N., Danter, E., Fraser, J. & Flinner, K. (2019). The Poets House Guide to Measuring Impacts of Poetry & Science Collaborative Programming. Knology Publication #IML.078.415.02. New York: Poets House. NSF 432 - CodePlay Barchas-Lichtenstein, J., Brucker, J.L., Nock, K., Tietjen, L., Norlander, R. (2019). CodePlay: Year 2 Fall Semester Process Evaluation Brief. NewKnowledge Publication #NSF.051.432.02. New York: New York. New Knowledge Organization Ltd. Barchas-Lichtenstein, J., Brucker J.L., Tietjen, L., & Nock, K. (2019). CodePlay: Year 2 Spring Semester Process Evaluation Brief. NewKnowledge Publication #NSF.051.432.03. New York: New Knowledge Organization Ltd. NPO 456 - Teach Our Cities Learning Ecosystem Field, S., Gupta, R., Ardalan, N., Nock, K., Thomas, U.G. (2020). Teaching Our Cities 2019 Final Report. #NPO.132.456.02. New York: Knology. NIH 472 - Evaluation of Educational Materials about Genetics for Ken Burns Presents The Gene: An Intimate History Barchas-Lichtenstein, J., Voiklis, J., Nock, K., Thomas, U.G. & LaMarca, N. (2019). Genetics in the Classroom: Student & Teacher Needs. Knology Publication #NIH.100.472.01. New York: Knology. NIH 472 - ArkanSONO: A Technology Based Outreach Exposure Program for High School Students Field, S., de la Torre Dwyer, J., Ardalan, N., Glasser, D., Norlander, R., Thomas, U.G, & Flinner, K. (2019). Using Ultrasound to Engage Students in STEM Learning #NIH.170.486.01. New York: Knology Field, S., de la Torre Dwyer, J., Glasser, D., Ardalan, N. (2019) Appendix: Using Ultrasound to Engage Students in STEM Learning. #NIH.170.486.01-A. New York: Knology IML 488 - Capacity-Building for Youth Civic Leadership for Issues in Science and Society (CYCLIST) Glasser, D., Gupta, R., Thomas, U.G, LaMarca, N. (2019). CYCLIST: Literature Review on Youth Civic Leadership. NewKnowledge Publication #IML.052.488.01. New York: New Knowledge Organization Ltd. Glasser, D., Gupta, R., Thomas, U.G. (2019). Year 1 CYCLIST Focus Group Briefing. NewKnowledge Publication #IML.052.488.02. New York: New Knowledge Organization Ltd. LaMarca, N., Gupta, R., Glasser, G., & Ardalan, N. (2019). Building a Community & Exploring Civic Engagement. Knology Publication #IML.052.488.03. New York: Knology. LaMarca, N. & Gupta, R. (2019). Appendix: Building a Community & Exploring Civic Engagement. Knology Publication #IML.052.488.03-A. New York: Knology. IML 495 - Emerging Research on Identity, Representation, & Inclusion in Museums Morrissey, K., Dirk, G., & Fraser, J. (2019). Advisor Update on Emerging Research: Identity & Representation in Museums. Knology Publication #IML.023.495.01. New York: Knology. Morrissey, K. & Dirk, G. (2019). Emerging Research on Identity, Representation, & Inclusion in Museums Bibliography & Abstracts. Knology Publication #IML.023.495.02. New York: Knology. NPO 502 - NewsHour Making Sen$e Evaluation Barchas-Lichtenstein, J., Voiklis, J., Fraser, J., LaMarca, N., Thomas, U.G., Field, S., & Flinner, K. (2019). NewsHour Making Sen$e Final Evaluation Report. NewKnowledge Publication #NPO.100.502.02. New York: New Knowledge Organization Ltd. LaMarca, N. & Field, S. (2019). Appendix: Making Sen$e Final Evaluation Report. NewKnowledge Publication #NPO.100.502.02-A, New York: New Knowledge Organization Ltd. NSF 508 - Big Data Literacy Planning Norlander, R.J. (2019). Community Workshop: Findings & Recommendations. NewKnowledge Publication #NSF.061.508.01. New York: New Knowledge Organization Ltd. NPO 511 - Thinking Money for Kids Norlander, R.J., Glasser, D., Brucker, J.L., Flinner, K., Nock, K. (2019). Design Evaluation Feedback: Thinking Money for Kids. NewKnowledge Publication #NPO.074.511.01. New York: New Knowledge Organization Ltd. Brucker, J.L., Norlander, R.J., & Nock, K. (2019). Appendix: Design Evaluation Feedback: Thinking Money for Kids. NewKnowledge Publication #NPO.074.511.01-A. New York: New Knowledge Organization Ltd. Norlander, R.J., de la Torre Dwyer, J., Nock, K., Thomas, U.G., Brucker, J.L. (2019). Baseline Study: Thinking Money for Kids. NewKnowledge Publication #NPO.074.511.02. New York: New Knowledge Organization Ltd. Norlander, R.J., Brucker, J.L., de la Torre Dwyer, J. (2019). Evaluation Plan and Instruments. NewKnowledge Publication #NPO.074.511.03. New York: New Knowledge Organization Ltd. Norlander, R., Nock, K., Brucker, J.L. Field, S., de la Torre Dwyer, J., Thomas, U.G. (2019). Thinking Money for Kids: Topline Report Cohorts 1 & 2. #NPO.074.511.04. New York: Knology. NPO 518 - New Americans Library Project Barchas-Lichtenstein, J., Nock, K., Norlander, R., Brucker, J.L. (2019) New Americans Evaluation Report. NewKnowledge Publication #NPO.074.518.02. New York: New York. New Knowledge Organization Ltd. Flinner, K. Norlander, R. J. Nock, K., Brucker, J. L. Welch, M. (2019). Library Programs & New Americans: A White Paper. NewKnowledge Publication #NPO.074.518.03. Chicago: American Library Association & New Knowledge Organization Ltd. NPO 525 - Breaking the Code Field, S., Nock, K., Barchas-Lichtenstein, J., de la Torre Dwyer, J. (2019). Topline Report: Breaking the Code February Camp. NewKnowledge Publication #NPO.144.525.02. New York: New Knowledge Organization Ltd. Barchas-Lichtenstein, J., de la Torre Dwyer, J., Thomas, U.G., Brucker, J.L., Nock, K., & Voiklis, J. (2019). Girls Explore Coding & Careers. Knology Publication #NPO.144.525.03. New York: Knology. Barchas-Lichtenstein, J., Voiklis, J., Brucker, J.L., de la Torre Dwyer, J., Nock, K. (2019). Appendix: Girls Explore Coding & Careers. Knology Publication #NPO.144.525.03-A, New York: Knology. IML 568 - Association of Children's Museums Trends Series III Flinner, K., de la Torre Dwyer, J., Field, S., Nock, K., & Fraser, J. (2019). How Are Foundations Investing in Children's Museums? ACM Trends 3(1). New York: Knology & Association of Children's Museums. Flinner, K., de la Torre Dwyer, J., Field, S., Nock, K., & Fraser, J. (2019). Changing Priorities in Foundation Grants to Children's Museums. ACM Trends 3(2). New York: Knology & Association of Children's Museums. Flinner, K., de la Torre Dwyer, J., Nock, K., Barchas-Lichtenstein, J., Field, S., & Fraser, J. (2019). Measuring Diversity in Children's Museums & Their Communities. ACM Trends 3(3). New York: Knology & Association of Children's Museums. NPO 578 - Film Independent Evaluation Workshop Barchas-Lichtenstein, J., Brucker, J.L., LaMarca, N. (2019). Opportunities for Evaluation. Knology Publication #NPO.172.578.01. New York: Knology. NPO 586 - NY-NJ Harbor Resilience Task Force Facilitation Gupta, R., Flinner, K., & Fraser, J. (2019). Task Force Meeting 1: Recommendations. NewKnowledge Publication #NPO.171.586.01. New York: New Knowledge Organization Ltd. DOS 596 - Global Media Makers Year 4 Ardalan, N., Barchas-Lichtenstein, J., Brucker J.L., & Nock, K. (2019). Year 4 GMM Media Landscape Interviews. NewKnowledge Publication #DOS.172.596.01. New York: New Knowledge Organization Ltd. Nock, K. (2019). Appendix: Y4 Media Landscape Review & Lab Fellows Interviews Knology Publication #DOS.172.596.01-A. New York: Knology. NPO 622 - Cleveland Metroparks Zoo Conservation Psychology Project Gupta, R., & Thomas, U.G. (2019). Communicating Effectively about the Illegal Wildlife Trade: Conservation Psychology Research Plan. Knology Publication #NPO.176.622.01. New York: Knology. Gupta, R., Thomas, U.G., & Ardalan, N. (2019). CMZ Final Report: Capacity Building for a Conservation Psychology Program. Knology Publication #NPO.176.622.02. New York: Knology. Gupta, R., & Thomas, U.G. (2019). Appendix: Capacity Building for a ConservationPsychology Program. Knology Publication #NPO.176.622.02-A. New York: Knology. PRC 679 - ClearHealth Costs Workshop Fraser, J., Barchas-Lichtenstein, J., Thomas U.G., & LaMarca, N. (2019). ClearHealthCosts' Evaluation Workshop: Assessing Impact. Knology Publication #PRC.183.679.01. New York: Knology Ltd. 22 Annual Report 2019 tel: (347) 766-3399 40 Exchange Pl. Suite 1403 New York, NY 10005 tel: (442) 222-8814 3630 Ocean Ranch Blvd. Oceanside, CA 92056 designed by: mark ernst ernst-design.com