Business Plan Projects -- COS develops and maintains infrastructure to support scientific practices, fosters open science communities of software developers and researchers, coordinates collaboration among stakeholders in the scientific process (journals, funders, IRBs, societies), conducts research on the scientific process (metascience), and creates incentives for replication and increasing reproducibility of scientific results. These projects promote open science, evaluate or improve reproducibility of scientific findings, and improve the alignment of scientific practices to scientific values. All projects are interdisciplinary or are models to replicate across disciplines. Center for Open Science COS _f50a94vc-3f02-1e10-b991-79167a64bc2a COS Personnel Personnel and Organizational Structure COS Director Infrastructure architect, developing collaborations, promoting open science, communication, project leadership, funding COS Director of Business Operations COS Chief Technologist Lead of infrastructure team, lead developer COS Infrastructure Team Professional software developers plus consultants and open source community contributors. Infrastructure development and maintenance COS Scientific Board. Senior leadership across scientific disciplines and interest groups - scientists, societies, journals. Advises center activities and facilitates connections and collaborations across the scientific community. COS Technology Board Senior leadership in technology community, particularly open source, open practices, and start-up open science culture. Advises COS activities and facilitates connections and collaboration across infrastructure projects. COS Admin Team. Business managing, project coordination and support, conference organizing and support, administrative tasks for center and projects COS Project Directors Academic researcher leads for metascience and replication projects. Postdoctoral researchers on staff and grantee academics with university positions COS Researchers Academic researchers contributing to metascience and replication projects. Faculty, postdocs, and graduate students at universities supported by COS grants, and post-undergrad staff research assistants COS Fellows Academics, technologists, journalists, funders, society leadership. Short-term visits at Center for special projects. f348055e-9cef-4de0-a2a6-9b90c1b18282 To increase the openness, integrity, and reproducibility of scientific research eddfdbd2-894d-4ce5-a9a9-27b226e7691e Technology COS is a technology start-up with a non-profit agenda. COS is dynamic, innovative, aspirational, high-energy, charitable, and service-oriented. Non-Profit Agendas Dynamism Aspirations High-Energy Charity Service-Orientation Inclusiveness COS is inclusive. COS serves the scientific community. COS staff are coordinators and contributors to the broader open science community. Coordination Contribution Collaboration COS is collaborative. COS shares, reuses, and integrates. Products and projects are open-source. COS seeks to link with other projects and infrastructure rather than reinvent them. Sharing Reuse Integration Linkage Respect COS respects people. COS appreciates persons for their contributions, not their status. Hard Work COS is a work hard, love what you do atmosphere. Engagement is bolstered by investing in projects that can make a difference. Enjoyment Engagement Investment Openness COS aims to live up to the values it preaches - openness, strong communication, collaboration, dedication to mission and team, respect. Communication Dedication Teaming Scientific Values Increase prevalence of scientific values - openness, reproducibility - in scientific practice eb943c8a-f96a-4e74-9494-9fb01e9219e7 1 Reproducibility Project Examine the rate and predictors of reproducibility in psychological science. 4611c2bb-957d-4008-90a2-06986422eaf4 1.1 Open Science Collaboration Project Science Nature Chronicle for Higher Education Reproducibility is a defining feature of science. However, because of strong incentives for innovation and weak incentives for verification, direct replication is rarely practiced or published. The Reproducibility Project is an open, large-scale, collaborative effort to systematically examine the rate and predictors of reproducibility in psychological science. The results will provide the first empirical estimate of reproducibility, and will identify predictors of reproducibility. The project's inception and progress has been covered in Science, Nature, and the Chronicle for Higher Education. COS supports the administration of the project, provides targeted funds for replications, and will promote the project adaptation to other sciences 11e64cc5-0c9c-469c-a858-9d309b69a9f3 Replication Value [Create a] statistic to guide resource allocation for replication efforts. 9f1f36b1-034d-41e7-9645-b31e33edb53e 1.2 Daniel Lakens Open Science Collaboration project; Daniel Lakens, Coordinator Present publishing incentives value innovation almost exclusively at the expense of verification. Increasing incentives for verification will make replication more common. However, it is not feasible or desirable to replicate all research. Replication Value (RV) will be a statistic to guide resource allocation for replication efforts. It identifies which findings are having substantial impact, but are not yet estimated precisely. An effective statistic will guide researchers and journals in the selection and evaluation of replication projects. a2fff10d-f928-403c-a50c-8985e56cf1d7 Metascience Grants Provide small grants to scientific research about science. 7aaba326-08c6-43b9-a53f-34739e9cde89 1.3 Starter grants for metascience research. COS will provide small grants to scientific research about science. These include, for example, archival studies about publication practices, testing interventions to increase the reproducibility of research results, evaluating novel publishing or peer review practices, investigating the effects of pre-registration, and comparative evaluation of open versus closed scientific practices for knowledge building. 62cbeeb7-17ef-4842-a38a-65d78e26735e Research Materials Develop and maintain infrastructure for documentation, archiving, sharing, and registering research materials 85cb193b-aea7-40d6-8be7-52791e26dc4d 2 Archival Project Investigate publishing practices, frequency of replication, effect sizes and power, and other issues related to reproducibility and confidence in research findings. d15ea9fd-789b-42f8-b4c7-fa6d5bd8538e 2.1 Roger Giner-Sorolla Open Science Collaboration project; Roger Giner-Sorolla, Coordinator Psi Chi Psi Beta An investigation of present publishing practices, frequency of replication, effect sizes and power, and other issues related to reproducibility and confidence in research findings. Two national psychology honor societies - Psi Chi and Psi Beta - have signed on to make this a national project for their chapters and members. The massively crowdsourced research design will enable coding of a substantial sample of journals and articles and produce a dataset useful for many investigations of current publishing practices to inform efforts for innovation and improvement. c901ca84-fdc1-473f-954a-b498db10930a Scientific Workflow Join infrastructures to support the entire scientific workflow in a common framework dee0963f-688c-4c12-8a16-f629bd3bc971 3 Open Science Framework (OSF) Support open science objectives across disciplines. 44796ac3-c63f-4cc7-82ef-60e6a5898354 3.1 Researchers Research Funders Journals IRBs OSF is the central infrastructure for the COS to support open science objectives across disciplines. Researchers use OSF to collaborate, document, archive, share, and register research projects, materials, and data. OSF respects and supports the scientist's workflow. OSF will connect solutions for improving scientific practices and provide incentives for researchers to use the system and practice openly. Funders, journals, and IRBs will encourage or require researchers to use OSF to meet open science or reproducibility objectives. 5e39ee04-6470-4356-9a79-ab3e12a4445e APIs Connect infrastructure with APIs so that researchers can access many services through a single framework. 33fb0fbc-4a61-4051-8152-e91b0032de83 3.2 APIs connecting open science infrastructure. There are many groups developing infrastructure to facilitate open science. Rather than pursue redundant, competitive development, COS will aim for collaborative relationships and integration. OSF will connect infrastructure with APIs so that researchers can access many services through a single framework. Researchers will benefit with choice and services in a single workflow, infrastructure developers will benefit by focusing their development and support on their core competencies rather than needing to reinvent the operational tools around it. 3d82aff2-d2ad-420a-b22d-93fd26d50934 Grants Provide small grants to groups creating new infrastructure to support open science practices. 3ceba7a9-62f2-492d-bdc1-cd14a9dbcdf4 3.3 Starter grants for infrastructure development. COS will provide small grants to groups creating new infrastructure to support open science practices. Grants from COS will be limited to open solutions - open-source, creative commons licensing - rather than supporting commercial ventures. 59fa6714-5be0-4fa3-9ce1-b07815443c8a Community Foster an interdisciplinary community open science developers, scientists, and organizations 0660f5d6-ad75-4150-b128-ca85f66e531a 4 Open Science Developers Open Science Scientists Open Science Organizations Open Developer Community Establish an open developer community. 4be6d323-7640-4484-b616-87f1584efebf 4.1 Open Developers Open science developer community. Many infrastructure projects in development outside the COS will increase openness in science. Establishing an open developer community will enhance collaboration and interactivity among these siloed efforts. This is particularly important for establishing an interdisciplinary open science infrastructure that accounts for the entire researcher workflow. COS hosts conferences, supports short-term personnel exchanges between groups, provides administrative resources, and facilitates integrating functionality across projects. 9b91cae7-6472-4b19-8f32-f5197ef3c293 Open Science Community [Support an] open science researcher community cf8b63a5-b2ee-45a7-b8a0-7bcc2a8f0996 4.2 Open Science Researchers Open science researcher community. In parallel with a developer community, the early adopter community of open science researchers is critical for a successful revolution. An active open science community is essential for testing and improving infrastructure and practices. Already, there are more than 400 members of the Open Science Collaboration discussion group. COS supports conferences, development of best practice standards), and administrative coordination for the community. b38f27e0-3a71-4919-8985-dd9d822f6562 Open Science Practices Promote open science practices. 8d125c7a-d32f-44ca-9dfa-52b4b7f0f2f5 4.3 Journals Research Funders Researchers Rearch Societies Promoting open science practices with journals, funders, researchers, and societies. Open science practices will accelerate dramatically if stakeholders with levers for change create incentives or requirements for researchers. COS will promote open science practices with journals, funders, researchers, and societies. COS will support and conduct model cases as existence proofs that open science practices can work. COS will also host conferences for stakeholder groups for developing strategies, adopting best practices, and establishing a collaborative network for promoting change. 4c277bee-3e67-43aa-a324-04f1da65603d Incentives Adjust incentives to make "getting it right" more competitive with "getting it published" 48a27817-2db9-448f-a8ea-67d3d6a5350b 5 Replication Grants Provide grants for replications of important research results that have a high replication value. 0181ac73-df85-40df-b19c-cbc064f0a461 5.1 Brian Nosek Daniel Lakens Incentives and grants for Replicating Important Results. COS will provide grants for replications of important research results that have a high replication value - many citations or strong influence on research or practice, but few replications or imprecise estimation of effects. Further, COS will promote the development of incentives for conducting and publishing replications, such as supporting journals adopting new practices for publishing replications and promoting registration of research designs. A model example will be a special issue of the journal Social Psychology edited by Brian Nosek and Daniel Lakens. 52959433-0659-45bf-b547-6d6d3ee5cc9b Discoverability & Accessibility Make all academic research discoverable and accessible 65a37f6d-4a53-4f53-937c-19751b4f8761 6 d10e9e27-cf8a-498f-a1ac-c0d90ae7c783 b7993468-f76e-477f-ad28-e7c9249cd6f1 2013-01-31 2013-07-31 Owen Ambur Submit error.