{"id":898,"date":"2018-08-13T20:47:39","date_gmt":"2018-08-13T20:47:39","guid":{"rendered":"http:\/\/blog.valdosta.edu\/research\/?p=898"},"modified":"2018-08-13T20:47:39","modified_gmt":"2018-08-13T20:47:39","slug":"darpa-officer-talks-social-and-behavioral-science-reliability-initiative","status":"publish","type":"post","link":"https:\/\/blog.valdosta.edu\/research\/2018\/08\/13\/darpa-officer-talks-social-and-behavioral-science-reliability-initiative\/","title":{"rendered":"DARPA Officer Talks Social and Behavioral Science Reliability Initiative"},"content":{"rendered":"

Adam Russell, an anthropologist and program manager with the Defense Advanced Research Projects Agency (DARPA) was recently interviewed in\u00a0Nature Index<\/a>\u00a0on the agency\u2019s pursuit of tools that would assign confidence levels to published research in the social and behavioral sciences through its\u00a0SCORE<\/a>\u00a0initiative (Systematizing Confidence in Open Research and Evidence). These tools will look for a mix of endogenous (internal) and exogenous (external) signals to assign a kind of credit score to the degree of reproducibility and replicability of claims. Endogenous signals might include sample sizes, pre-registration of research, open data, shared code, etc., while exogenous signals might include author and institution reputation, impact factors, peer review networks, social media commentary, post-publication review, funding sources, conflicts of interest, rates of retraction, and more.<\/p>\n

While DARPA intends to use these tools in tandem with human experts to help the military calibrate the reliability of data it uses to inform its decisions, it knows this won\u2019t be foolproof. When asked if he believes the issue of research irreproducibility will ever by completely solved, Russell says, \u201cNo, I don\u2019t think irreproducibility will ever not be a feature of research. Science is really difficult and messy. But I do think the research community more generally can make improvements in where, how, and why irreproducibility occurs, and help limit the extent to which it impedes important scientific progress.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"

Adam Russell, an anthropologist and program manager with the Defense Advanced Research Projects Agency (DARPA) was recently interviewed in\u00a0Nature Index\u00a0on the agency\u2019s pursuit of tools that would assign confidence levels to published research in the social and behavioral sciences through its\u00a0SCORE\u00a0initiative (Systematizing Confidence in Open Research and Evidence). These tools will look for a mix […]<\/p>\n","protected":false},"author":322,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ocean_post_layout":"","ocean_both_sidebars_style":"","ocean_both_sidebars_content_width":0,"ocean_both_sidebars_sidebars_width":0,"ocean_sidebar":"","ocean_second_sidebar":"","ocean_disable_margins":"enable","ocean_add_body_class":"","ocean_shortcode_before_top_bar":"","ocean_shortcode_after_top_bar":"","ocean_shortcode_before_header":"","ocean_shortcode_after_header":"","ocean_has_shortcode":"","ocean_shortcode_after_title":"","ocean_shortcode_before_footer_widgets":"","ocean_shortcode_after_footer_widgets":"","ocean_shortcode_before_footer_bottom":"","ocean_shortcode_after_footer_bottom":"","ocean_display_top_bar":"default","ocean_display_header":"default","ocean_header_style":"","ocean_center_header_left_menu":"","ocean_custom_header_template":"","ocean_custom_logo":0,"ocean_custom_retina_logo":0,"ocean_custom_logo_max_width":0,"ocean_custom_logo_tablet_max_width":0,"ocean_custom_logo_mobile_max_width":0,"ocean_custom_logo_max_height":0,"ocean_custom_logo_tablet_max_height":0,"ocean_custom_logo_mobile_max_height":0,"ocean_header_custom_menu":"","ocean_menu_typo_font_family":"","ocean_menu_typo_font_subset":"","ocean_menu_typo_font_size":0,"ocean_menu_typo_font_size_tablet":0,"ocean_menu_typo_font_size_mobile":0,"ocean_menu_typo_font_size_unit":"px","ocean_menu_typo_font_weight":"","ocean_menu_typo_font_weight_tablet":"","ocean_menu_typo_font_weight_mobile":"","ocean_menu_typo_transform":"","ocean_menu_typo_transform_tablet":"","ocean_menu_typo_transform_mobile":"","ocean_menu_typo_line_height":0,"ocean_menu_typo_line_height_tablet":0,"ocean_menu_typo_line_height_mobile":0,"ocean_menu_typo_line_height_unit":"","ocean_menu_typo_spacing":0,"ocean_menu_typo_spacing_tablet":0,"ocean_menu_typo_spacing_mobile":0,"ocean_menu_typo_spacing_unit":"","ocean_menu_link_color":"","ocean_menu_link_color_hover":"","ocean_menu_link_color_active":"","ocean_menu_link_background":"","ocean_menu_link_hover_background":"","ocean_menu_link_active_background":"","ocean_menu_social_links_bg":"","ocean_menu_social_hover_links_bg":"","ocean_menu_social_links_color":"","ocean_menu_social_hover_links_color":"","ocean_disable_title":"default","ocean_disable_heading":"default","ocean_post_title":"","ocean_post_subheading":"","ocean_post_title_style":"","ocean_post_title_background_color":"","ocean_post_title_background":0,"ocean_post_title_bg_image_position":"","ocean_post_title_bg_image_attachment":"","ocean_post_title_bg_image_repeat":"","ocean_post_title_bg_image_size":"","ocean_post_title_height":0,"ocean_post_title_bg_overlay":0.5,"ocean_post_title_bg_overlay_color":"","ocean_disable_breadcrumbs":"default","ocean_breadcrumbs_color":"","ocean_breadcrumbs_separator_color":"","ocean_breadcrumbs_links_color":"","ocean_breadcrumbs_links_hover_color":"","ocean_display_footer_widgets":"default","ocean_display_footer_bottom":"default","ocean_custom_footer_template":"","ocean_post_oembed":"","ocean_post_self_hosted_media":"","ocean_post_video_embed":"","ocean_link_format":"","ocean_link_format_target":"self","ocean_quote_format":"","ocean_quote_format_link":"post","ocean_gallery_link_images":"on","ocean_gallery_id":[],"footnotes":""},"categories":[24],"tags":[],"class_list":["post-898","post","type-post","status-publish","format-standard","hentry","category-grants-research-news","entry"],"acf":[],"_links":{"self":[{"href":"https:\/\/blog.valdosta.edu\/research\/wp-json\/wp\/v2\/posts\/898","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.valdosta.edu\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.valdosta.edu\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.valdosta.edu\/research\/wp-json\/wp\/v2\/users\/322"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.valdosta.edu\/research\/wp-json\/wp\/v2\/comments?post=898"}],"version-history":[{"count":1,"href":"https:\/\/blog.valdosta.edu\/research\/wp-json\/wp\/v2\/posts\/898\/revisions"}],"predecessor-version":[{"id":899,"href":"https:\/\/blog.valdosta.edu\/research\/wp-json\/wp\/v2\/posts\/898\/revisions\/899"}],"wp:attachment":[{"href":"https:\/\/blog.valdosta.edu\/research\/wp-json\/wp\/v2\/media?parent=898"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.valdosta.edu\/research\/wp-json\/wp\/v2\/categories?post=898"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.valdosta.edu\/research\/wp-json\/wp\/v2\/tags?post=898"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}