{"id":757,"date":"2021-10-14T20:28:00","date_gmt":"2021-10-14T20:28:00","guid":{"rendered":"https:\/\/dataninja.nrw\/?p=757"},"modified":"2023-09-15T05:34:37","modified_gmt":"2023-09-15T05:34:37","slug":"reproducibility-in-machine-learning-lecture-and-tutorial-in-the-colloquium","status":"publish","type":"post","link":"https:\/\/dataninja.nrw\/?p=757","title":{"rendered":"14.10.21: Reproducibility in Machine Learning \u2013 Lecture and Tutorial in the Colloquium"},"content":{"rendered":"\n<p>Reproducibility is an important topic for Machine Learning research and we had as invited speaker Koustuv Sinha in our colloquium (14th of October). He is one of the co-organizers of Machine Learning Reproducibility Challenges on (basically all the) major ML conferences over the last five years. He provided a very nice overview on the need of reproducibility and in particular we discussed best practices for projects. <\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"444\" src=\"https:\/\/dataninja.nrw\/wp-content\/uploads\/2021\/11\/Screen-Shot-2021-10-14-at-3.11.32-PM-1024x444.png\" alt=\"\" class=\"wp-image-758\" srcset=\"https:\/\/dataninja.nrw\/wp-content\/uploads\/2021\/11\/Screen-Shot-2021-10-14-at-3.11.32-PM-1024x444.png 1024w, https:\/\/dataninja.nrw\/wp-content\/uploads\/2021\/11\/Screen-Shot-2021-10-14-at-3.11.32-PM-300x130.png 300w, https:\/\/dataninja.nrw\/wp-content\/uploads\/2021\/11\/Screen-Shot-2021-10-14-at-3.11.32-PM-768x333.png 768w, https:\/\/dataninja.nrw\/wp-content\/uploads\/2021\/11\/Screen-Shot-2021-10-14-at-3.11.32-PM-1536x666.png 1536w, https:\/\/dataninja.nrw\/wp-content\/uploads\/2021\/11\/Screen-Shot-2021-10-14-at-3.11.32-PM-2048x888.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>Title: Hands on Reproducibility &#8211; A primer on reproducible research in ML<\/p>\n\n\n\n<p>Abstract: The incredible progress in the field of Machine Learning over the last five years have pushed the state-of-the-art in many applications across different modalities. However, translation of these findings to real world problems has been slow &#8211; primarily due to issues in reproducibility. Reproducibility, which is obtaining similar results as presented in a paper or talk, using the same code and data (when available), is a necessary step to verify the reliability of research findings. Reproducibility is also an important step to promote open and accessible research, thereby allowing the scientific community to quickly integrate new findings and convert ideas to practice. Reproducibility also promotes the use of robust experimental workflows, which potentially reduce unintentional errors. In this talk, I will first present some statistics on the need for reproducibility in machine learning research, and then cover the recent approaches taken by the community to promote reproducible science. Finally, I will talk in-depth about the experimental workflows that you can integrate with your research, to ensure and promote reproducible science.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Reproducibility is an important topic for Machine Learning research and we had as invited speaker Koustuv Sinha in our colloquium [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ub_ctt_via":"","footnotes":""},"categories":[1],"tags":[],"featured_image_src":null,"author_info":{"display_name":"admin","author_link":"https:\/\/dataninja.nrw\/?author=1"},"_links":{"self":[{"href":"https:\/\/dataninja.nrw\/index.php?rest_route=\/wp\/v2\/posts\/757"}],"collection":[{"href":"https:\/\/dataninja.nrw\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dataninja.nrw\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dataninja.nrw\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/dataninja.nrw\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=757"}],"version-history":[{"count":2,"href":"https:\/\/dataninja.nrw\/index.php?rest_route=\/wp\/v2\/posts\/757\/revisions"}],"predecessor-version":[{"id":1386,"href":"https:\/\/dataninja.nrw\/index.php?rest_route=\/wp\/v2\/posts\/757\/revisions\/1386"}],"wp:attachment":[{"href":"https:\/\/dataninja.nrw\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=757"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dataninja.nrw\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=757"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dataninja.nrw\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=757"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}