Abstract

Background Science is experiencing a reproducibility crisis. Artificial intelligence research is not an exception. Objective To give practical and pragmatic recommendations for how to document AI research so that the results are reproducible. Method Our analysis of the literature shows that AI publications fall short of providing enough documentation to facilitate reproducibility. Our suggested best practices are based on a framework for reproducibility and recommendations given for other disciplines. Results We have made an author checklist based on our investigation and provided examples for how every item in the checklist can be documented. Conclusion We encourage reviewers to use the suggested best practices and author checklist when reviewing submissions for AAAI publications and future AAAI conferences.
Background

Objective

Method

Results

Conclusion

Date

2018

Authors

Odd Erik Gundersen, Yolanda Gil, David W Aha

Journal

AI magazine

Volume

39

Issue

3

Pages

56-68