It is our great pleasure to welcome you to the 44th ACM SIGPLAN Symposium on Principles of Programming Languages (POPL 2017). POPL is sponsored by ACM SIGPLAN, and organised in cooperation with ACM SIGACT and ACM SIGLOG. The conference is held in Paris, France, at the convention centre of the Université Pierre et Marie Curie. It has been both an honour and a delight to serve as chairs for POPL 2017.
In the programming languages and software engineering community, artifact evaluation is concerned with the by-products of theoretical and applied work. An “artifact” is something intended to support the scientific claims made in a paper. For instance, an artifact might be a program’s source code, a dataset, a test suite, a proof, or a model. “Evaluation” is a best-effort attempt to reconcile a paper’s artifacts with the claims made in the paper. A primary goal of the artifact evaluation process is to encourage authors to create artifacts that can be shared and used by others as a basis for new activities. The process has other benefits as well, such as encouraging authors to be precise in their claims and the public recognition of the effort to create artifacts.
To encourage this beneficial behavior, since POPL 2015, authors of accepted papers have been invited to submit artifacts for evaluation by an Artifact Evaluation Committee (AEC). In this report we describe the process of artifact evaluation for POPL 2017, and describe some issues and questions that should be addressed moving forward.