Submission Guide

Submission Guide

Submit your paper at the Koli Calling 2024 EasyChair site (to be published soon).

See the Call for Papers for important dates and information on the publication categories.

For full and discussion papers, only metainformation (authors, title, abstract, keywords, and submission topics) is required by the initial submission deadline. This will help us identify good reviewers. Your final paper must then be submitted by the extended submission deadline (one week after). It will be possible to submit updated versions of the paper until the extended submission deadline.

For poster abstracts and demo papers, both the final paper and metainformation are required by the submission deadline.  

All papers will be evaluated prior to review to ensure that they are fitting for the chosen track, have been correctly anonymised, and are ready to be reviewed. Papers not fulfilling these criteria may be desk rejected by the chairs. Each full and discussion paper that goes to review will receive three (double blind) reviews. A senior PC member will write a (double blind) metareview based on these reviews and the discussion of the committee. Posters and demo abstracts will receive a review from at least one member of the committee.

Paper Formatting and Length Requirements

Papers submitted to Koli Calling must conform to the style rules outlined on the ACM SIG Proceedings website. Authors should use the templates listed at ACM’s site. Note that the templates have been recently revised and that many authors have reported challenges with the interim Word template. We strongly recommend use of the LaTeX template.

LaTeX Authors: The easiest way to ensure that you have up-to-date versions and the correct fonts is to use the ACM templates in Overleaf, but any reasonable LaTeX environment should suffice if you load the correct templates and install any needed packages. For all LaTex submissions, use the following documentclass for review:

\documentclass[manuscript,anonymous,screen,review]{acmart} 

This should produce an author-anonymized, single-column submission with line numbers.

Word Authors: Based on our experiences with previous years’ conferences, we strongly encourage the use of LaTeX. If you choose to use Word, follow the tooling guidelines in the ACM Primary Article Templates AND Publication Workflow.

Page Limits

Koli’s page limits are based on single-column submissions. All limits include additional space that may contain only references – not acknowledgements or other material. 

Full Papers12 – 16 pages single-column + references
Discussion Papers7 – 10 pages single-column + references
Poster Abstracts/Demo Papers2 pages single-column + references

In addition to the paper itself, authors may submit up to 50 MB of supplementary material (e.g., additional figures, raw data, analysis code, more detailed descriptions). The supplementary material must be anonymized, and the paper should stand on its own: it should be reviewable and readable without the supplementary material. However, the supplementary material may provide additional details of interest to particular researchers or to support confirmation or replication of the result. Reviewers have discretion about whether they choose to look at the supplementary material.

Reporting Standards

We expect that all empirical submissions adhere to one of the reporting standards of SIGSOFT (https://www2.sigsoft.org/EmpiricalStandards/docs/standards). Please scan the list to find an appropriate standard and, for example, use the checklist provided to make sure that your submission includes all the information expected for that standard. If you feel like your research is not represented well by any of the specific standards, follow the “General Standard” as a default category that fits for every empirical submission.

Anonymization

All submissions should be anonymized for review. This includes author names and affiliations, information within the paper that might identify the authors (e.g., links, references to geographic locations, or acknowledgements), and self-citations. 

Self-citations should not be removed. They should be worded so that the reviewer does not know – or at least can plausibly doubt – that the authors are citing themselves (“third-person anonymization”).

Here is a brief checklist:

  • Remove author names and affiliations. If you are using LaTeX, the documentclass for review includes “anonymous” to quickly remove author information from the author blocks. You will still need to manually remove references within your paper’s text.
  • Select a title that does not clearly identify your research group or project.
  • Remove any identifying information in the text. Often, these occur in the introduction, methods, and acknowledgements.
  • Refer to your prior work in the third person and speak about the work as another author would.

Camera Ready Submission

If your paper is accepted, we will contact the authors with instructions. 

The ACM uses the TAPS production system which creates both a double column PDF and a single column HTML file from the source files. A single-column submission is required for the publication workflow. 

The TAPS production system can be challenging to navigate. To maximise the chances that your submission proceeds to publication without manual work and intervention of the help desk:

  1. Use the most up-to-date template and, if you are using LaTeX, submit with the documentclass:

\documentclass[manuscript]{acmart}

  1. Only use packages on the list of ACM-approved LaTeX packages.
  2. Do not introduce additional macros to the file – and especially beware of macros that modify figure or text positioning.
  3. Start the final submission process early. If your paper is flagged for review, it could take several weeks to work through the help desk. For this reason, avoid referring your paper to the help desk when possible. 
  4. Every submission should generate an error log that you can review to try to identify the problem. However, it’s not always obvious – and we can try to help, if you are unable to identify the error.

Prior to contacting the help desk, please reach out to the Chairs for assistance. We may be able to identify the issue more quickly than the help desk.

Authorship

Koli Calling is run in cooperation with the ACM and, as a result, follows the ACM’s Authorship Policy. Authors should, therefore, have made substantial intellectual contributions, have participated in drafting and revision, be aware of the submission, and agree to be held accountable for the correctness and integrity of the work.

Submission of Previously Published Works

Koli Calling adheres to the ACM’s Prior Publication and Simultaneous Submission Policy. As a result, Koli does not permit simultaneous submission of work to Koli and another venue with an overlapping submission period.  

The Policy also discourages publication of previously published works except in specific situations, such as publication at a workshop. Before submitting a previously published work, the authors should contact the Koli Calling Chairs to disclose the previous publication and to determine if republication is warranted. In particular, they will consider how much of the work has been revised compared to the prior publication and whether it advances knowledge beyond the prior publication. If submission is allowed and the paper is accepted, the paper must acknowledge (and if possible, cite) the original publication.

Conflicts of Interest

Koli Calling also adheres to the ACM’s Conflict of Interest Policy for ACM Publications. The policy requires that all participants in the publication process, including chairs, reviewers, and authors, disclose conflicts of interest and that parties with a conflict recuse themselves from deliberations or decision-making related to the work.

For authors, this means that conflicts (e.g., source of funding or employer) be disclosed in the work.

For reviewers, including both PC and Senior PC members, this means identifying submissions with which they have a conflict and recusing themselves from review of the paper. Ideally, this will occur during the bidding process, but if a reviewer recognizes that they are in conflict once reviewing starts, they should immediately contact the Chairs for reassignment.

Koli reviewers (including both PC and Senior PC members) are encouraged to submit work to the conference but will, of course, not be involved in the review of that work.

For the chairs, this means identifying submissions with which they have a conflict and recusing themselves from deliberations and decision-making related to the work. Since Koli Calling, by design, has two Chairs, the other Chair will take responsibility, in collaboration with a Senior PC member, for decisions on works that are in conflict with one Chair. The Chair in conflict will not participate in or be aware of any deliberations or decisions taken until notifications are sent to all authors.

Koli Chairs are also permitted to be co-authors on work submitted to the conference but must disclose potential submissions to their co-Chair prior to submission. The co-Chair, in consultation with a senior PC member, may determine that they will not be able to make an decision on the work without the appearance of bias, in which case the work cannot be submitted. In addition, chairs should not be the primary author of works submitted and should not present work. Furthermore, any work submitted with a Chair as an author will not be eligible for any Koli Calling award (e.g. Best Paper).