Initial Triage
Papers undergo compliance checks with the conference submission template guidelines to ensure paper details on submission are consistent with review system data. Checks include the number of papers submitted by one author or co-author (nine or less), paper length, structure, research topics, language, author names, and order. Papers undergo a first plagiarism and self-plagiarism check using iThenticate. The paper can be sent to peer review only if the paper passes the initial check.
Upon receipt of the paper assignments, Area Chairs review their list of papers for conflicts of interest, report to the Technical Program Chair, and the paper is re-assigned to another Area Chair. Area Chairs will also report to the Technical Program Chair any paper that has been categorized under an incorrect EDICS topic.
Paper Reproducibility and Supporting Content
Authors are encouraged and offered the ability to share datasets, code, and other supporting content associated with accepted papers. The below platforms support reproducibility and publicity for posters and/or presentation files that accompany a conference paper. Free resources are available to upload content.
- IEEE DataPort – Authors are encouraged to upload up to 2TB of data associated with their conference paper to IEEE DataPort at no cost. This service is intended to enhance the value of the article, support research reproducibility, and each dataset uploaded to IEEE DataPort is assigned a unique DOI that can be cited and referenced.
- Code Ocean-Authors are encouraged to include associated code, software simulations, algorithms, and more for article readers to understand what produced the results. Articles in the IEEE Xplore® digital library will display the associated and executable code from Code Ocean. Published code is fully citable and receives a DOI for better discoverability.
- IEEE SigPort – Authors are also encouraged to upload their presentations or posters in PDF format to share with other conference attendees.
Editorial Triage
In this step, Technical Program Committee Chairs scan and place the papers in peer review tracks for Area Chairs to assign reviews.
Review Assignment
- Papers are assigned to a track according to what the authors selected as the first track during submission. If a paper is not a good fit for their track, track chairs have the option to reassign it to a different track, according to their best judgment. The secondary track that the authors choose during submission may serve as a guide for the reassignment but is not binding.
- Papers are assigned to area chairs and/or meta-reviewers (if the track uses them) according to their relevance to their expertise.
- Papers are assigned to reviewers by the track or area chairs, according to relevance to the reviewers’ expertise and the paper’s area either manually or assisted by AI tools, such as the Toronto Paper Matching System.
- Any AI-assisted assignment is manually refined by the track/area chairs as necessary before the final assignment to ensure all papers have sufficient reviewers and reviewers are not overloaded.
- Track chairs have the authority to invite additional emergency reviews as necessary for papers not meeting the minimum numbers or if a specific reviewer is not on the list of available reviewers for that paper, an area chair may contact them directly to recruit them to review the paper. This request must be sent to the Technical Program Chair for review and addition of this new reviewer.
- Each paper is assigned to at least three (3) reviewers. The best effort is made to ensure a good match between the author-declared areas of papers and the reviewers’ areas of expertise and a balanced composition of senior and junior reviewers.
Paper Evaluation (Peer Review)
A set of reviewers selected by the Technical Program Committee will review the submitted documents and rate them according to quality, relevance, and correctness. The conference’s Technical Program Committee will use these reviews to determine which papers will be accepted for presentation at the conference and published in the proceedings. The result of the technical committee’s decision will be communicated to the submitting authors by email, along with any reviewer comments, if any.
Papers undergo single-anonymous review (i.e., reviewers know the names of the authors, but reviewers are anonymous to the authors and other reviewers). At least three reviewers will be assigned to each paper.
Review Criteria
- Language and Clarity of Presentation – The manuscripts submitted to the conference should be written in English, which is required to be inclusive, appropriate, and understandable for editors, reviewers, and future readers. Please use proper grammar, and fluent sentences, choose good words, and avoid syntax errors in your paper. Authors should be aware that comprehension difficulties may lead to rejection of the paper.
- Importance/Relevance – Every researcher working in the general technical area should find interest in works “Of broad interest” such as, for example, a contribution that has broad impact, or a surprising result. Works “Of sufficient interest” do not have to address everyone in the audience, but should have an impact in a certain area. Works “Of limited interest” should be considered only if their novelty, clarity, and correctness is excellent. “Irrelevant” implies rejection, and must be justified thoroughly.
- Novelty/Originality – “Very original” papers open new directions and often become seminal papers. “Has been done before” implies reject, in which case the reviewer’s comments must include appropriate justifications and relevant references.
- Technical Correctness – “Technically correct” means that the work conclusions are supported by flawless arguments. Proofs are correct, formulas are correct, there are no hidden assumptions, and experiments are well-designed and properly evaluated. However, “Has major problems” implies rejection and must be justified thoroughly. For “minor errors”, the reviewer should list the errors that need to be corrected by the authors.
- Experimental Validation – Different papers need different levels of experimental validation. A theoretical paper may need no experiments. A paper presenting a new idea might just need an experiment illustrating that there exists a situation where the idea applies. A paper presenting a new phenomenon or a performance evaluation paper may need thorough experiments and evaluation. “Insufficient validation” implies rejection and must be justified thoroughly.
- Reference to Prior Work – “Does not cite relevant work” implies rejection. This option should be selected only if the missing work is well-known in the community and commonly cited, else we suggest selecting “References missing”. List the missing references. Reviewers are asked to review the citations for relevance and conflict of interest.
Decision and Revision
Immediate Rejects/Desk Rejects
For submissions that do not have a minimum quality or do not include adequate technical content as checked by two senior experts, e.g. Area Chairs or Technical Committee Chairs, may be desk rejected and not subject to a full reviewing process. The immediate rejection must be supported by a clear motivation provided to the authors. This does not prevent authors from appealing later to the Technical Program Committee Chairs.
This option is used at the discretion of the event Organizing Committee; however, to be used, it has to be clearly announced well before the submission deadline on the event Web page and Call for Papers.
For scenarios where over nine (9) papers have been submitted listing the same author or co-author, the author will be contacted and asked to reduce the submitted papers to nine (9) or less.
Rebuttal Process
After reviews are returned to the authors, they are given at least one week to submit an optional rebuttal that is sent to the Technical Committee (TC) Chairs and their Area Chairs for use in helping make a final decision on papers. It is up to the Area Chairs to use a rebuttal response in making their decisions and it is noted that these Rebuttals are not shared with the original reviewers.
Notification of Acceptance or Rejection
Authors will be notified of paper acceptance or non-acceptance by email as close as possible to the published author notification date.
If accepted, the email notification may also include the presentation format chosen for your paper (lecture or poster) and the presentation date and time, if available. If this information is not available at the notification stage, a separate email notification will be sent soon after the acceptance notification date. The assignment of papers to oral or poster sessions is a purely scheduling decision from the TPC and does not reflect a quality judgment on the papers.
For both Acceptances and Rejections, the notification email will include comments from the reviewers. The conference cannot guarantee that all of the reviewers will provide the level of comment desired by each author. However, reviewers are encouraged to submit as detailed comments as possible.
An Ombud is assigned for each conference and any violations of policies should be reported to the conference ombud, noted on the Organizing Committee page. All reports will be treated confidentially. The Ombud will investigate and prepare a brief statement of facts, a conclusion (proven/not proven) using a preponderance of the evidence standard, and a recommended sanction if a violation is proven. The Conference Organizing Committee will vote to either adopt or not adopt this recommendation and may modify it. The decision of the Committee is final.
Requirements of Publication Following Acceptance
- The author must register at the full conference rate and for a maximum of four papers per author registration.
- One author may not be listed on more than nine (9) submitted papers.
- The paper must be presented at the conference live by one of the authors. (See Non-Presented Paper Policy).
- All accepted papers must have an IEEE Electronic Copyright form submitted before the manuscript can be included in the conference proceedings. You will be required to submit the form during the submission of the final version of the paper.
Special Sessions
Special session paper reviews are managed by the special session organizers, who report to the Technical Program Committee Chairs. Such papers also undergo review by at least three reviewers. At least one reviewer should be assigned externally by the TPC Chairs.
Satellite Workshop Papers
Proposals to hold a satellite workshop are reviewed and accepted or rejected by the Organizing Committee including the TPC Chairs. Each Satellite Workshop Organizing Committee has its independent peer review process. Submitted workshop papers should abide by the conference’s paper style, format, and length, while their peer-reviewing process should follow all IEEE Policies and the main conference reviewing guidelines if the workshop organizers desire that the workshop papers be published at the IEEE Xplore Digital Library.