Participation¶

This challenge is organised in the spirit of cooperative scientific progress. Therefore we ask everybody using this website to respect the rules below. The following rules apply to those who request to participate (individually or as a team) and to those who download the data.

Evaluation of classification results uploaded to this website will be made publicly available on the Results page of this site, and by submitting results, you grant us permission to publish our evaluation. Participating teams maintain full ownership and rights to their method. We do not claim any ownership or rights to the algorithms.

To participate in the challenge and have your results visible on this website it is mandatory to submit a link to a 4-page paper (possibly arXiv) in appropriate ISBI style to the organisers in which you explain your algorithm.

A maximum of 3 submissions is allowed for each team. Multiple submissions are only allowed when the utilised algorithm differs significantly from the algorithm used in the first submission (e.g. new submission when only the hyper-parameters of the algorithm are changed is not allowed). The second and third submissions must be accompanied by a new abstract or a short description of the difference of the method from the previous submissions.

Publication¶

The top 10 participating teams and individuals will be invited to contribute to a joint journal paper with maximum 2 authors per team describing and summarising the methods used and results found in this challenge. The paper will be submitted to a high-impact journal in the field no later than 6 months after the challenge. All remaining authors will be listed in a separate CAMELYON17 participants consortium annex.

In order to be included in the joint journal paper the participants must send to the organisers a 4-page paper in appropriate ISBI style describing their methods. The organisers will review the paper for sufficient detail to be able to understand and reproduce the method and hold the right to exclude participants from the joint journal paper in case their method description was not adequate.

Data¶

This challenge aims for a fair comparison of algorithms, therefore, participants are only allowed to use other data sources than the provided data sets (CAMELYON16 and CAMELYON17) if:

• The used external data set is open access.
• The availability of the used external data set is included in the accompanying paper.

Making extra annotations on the training data set is only allowed if the annotations are subsequently submitted to the organizers along with the submission of the results so that these annotations can be made available to other participants.