HomeWhy Challenges?All ChallengesCreate Your Own ChallengeContributorsForum
Sign in / Register

Participation

This challenge is organised in the spirit of cooperative scientific progress. Therefore we ask everybody using this website to respect the rules below. The following rules apply to those who request to participate (individually or as a team) and download the data.

All information entered when registering a team or individual, including the name of the contact person, the affiliation (institute, organisation or company the team's contact person works for) and the e-mail address must be complete and correct. In other words, anonymous registration/participation is not allowed.

Evaluation of results uploaded to this website will be made publicly available on this site, and by submitting results, you grant us permission to publish our evaluation. Participating teams maintain full ownership and rights to their method. We do not claim any ownership or rights to the algorithms.

To participate in the challenge and have your results visible on this website it is mandatory to submit a 4-page paper in appropriate ISBI style to the organisers in which you explain your algorithm.

A maximum of 3 submissions is allowed for each team. Multiple submissions are only allowed when the utilised algorithm differs significantly from the algorithm used in the first submission (e.g. new submission when only the hyper-parameters of the algorithm are changed is not allowed). The second and third submissions must be accompanied by a new abstract or a short description of the difference of the method from the previous submissions.

Publication

The top 10 participating teams and individuals will be invited to contribute to a joint journal paper with maximum 2 authors per team describing and summarising the methods used and results found in this challenge. The paper will be submitted to a high-impact journal in the field no later than 6 months after the challenge. All remaining authors will be listed in a separate CAMELYON17 participants consortium annex.

In order to be included in the joint journal paper the participants must send to the organisers a 4-page paper in appropriate ISBI style describing their methods. The organisers will review the paper for sufficient detail to be able to understand and reproduce the method and hold the right to exclude participants from the joint journal paper in case their method description was not adequate.

Within 3 months after the challenge workshop, participants are not allowed to publish scientific publications (journal publications, conference papers, technical reports) based on CAMELYON17 data. Should you wish to get exemption from this rule, please contact us.

Attribution

Appropriate citation is to be made in scientific publications (journal publications, conference papers, technical reports, presentations at conferences and meetings) that use the data shared in this challenge. Currently, this citation must refer to the this website, and later to the publication that will describe the results of this challenge.

Teams must notify the organisers of the challenge about any publication that is (partly) based on the results or data published on this site, in order for us to maintain a list of publications associated with the challenge.

Data

This challenge aims for a fair comparison of algorithms, therefore, participants are not allowed to use other data sources than the provided data sets (CAMELYON16 and CAMELYON17).

Making extra annotations on the training data set is only allowed if the annotations are subsequently submitted to the organizers along with the submission of the results so that these annotations can be made available to other participants.

Data license

Creative Commons Licence This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

 

Feel free to contact us if you have any questions or need clarification regarding the rules of the challenge or the licensing of the data.


Consortium for Open Medical Image Computing © 2012-