<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div class="">* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *</div><div class="">The Sixteenth Extended Semantic Web Conference (ESWC 2019)</div><div class="">2nd June - 6th June 2019, Portorož, Slovenia</div><div class=""> </div><div class="">Web Page: <a href="https://2019.eswc-conferences.org" class="">https://2019.eswc-conferences.org</a> </div><div class="">Twitter: @eswc_conf </div><div class="">Facebook: <a href="https://www.facebook.com/ESWCCONF" class="">https://www.facebook.com/ESWCCONF</a> </div><div class=""><br class=""></div><div class="">* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *</div><div class=""><br class=""></div><div class="">* * * * * * * </div><div class="">Overview</div><div class="">* * * * * * * <br class=""><br class="">The ESWC 2019 conference is looking for organizers to define challenges to which participants can submit solutions.<br class=""><br class="">The purpose of challenges is to showcase the maturity of state-of-the-art methods and tools on tasks common to the Semantic Web community and adjacent disciplines, in a controlled setting involving rigorous evaluation.<br class=""><br class="">Semantic Web Challenges are an official track of the conference, ensuring significant visibility for the challenges as well as participants. Challenge participants are asked to present their submissions as well as provide a paper describing their work. These papers undergo a peer review by experts and will be published in the challenge proceedings.<br class=""><br class="">In addition to the publication of proceedings, challenges at ESWC 2019 will benefit from high visibility and direct access to the ESWC audience and community.<br class=""><br class="">* * * * * * * * * * * * * * *</div><div class="">Challenge Proposals</div><div class="">* * * * * * * * * * * * * * *<br class=""><br class=""><b class="">Challenge organizers are encouraged to submit proposals adhering to the following criteria:</b><br class=""><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- <i class="">Challenges consist of one or multiple tasks</i>. If multiple tasks are provided, they are preferably independent so that participants may choose which to participate in.<br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- <i class="">At least one task involves semantics in data</i>. The task(s) should relate to the Semantic Web, but it is highly encouraged to consider tasks which involve other, highly related communities, such as NLP, Recommender Systems, Machine Learning or Information Retrieval.<br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- <i class="">Task descriptions appeal to a wider audience</i>. We encourage the challenge organizers to propose at least one basic task that can be addressed by a larger audience from their community.<br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- <i class="">Clear and rigorous definition of the tasks and evaluation metrics</i>. For each task, you should define a deterministic and objective way to verify to which extent it has been achieved, if possible using at least two objective criteria/metrics (such as precision or recall). The best way is usually to provide detailed examples of input data and expected output. The examples should leave no ambiguity about whether in the task is done.<br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- <i class="">Valid dataset (if applicable)</i>. When proposing the challenge, provide details on the used datasets and on the way it is or will be created. If accepted, you need to provide the datasets together with their provenance. You must make sure you that have the right to use/publish the datasets and state the license. <br class="">If training and evaluation datasets are necessary to complete the task, results must only be available for the training dataset. Challenge organizers need to make certain that the correct results for the evaluation dataset have not previously been published and/or made available to the participants.<br class=""></div><b class=""><div class=""><b class=""><br class=""></b></div>Selection criteria for evaluating and selecting submitted challenge proposals are:</b><br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- Potential number to interested participants<br class=""><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- Rigor and transparency of the evaluation procedure<br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- Relevance to the Semantic Web community<br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- Endorsements (e.g., from researchers working on the task, from industry players interested in results, from future participants)<br class=""></div><div class=""><br class=""></div><div class=""><div class="">* * * * * * * * * * * *</div></div>Important Dates<br class=""><div class="">* * * * * * * * * * * * </div><div class=""><br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- Challenges proposals due: December 15th, 2018<br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- Notification of acceptance: January 7th, 2018<br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- Training data ready available and challenges calls for papers sent: February 7th, 2019<br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- Challenge papers submission deadline (8 pages document): March 31st, 2019<br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- Notifications sent to participants and invitations to submit task results: April 15th, 2019<br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- Camera-ready papers for the conference (8 pages document): April 30th, 2019<br class=""></div><div class=""><br class=""></div><div class="">* * * * * * * * * * * * * *</div>Submission Details</div><div class="">* * * * * * * * * * * * * *<br class=""><br class="">The challenge proposals should contain at least the following elements:<br class=""><br class=""><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- A summarizing description of the challenge and its tasks<br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- How the training/testing data will be built and/or procured<br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- The evaluation methodology to be used, including clear evaluation criteria and the exact way in which they will be measured. Who will perform the evaluation and how will transparency be assured?<br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- The anticipated availability of the necessary resources to the participants<br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- The list of challenge committee members who will evaluate the challenge papers (please indicate which of the listed members already accepted the role)<br class=""></div>In case of doubt, feel free to send us your challenge proposal drafts as early as possible – the challenges chairs will provide you with feedback and answers to questions you may have.<br class=""><br class="">Please submit proposals via EasyChair <<a href="https://easychair.org/conferences/?conf=eswc2019challenges" class="">https://easychair.org/conferences/?conf=eswc2019challenges</a>>.</div></body></html>