-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathindex.html
More file actions
159 lines (146 loc) · 6.69 KB
/
index.html
File metadata and controls
159 lines (146 loc) · 6.69 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
<!doctype html>
<html>
<head>
<title>SVELA @ EVALITA 2026</title>
<meta charset="utf-8" name="viewport" content="width=device-width, initial-scale=1">
<link href="https://use.fontawesome.com/releases/v5.2.0/css/all.css" media="screen" rel="stylesheet" type="text/css" />
<link href="css/frame.css" media="screen" rel="stylesheet" type="text/css" />
<link href="css/controls.css" media="screen" rel="stylesheet" type="text/css" />
<link href="css/custom.css" media="screen" rel="stylesheet" type="text/css" />
<link href='https://fonts.googleapis.com/css?family=Open+Sans:400,700' rel='stylesheet' type='text/css'>
<link href='https://fonts.googleapis.com/css?family=Open+Sans+Condensed:300,700' rel='stylesheet' type='text/css'>
<link href="https://fonts.googleapis.com/css?family=Source+Sans+Pro:400,700" rel="stylesheet">
<script src="https://ajax.googleapis.com/ajax/libs/jquery/3.3.1/jquery.min.js"></script>
<script src="js/menu.js"></script>
<script src="js/footer.js"></script>
<link rel="icon" type="image/x-icon" href="/img/logo.ico">
<style>
.menu-index {
color: rgb(0, 0, 0) !important;
opacity: 1 !important;
font-weight: 700 !important;
}
</style>
</head>
<body>
<div class="menu-container"></div>
<div class="content-container">
<div class="banner" style="background: url('img/bari.jpg') no-repeat center; background-size: cover; height: 500px;">
<div class="banner-table flex-column" style="background-color: rgba(0, 0, 0, 0.75);">
<div class="flex-row">
<div class="flex-item flex-column">
<h1 class="add-top-margin-small strokeme">
<b>S</b>elective <b>V</b>erification of <b>E</b>rasure from <b>L</b>LM <b>A</b>nswers (SVELA)
<p class="text" style="font-size: 20px">
2026 - Bari, Italy
</p>
<p class="text" style="font-size: 20px">
EVALITA 2026 Evaluation Campaign
</p>
</h1>
</div>
</div>
</div>
</div>
<div class="content">
<div class="content-table flex-column">
<div class="flex-row">
<div class="flex-item flex-column">
<p class="text">
<em>Can we reliably verify if an LLM has truly “forgotten” specific information?</em>
</p>
<p class="text">
<strong>SVELA (Selective Verification of Erasure from LLM Answers)</strong> is a shared task at <strong>EVALITA 2026</strong> focusing on the evaluation of Machine Unlearning in Large Language Models.
Participants will design, implement, and benchmark metrics for verifying selective forgetting, ensuring that models forget targeted knowledge while retaining unrelated capabilities.
The task is intended to be model-agnostic and resource-inclusive, offering pre-trained models in different sizes so that teams with varying computational resources can participate.
</p>
<!-- --------------------------------------------------------- -->
<h3>Important Dates</h3>
<hr>
<ul>
<li>Task Registration Opens: <b>September 1st, 2025</b></li>
<li>Development Data Release: <b>September 22nd, 2025</b></li>
<li>
System Submission Opens: <b>December 1st, 2025</b>
</li>
<li>
System Submission Deadline: <s>November 3rd, 2025</s> → <b>December 8th, 2025</b>
</li>
<li>
Results Notification: <s>November 17th, 2025</s> → <b>December 15th, 2025</b>
</li>
<li>
System Description Paper Deadline: <s>December 15th, 2025</s> → <b>January 9th, 2026</b>
</li>
<li>EVALITA 2026 Conference: <b>February 26th–27th, 2026 in Bari, Italy</b></li>
</ul>
<p class="text">
All deadlines refer to midnight (23:59) in the AoE (Anywhere on Earth) time zone.
Participants are required to submit a system description paper describing their approach and results.
</p>
<h3>News</h3>
<hr>
<ul>
<li>
<p class="text">
<b>Final results and datasets released!</b><br>
We would like to sincerely thank all participants for taking part in
<strong>SVELA – Selective Verification of Erasure from LLM Answers</strong>.
The final results and rankings for both tasks are now public and available
<a href="https://docs.google.com/spreadsheets/d/1ULbyEjIWBwhoIa1AcW9ZRFGWX9fcmavy/edit?usp=sharing&ouid=115369798822679389245&rtpof=true&sd=true" target="_blank">here</a>.
In addition, the complete datasets — including all models used in the evaluation — are now fully accessible on the official
<a href="https://huggingface.co/SVELA-task" target="_blank">Hugging Face page</a>.
</p>
</li>
<li>
<p class="text">
<b>Public leaderboards are live!</b></br>
The Codabench leaderboards for SVELA – Selective Verification of Erasure from LLM Answers – are now online:<br>
• <a href="https://www.codabench.org/competitions/11789/" target="_blank">Task 1</a><br>
• <a href="https://www.codabench.org/competitions/11803/" target="_blank">Task 2</a><br>
</li>
<li>
<p class="text">
<b>Baseline model available!</b></br>
A first model is now available for participants to start testing:
<a href="https://huggingface.co/ClaudioSavelli/SVELA-model-unlearned_1B" target="_blank">SVELA-model-unlearned_1B</a>.
Additional models will be released soon.
</p>
</li>
<li>
<p class="text">
<b>New dataset splits released!</b></br>
The SVELA <a href="https://huggingface.co/datasets/ClaudioSavelli/SVELA-train-split" target="_blank">train split</a>
(with retain, forget, and test partitions) and the
<a href="https://huggingface.co/datasets/ClaudioSavelli/SVELA-val-split" target="_blank">validation split</a>
(unlabeled) are now available on Hugging Face.
</p>
</li>
<li>
<p class="text">
<b>Registration is open!</b></br>
You can now register for the challenge by filling out the form
<a href="https://docs.google.com/forms/d/1Vm3GD6NoyGbwq6vSS6oEFKTFbdp2j-thQSUox0sptXo/edit" target="_blank">here</a>.
</p>
</li>
<li>
<p class="text">
<b>SVELA task announced!</b></br>
The SVELA task has been officially announced as part of the EVALITA 2026 Evaluation Campaign.
</p>
</li>
<li>
<p class="text">
<b>Official task website is live!</b></br>
The official website for SVELA @ EVALITA 2026 is now live.
</p>
</li>
</ul>
<!-- <h3>Co-located with ICASSP 2025</h3>
<img src="img/icassp2025.jpeg" style="width: 300px; margin-top: 20px;"> -->
<!-- CENTERED VERSION -->
<div style="text-align: center;">
<h3 style="color: #333;">Part of EVALITA 2026</h3>
<img src="img/EVALITA_Logo.png" style="width: 300px; margin-top: 20px;">
</div>
</html>