
Report March 2025
Your organisation description
Integrity of Services
Commitment 14
In order to limit impermissible manipulative behaviours and practices across their services, Relevant Signatories commit to put in place or further bolster policies to address both misinformation and disinformation across their services, and to agree on a cross-service understanding of manipulative behaviours, actors and practices not permitted on their services. Such behaviours and practices include: The creation and use of fake accounts, account takeovers and bot-driven amplification, Hack-and-leak operations, Impersonation, Malicious deep fakes, The purchase of fake engagements, Non-transparent paid messages or promotion by influencers, The creation and use of accounts that participate in coordinated inauthentic behaviour, User conduct aimed at artificially amplifying the reach or perceived public support for disinformation.
We signed up to the following measures of this commitment
Measure 14.1 Measure 14.2 Measure 14.3
In line with this commitment, did you deploy new implementation measures (e.g. changes to your terms of service, new tools, new policies, etc)?
If yes, list these implementation measures here
YouTube has long been updating, on a regular and ongoing basis, its internal systems and processes related to the detection of content that violates its policies. This includes investment in automated detection systems.
Search & YouTube
In November 2024, Google released a white paper detailing how it is addressing the growing global issue of fraud and scams. In the paper, Google explains that it fights scams and fraud by taking proactive measures to protect users from harm, deliver reliable information, and partner to create a safer internet, through policies and built-in technological protections that help us to prevent, detect, and respond to harmful and illegal content. For details on YouTube and Google Search’s approaches to tackling scams, see the full report here.
Do you plan to put further implementation measures in place in the next 6 months to substantially improve the maturity of the implementation of this commitment?
If yes, which further implementation measures do you plan to put in place in the next 6 months?
Measure 14.1
Relevant Signatories will adopt, reinforce and implement clear policies regarding impermissible manipulative behaviours and practices on their services, based on the latest evidence on the conducts and tactics, techniques and procedures (TTPs) employed by malicious actors, such as the AMITT Disinformation Tactics, Techniques and Procedures Framework.
QRE 14.1.1
Relevant Signatories will list relevant policies and clarify how they relate to the threats mentioned above as well as to other Disinformation threats.
YouTube continues to assess, evaluate, and update its policies on a regular basis, the latest updated policies, including Community Guidelines, can be found here.
QRE 14.1.2
Signatories will report on their proactive efforts to detect impermissible content, behaviours, TTPs and practices relevant to this commitment.
Measure 14.2
Relevant Signatories will keep a detailed, up-to-date list of their publicly available policies that clarifies behaviours and practices that are prohibited on their services and will outline in their reports how their respective policies and their implementation address the above set of TTPs, threats and harms as well as other relevant threats.
QRE 14.2.1
Relevant Signatories will report on actions taken to implement the policies they list in their reports and covering the range of TTPs identified/employed, at the Member State level.
For TTPs 1, 5, 7 and 9, YouTube provides details around mapping to its policies. To learn more about these methodologies, refer to SLI 14.2.1, SLI 14.2.2, and SLI 14.2.4.
SLI 14.2.1
Number of instances of identified TTPs and actions taken at the Member State level under policies addressing each of the TTPs as well as information on the type of content.
TTP 1
TTP 5
TTP 7
TTP 9
YouTube continues to assess, evaluate, and update its policies on a regular basis. The latest updated policies, including Community Guidelines, can be found here.
Country | TTP OR ACTION 1 - Number of channels identified | TTP OR ACTION 1 - Number of channels removed | TTP OR ACTION 5 - Number of channels identified | TTP OR ACTION 5 - Number of channels removed | TTP OR ACTION 5 - Number of videos identified | TTP OR ACTION 5 - Number of videos removed | TTP OR ACTION 7 - Number of videos identified | TTP OR ACTION 7 - Number of videos removed | TTP OR ACTION 9 - Number of channels identified | TTP OR ACTION 9 - Number of channels removed | TTP OR ACTION 9 - Number of videos identified | TTP OR ACTION 9 - Number of videos removed |
---|---|---|---|---|---|---|---|---|---|---|---|---|
Austria | 3,789 | 3,789 | 170 | 170 | 4 | 4 | 19 | 19 | 90 | 90 | 67 | 67 |
Belgium | 2,193 | 2,193 | 237 | 237 | 1 | 1 | 38 | 38 | 144 | 144 | 81 | 81 |
Bulgaria | 1,335 | 1,335 | 145 | 145 | 2 | 2 | 26 | 26 | 74 | 74 | 30 | 30 |
Croatia | 505 | 505 | 66 | 66 | 0 | 0 | 4 | 4 | 36 | 36 | 13 | 13 |
Cyprus | 450 | 450 | 51 | 51 | 2 | 2 | 26 | 26 | 68 | 68 | 47 | 47 |
Czech Republic | 1,830 | 1,830 | 159 | 159 | 7 | 7 | 19 | 19 | 139 | 139 | 183 | 183 |
Denmark | 633 | 633 | 65 | 65 | 12 | 12 | 8 | 8 | 92 | 92 | 54 | 54 |
Estonia | 213 | 213 | 27 | 27 | 0 | 0 | 3 | 3 | 17 | 17 | 19 | 19 |
Finland | 686 | 686 | 90 | 90 | 45 | 45 | 19 | 19 | 58 | 58 | 38 | 38 |
France | 14,635 | 14,635 | 1,277 | 1,277 | 237 | 237 | 236 | 236 | 603 | 603 | 394 | 394 |
Germany | 14,157 | 14,157 | 1,749 | 1,749 | 1,440 | 1,440 | 338 | 338 | 947 | 947 | 641 | 641 |
Greece | 3,831 | 3,831 | 124 | 124 | 6 | 6 | 96 | 96 | 115 | 115 | 59 | 59 |
Hungary | 1,945 | 1,945 | 129 | 129 | 2 | 2 | 10 | 10 | 82 | 82 | 23 | 23 |
Ireland | 5,823 | 5,823 | 116 | 116 | 102 | 102 | 55 | 55 | 61 | 61 | 101 | 101 |
Italy | 5,651 | 5,651 | 828 | 828 | 250 | 250 | 85 | 85 | 319 | 319 | 177 | 177 |
Latvia | 611 | 611 | 46 | 46 | 0 | 0 | 8 | 8 | 34 | 34 | 45 | 45 |
Lithuania | 10,170 | 10,170 | 49 | 49 | 10 | 10 | 5 | 5 | 142 | 142 | 26 | 26 |
Luxembourg | 429 | 429 | 20 | 20 | 0 | 0 | 5 | 5 | 13 | 13 | 8 | 8 |
Malta | 193 | 193 | 13 | 13 | 0 | 0 | 2 | 2 | 17 | 17 | 5 | 5 |
Netherlands | 5,055 | 5,055 | 406 | 406 | 195 | 195 | 143 | 143 | 556 | 556 | 866 | 866 |
Poland | 13,947 | 13,947 | 697 | 697 | 6 | 6 | 45 | 45 | 1,040 | 1,040 | 982 | 982 |
Portugal | 2,488 | 2,488 | 165 | 165 | 50 | 50 | 27 | 27 | 146 | 146 | 14 | 14 |
Romania | 3,062 | 3,062 | 460 | 460 | 5 | 5 | 27 | 27 | 235 | 235 | 96 | 96 |
Slovakia | 583 | 583 | 47 | 47 | 4 | 4 | 5 | 5 | 53 | 53 | 49 | 49 |
Slovenia | 306 | 306 | 25 | 25 | 0 | 0 | 2 | 2 | 39 | 39 | 30 | 30 |
Spain | 3,812 | 3,812 | 907 | 907 | 177 | 177 | 125 | 125 | 413 | 413 | 133 | 133 |
Sweden | 1,642 | 1,642 | 211 | 211 | 10 | 10 | 45 | 45 | 139 | 139 | 110 | 110 |
Iceland | 211 | 211 | 9 | 9 | 0 | 0 | 0 | 0 | 8 | 8 | 4 | 4 |
Liechtenstein | 6 | 6 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Norway | 1,389 | 1,389 | 97 | 97 | 19 | 19 | 20 | 20 | 122 | 122 | 74 | 74 |
Total EU | 99,974 | 99,974 | 8,279 | 8,279 | 2,567 | 2,567 | 1,421 | 1,421 | 5,672 | 5,672 | 4,291 | 4,291 |
Total EEA | 101,580 | 101,580 | 8,385 | 8,385 | 2,586 | 2,586 | 1,441 | 1,441 | 5,802 | 5,802 | 4,369 | 4,369 |
SLI 14.2.2
Views/impressions of and interaction/engagement at the Member State level (e.g. likes, shares, comments), related to each identified TTP, before and after action was taken.
TTP 1
TTP 5
TTP 7
TTP 9
Country | TTP OR ACTION 5 - Number of videos removed with 0 views | TTP OR ACTION 5 - Number of videos removed with 1-10 views | TTP OR ACTION 5 - Number of videos removed with 11-100 views | TTP OR ACTION 5 - Number of videos removed with 101-1,000 views | TTP OR ACTION 5 - Number of videos removed with 1,001- 10,000 views | TTP OR ACTION 5 - Number of videos removed with >10,000 views | TTP OR ACTION 5 - Views after action | TTP OR ACTION 7 - Number of videos removed with 0 views | TTP OR ACTION 7 - Number of videos removed with 1-10 views | TTP OR ACTION 7 - Number of videos removed with 11-100 views | TTP OR ACTION 7 - Number of videos removed with 101-1,000 views | TTP OR ACTION 7 - Number of videos removed with 1,001- 10,000 views | TTP OR ACTION 7 - Number of videos removed with >10,000 views | TTP OR ACTION 7 - Views after action | TTP OR ACTION 9 - Number of videos removed with 0 views | TTP OR ACTION 9 - Number of videos removed with 1-10 views | TTP OR ACTION 9 - Number of videos removed with 11-100 views | TTP OR ACTION 9 - Number of videos removed with 101-1,000 views | TTP OR ACTION 9 - Number of videos removed with 1,001- 10,000 views | TTP OR ACTION 9 - Number of videos removed with >10,000 views | TTP OR ACTION 9 - Views after action |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Austria | 1 | 0 | 0 | 2 | 1 | 0 | 0 | 1 | 7 | 6 | 0 | 2 | 3 | 0 | 0 | 1 | 13 | 19 | 13 | 21 | 0 |
Belgium | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 8 | 9 | 5 | 1 | 10 | 5 | 0 | 0 | 5 | 13 | 23 | 21 | 19 | 0 |
Bulgaria | 1 | 0 | 0 | 0 | 1 | 0 | 0 | 4 | 3 | 5 | 7 | 4 | 3 | 0 | 0 | 1 | 3 | 6 | 10 | 10 | 0 |
Croatia | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 2 | 1 | 0 | 0 | 0 | 0 | 0 | 2 | 1 | 3 | 5 | 2 | 0 |
Cyprus | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 1 | 5 | 2 | 6 | 8 | 4 | 0 | 0 | 1 | 5 | 11 | 24 | 6 | 0 |
Czech Republic | 1 | 0 | 0 | 1 | 3 | 2 | 0 | 2 | 2 | 7 | 2 | 1 | 5 | 0 | 0 | 2 | 25 | 69 | 61 | 26 | 0 |
Denmark | 2 | 1 | 8 | 1 | 0 | 0 | 0 | 1 | 5 | 2 | 0 | 0 | 0 | 0 | 0 | 3 | 12 | 16 | 16 | 7 | 0 |
Estonia | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 1 | 2 | 9 | 6 | 1 | 0 |
Finland | 21 | 3 | 3 | 10 | 8 | 0 | 0 | 3 | 8 | 6 | 2 | 0 | 0 | 0 | 0 | 1 | 4 | 20 | 7 | 6 | 0 |
France | 15 | 10 | 26 | 123 | 62 | 1 | 0 | 28 | 74 | 63 | 23 | 23 | 25 | 0 | 3 | 16 | 58 | 143 | 116 | 58 | 0 |
Germany | 984 | 190 | 88 | 86 | 63 | 29 | 0 | 70 | 95 | 59 | 48 | 35 | 31 | 0 | 3 | 26 | 89 | 266 | 150 | 107 | 0 |
Greece | 1 | 4 | 1 | 0 | 0 | 0 | 0 | 13 | 11 | 10 | 14 | 24 | 24 | 0 | 0 | 1 | 8 | 23 | 13 | 14 | 0 |
Hungary | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 4 | 1 | 2 | 1 | 0 | 0 | 0 | 1 | 5 | 5 | 7 | 5 | 0 |
Ireland | 3 | 1 | 2 | 75 | 21 | 0 | 0 | 11 | 12 | 8 | 5 | 12 | 7 | 0 | 2 | 5 | 18 | 38 | 22 | 16 | 0 |
Italy | 3 | 1 | 109 | 104 | 31 | 2 | 0 | 15 | 29 | 16 | 11 | 7 | 7 | 0 | 1 | 13 | 19 | 58 | 62 | 24 | 0 |
Latvia | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 6 | 0 | 0 | 1 | 0 | 0 | 0 | 1 | 7 | 20 | 12 | 5 | 0 |
Lithuania | 2 | 3 | 0 | 5 | 0 | 0 | 0 | 0 | 1 | 2 | 0 | 1 | 1 | 0 | 0 | 0 | 2 | 12 | 7 | 5 | 0 |
Luxembourg | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 5 | 2 | 0 | 0 |
Malta | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 0 | 0 | 0 | 1 | 0 | 1 | 2 | 1 | 0 |
Netherlands | 28 | 66 | 27 | 38 | 19 | 17 | 0 | 18 | 36 | 16 | 15 | 20 | 38 | 0 | 6 | 34 | 149 | 349 | 273 | 55 | 0 |
Poland | 1 | 0 | 1 | 0 | 2 | 2 | 0 | 8 | 10 | 11 | 4 | 6 | 6 | 0 | 128 | 258 | 209 | 231 | 105 | 51 | 0 |
Portugal | 3 | 2 | 27 | 18 | 0 | 0 | 0 | 4 | 12 | 2 | 4 | 3 | 2 | 0 | 0 | 0 | 0 | 7 | 5 | 2 | 0 |
Romania | 3 | 0 | 0 | 2 | 0 | 0 | 0 | 2 | 5 | 5 | 5 | 6 | 4 | 0 | 0 | 6 | 12 | 30 | 23 | 25 | 0 |
Slovakia | 0 | 0 | 0 | 2 | 2 | 0 | 0 | 0 | 2 | 0 | 1 | 1 | 1 | 0 | 0 | 5 | 12 | 14 | 13 | 5 | 0 |
Slovenia | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 4 | 10 | 9 | 7 | 0 |
Spain | 8 | 7 | 24 | 40 | 35 | 63 | 0 | 14 | 34 | 23 | 28 | 15 | 11 | 0 | 1 | 7 | 18 | 41 | 38 | 28 | 0 |
Sweden | 1 | 1 | 1 | 4 | 3 | 0 | 0 | 6 | 16 | 10 | 6 | 4 | 3 | 0 | 0 | 2 | 14 | 42 | 36 | 16 | 0 |
Iceland | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 2 | 1 | 0 | 0 |
Liechtenstein | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Norway | 2 | 1 | 1 | 15 | 0 | 0 | 0 | 1 | 12 | 2 | 2 | 0 | 3 | 0 | 0 | 4 | 10 | 27 | 20 | 13 | 0 |
Total EU | 1,081 | 289 | 317 | 511 | 251 | 118 | 0 | 217 | 389 | 264 | 186 | 184 | 181 | 0 | 144 | 393 | 703 | 1,471 | 1,058 | 522 | 0 |
Total EEA | 1,083 | 290 | 318 | 526 | 251 | 118 | 0 | 218 | 401 | 266 | 188 | 184 | 184 | 0 | 144 | 397 | 714 | 1,500 | 1,079 | 535 | 0 |
SLI 14.2.3
Metrics to estimate the penetration and impact that e.g. Fake/Inauthentic accounts have on genuine users and report at the Member State level (including trends on audiences targeted; narratives used etc.).
TTP 1
TTP 5
TTP 7
TTP 9
SLI 14.2.4
Estimation, at the Member State level, of TTPs related content, views/impressions and interaction/engagement with such content as a percentage of the total content, views/impressions and interaction/engagement on relevant signatories' service.
TTP 1
TTP 5
TTP 7
TTP 9
Country | TTP OR ACTION 1 - Percentage of TTP 1 channel removals out of all related channel removals | TTP OR ACTION 5 - Percentage of TTP 5 channel removals out of all related channel removals | TTP OR ACTION 5 - Percentage of TTP 5 video removals out of all related video removals | TTP OR ACTION 7 - Percentage of TTP 7 video removals out of all related video removals | TTP OR ACTION 9 - Percentage of TTP 9 channel removals out of all related channel removals | TTP OR ACTION 9 - Percentage of TTP 9 video removals out of all related video removals |
---|---|---|---|---|---|---|
Austria | 43.12% | 1.93% | 0.03% | 0.13% | 1.02% | 0.46% |
Belgium | 32.95% | 3.56% | 0.00% | 0.16% | 2.16% | 0.35% |
Bulgaria | 27.23% | 2.96% | 0.01% | 0.12% | 1.51% | 0.14% |
Croatia | 20.87% | 2.73% | 0.00% | 0.05% | 1.49% | 0.17% |
Cyprus | 31.38% | 3.56% | 0.04% | 0.51% | 4.74% | 0.93% |
Czech Republic | 28.11% | 2.44% | 0.02% | 0.05% | 2.14% | 0.51% |
Denmark | 23.00% | 2.36% | 0.07% | 0.05% | 3.34% | 0.33% |
Estonia | 12.63% | 1.60% | 0.00% | 0.05% | 1.01% | 0.33% |
Finland | 24.04% | 3.15% | 0.41% | 0.17% | 2.03% | 0.35% |
France | 27.01% | 2.36% | 0.18% | 0.18% | 1.11% | 0.30% |
Germany | 23.67% | 2.92% | 0.65% | 0.15% | 1.58% | 0.29% |
Greece | 9.14% | 0.30% | 0.04% | 0.63% | 0.27% | 0.38% |
Hungary | 37.43% | 2.48% | 0.01% | 0.05% | 1.58% | 0.12% |
Ireland | 53.86% | 1.07% | 0.65% | 0.35% | 0.56% | 0.64% |
Italy | 30.51% | 4.47% | 0.25% | 0.09% | 1.72% | 0.18% |
Latvia | 29.59% | 2.23% | 0.00% | 0.09% | 1.65% | 0.53% |
Lithuania | 66.89% | 0.32% | 0.10% | 0.05% | 0.93% | 0.26% |
Luxembourg | 37.27% | 1.74% | 0.00% | 0.40% | 1.13% | 0.65% |
Malta | 31.08% | 2.09% | 0.00% | 0.14% | 2.74% | 0.36% |
Netherlands | 21.13% | 1.70% | 0.27% | 0.20% | 2.32% | 1.18% |
Poland | 37.06% | 1.85% | 0.01% | 0.05% | 2.76% | 1.06% |
Portugal | 30.35% | 2.01% | 0.18% | 0.10% | 1.78% | 0.05% |
Romania | 18.71% | 2.81% | 0.01% | 0.03% | 1.44% | 0.12% |
Slovakia | 23.10% | 1.86% | 0.03% | 0.04% | 2.10% | 0.39% |
Slovenia | 32.83% | 2.68% | 0.00% | 0.07% | 4.18% | 1.03% |
Spain | 20.06% | 4.77% | 0.15% | 0.10% | 2.17% | 0.11% |
Sweden | 27.20% | 3.50% | 0.04% | 0.16% | 2.30% | 0.39% |
Iceland | 40.50% | 1.73% | 0.00% | 0.00% | 1.54% | 0.38% |
Liechtenstein | 15.38% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% |
Norway | 30.95% | 2.16% | 0.14% | 0.14% | 2.72% | 0.54% |
Total EU | 27.61% | 2.29% | 0.23% | 0.13% | 1.57% | 0.39% |
Total EEA | 27.67% | 2.28% | 0.23% | 0.13% | 1.58% | 0.39% |
Measure 14.3
Relevant Signatories will convene via the Permanent Task-force to agree upon and publish a list and terminology of TTPs employed by malicious actors, which should be updated on an annual basis.
QRE 14.3.1
Signatories will report on the list of TTPs agreed in the Permanent Task-force within 6 months of the signing of the Code and will update this list at least every year. They will also report about the common baseline elements, objectives and benchmarks for the policies and measures.
Commitment 15
Relevant Signatories that develop or operate AI systems and that disseminate AI-generated and manipulated content through their services (e.g. deepfakes) commit to take into consideration the transparency obligations and the list of manipulative practices prohibited under the proposal for Artificial Intelligence Act.
We signed up to the following measures of this commitment
Measure 15.1 Measure 15.2
In line with this commitment, did you deploy new implementation measures (e.g. changes to your terms of service, new tools, new policies, etc)?
If yes, list these implementation measures here
- After joining the Coalition for Content Provenance and Authenticity (C2PA), a cross-industry effort to help provide more transparency and context for people on AI-generated content, in February 2024, Google collaborated on the newest version (2.1) of the coalition’s technical standard, Content Credentials. This version is more secure against a wider range of tampering attacks due to stricter technical requirements for validating the history of the content’s provenance.
- In July 2024 at the Aspen Security Forum, Google, alongside industry peers, introduced the Coalition for Secure AI (CoSAI) to advance comprehensive security measures for addressing the unique risks that come with AI, for both issues that arise in real time and those over the horizon. The first three areas of focus the coalition will tackle in collaboration with industry and academia include Software Supply Chain Security for AI systems; Preparing defenders for a changing cybersecurity landscape; and AI security governance.
- In September 2024, Google announced a Global AI Opportunity Fund, which will invest $120 million to make AI education and training available in communities around the world. Google will provide this in local languages, in partnership with nonprofits and NGOs.
- In October 2024, Google released its EU AI Opportunity Agenda, a series of recommendations for governments to seize the full economic and societal potential of AI. The Agenda outlines the need to revisit Europe’s workforce strategy, as well as investment in AI infrastructure and research, adoption and accessibility.
- In October 2024, The Nobel Prize was awarded to Google DeepMind’s Demis Hassabis and John Jumper for their groundbreaking work with AlphaFold 2, which predicted the structures for nearly all proteins known to science. It has been used by more than 2 million researchers around the world, accelerating scientific discovery in important areas like malaria vaccines, cancer treatments, and more.
Do you plan to put further implementation measures in place in the next 6 months to substantially improve the maturity of the implementation of this commitment?
If yes, which further implementation measures do you plan to put in place in the next 6 months?
Measure 15.1
Relevant signatories will establish or confirm their policies in place for countering prohibited manipulative practices for AI systems that generate or manipulate content, such as warning users and proactively detect such content.
QRE 15.1.1
In line with EU and national legislation, Relevant Signatories will report on their policies in place for countering prohibited manipulative practices for AI systems that generate or manipulate content.
Measure 15.2
Relevant Signatories will establish or confirm their policies in place to ensure that the algorithms used for detection, moderation and sanctioning of impermissible conduct and content on their services are trustworthy, respect the rights of end-users and do not constitute prohibited manipulative practices impermissibly distorting their behaviour in line with Union and Member States legislation.
QRE 15.2.1
Relevant Signatories will report on their policies and actions to ensure that the algorithms used for detection, moderation and sanctioning of impermissible conduct and content on their services are trustworthy, respect the rights of end-users and do not constitute prohibited manipulative practices in line with Union and Member States legislation.
Commitment 16
Relevant Signatories commit to operate channels of exchange between their relevant teams in order to proactively share information about cross-platform influence operations, foreign interference in information space and relevant incidents that emerge on their respective services, with the aim of preventing dissemination and resurgence on other services, in full compliance with privacy legislation and with due consideration for security and human rights risks.
We signed up to the following measures of this commitment
Measure 16.1 Measure 16.2
In line with this commitment, did you deploy new implementation measures (e.g. changes to your terms of service, new tools, new policies, etc)?
If yes, list these implementation measures here
- Google’s Threat Analysis Group (TAG) published its Q3 2024, and Q4 2024 Quarterly Bulletin, which provides updates around coordinated influence operation campaigns terminated on Google’s platforms.
- In H2 2024 (1 July 2024 to 31 December 2024), Google TAG published 2 examples of information sharing and learnings in the TAG Blog:
Do you plan to put further implementation measures in place in the next 6 months to substantially improve the maturity of the implementation of this commitment?
If yes, which further implementation measures do you plan to put in place in the next 6 months?
Measure 16.1
Relevant Signatories will share relevant information about cross-platform information manipulation, foreign interference in information space and incidents that emerge on their respective services for instance via a dedicated sub-group of the permanent Task-force or via existing fora for exchanging such information.
QRE 16.1.1
Relevant Signatories will disclose the fora they use for information sharing as well as information about learnings derived from this sharing.
See Google’s disclosure policies about handling security vulnerabilities for developers and security professionals.
SLI 16.1.1
Number of actions taken as a result of the collaboration and information sharing between signatories. Where they have such information, they will specify which Member States that were affected (including information about the content being detected and acted upon due to this collaboration).
As reported in the Bulletin, some channels YouTube took action on were part of campaigns that uploaded content in some EEA languages, specifically: French (546 channels), German (460 channels), Polish (389 channels), Italian (362 channels), Spanish (128 channels), Romanian (15 channels), Czech (12 Channels), and Hungarian (12 channels). Certain campaigns may have uploaded content in multiple languages, or in other countries outside of the EEA region utilising EEA languages. Please note that there may be many languages for any one coordinated influence campaign and that the presence of content in an EEA Member State language does not necessarily entail a particular focus on that Member State. For more information, please see the TAG Bulletin.
Measure 16.2
Relevant Signatories will pay specific attention to and share information on the tactical migration of known actors of misinformation, disinformation and information manipulation across different platforms as a way to circumvent moderation policies, engage different audiences or coordinate action on platforms with less scrutiny and policy bandwidth.
QRE 16.2.1
As a result of the collaboration and information sharing between them, Relevant Signatories will share qualitative examples and case studies of migration tactics employed and advertised by such actors on their platforms as observed by their moderation team and/or external partners from Academia or fact-checking organisations engaged in such monitoring.
The most recent examples of specific tactics, techniques, and procedures (TTPs) used to lure victims, as well as how Google collaborates and shares information, can be found in Google’s TAG Blog.
Empowering Users
Commitment 17
In light of the European Commission's initiatives in the area of media literacy, including the new Digital Education Action Plan, Relevant Signatories commit to continue and strengthen their efforts in the area of media literacy and critical thinking, also with the aim to include vulnerable groups.
We signed up to the following measures of this commitment
Measure 17.1 Measure 17.2 Measure 17.3
In line with this commitment, did you deploy new implementation measures (e.g. changes to your terms of service, new tools, new policies, etc)?
If yes, list these implementation measures here
Do you plan to put further implementation measures in place in the next 6 months to substantially improve the maturity of the implementation of this commitment?
If yes, which further implementation measures do you plan to put in place in the next 6 months?
Measure 17.1
Relevant Signatories will design and implement or continue to maintain tools to improve media literacy and critical thinking, for instance by empowering users with context on the content visible on services or with guidance on how to evaluate online content.
QRE 17.1.1
Relevant Signatories will outline the tools they develop or maintain that are relevant to this commitment and report on their deployment in each Member State.
SLI 17.1.1
Relevant Signatories will report, at the Member State level, on metrics pertinent to assessing the effects of the tools described in the qualitative reporting element for Measure 17.1, which will include: the total count of impressions of the tool; and information on the interactions/engagement with the tool.
Country | Impressions of information panels (excluding fact-check panels, crisis resource panels and non-COVID medical panels) |
---|---|
Austria | 35,930,356 |
Belgium | 140,278,448 |
Bulgaria | 34,494,718 |
Croatia | 45,489,297 |
Cyprus | 4,709,568 |
Czech Republic | 76,755,521 |
Denmark | 18,153,587 |
Estonia | 13,864,098 |
Finland | 14,400,111 |
France | 909,171,599 |
Germany | 1,931,996,858 |
Greece | 29,433,930 |
Hungary | 55,347,902 |
Ireland | 68,473,652 |
Italy | 559,067,820 |
Latvia | 39,720,895 |
Lithuania | 36,214,789 |
Luxembourg | 2,825,126 |
Malta | 2,407,322 |
Netherlands | 357,656,982 |
Poland | 187,672,506 |
Portugal | 36,677,338 |
Romania | 90,075,363 |
Slovakia | 25,112,829 |
Slovenia | 14,414,991 |
Spain | 417,913,504 |
Sweden | 109,624,386 |
Iceland | 1,117,258 |
Liechtenstein | 149,057 |
Norway | 19,947,673 |
Total EU | 5,257,883,496 |
Total EEA | 5,279,097,484 |
Measure 17.2
Relevant Signatories will develop, promote and/or support or continue to run activities to improve media literacy and critical thinking such as campaigns to raise awareness about Disinformation, as well as the TTPs that are being used by malicious actors, among the general public across the European Union, also considering the involvement of vulnerable communities.
QRE 17.2.1
Relevant Signatories will describe the activities they launch or support and the Member States they target and reach. Relevant signatories will further report on actions taken to promote the campaigns to their user base per Member States targeted.
- In H2 2024, Google.org announced $10 million in funding to the Raspberry Pi Foundation to further expand access to Experience AI. This educational program was co-created with Google DeepMind as part of Google.org’s broader commitment to support organisations helping young people build AI literacy.
- Experience AI provides teachers with the training and resources needed to both educate and inspire young people aged 11-14 about AI.
- The curriculum focuses on a structured learning journey, ethical considerations, real-world examples and role models, and culturally relevant content to engage learners in understanding AI and how to use it responsibly. Raspberry Pi Foundation and Google DeepMind continued to develop further resources, including three new lessons centred around AI safety: AI and Your Data, Media Literacy in the Age of AI, and Using Generative AI Responsibly.
SLI 17.2.1
Relevant Signatories report on number of media literacy and awareness raising activities organised and or participated in and will share quantitative information pertinent to show the effects of the campaigns they build or support at the Member State level.
Country | Impressions from YouTube's media literacy campaigns |
---|---|
Austria | 3,051,110 |
Belgium | 4,052,296 |
Bulgaria | 5,131,069 |
Croatia | 3,451,905 |
Cyprus | 633,076 |
Czech Republic | 10,984,244 |
Denmark | 4,651,692 |
Estonia | 622,296 |
Finland | 3,382,016 |
France | 11,950,238 |
Germany | 33,707,796 |
Greece | 11,984,135 |
Hungary | 3,544,139 |
Ireland | 3,009,023 |
Italy | 25,554,069 |
Latvia | 1,016,128 |
Lithuania | 1,958,077 |
Luxembourg | 177,872 |
Malta | 202,535 |
Netherlands | 10,340,630 |
Poland | 45,007,000 |
Portugal | 5,495,194 |
Romania | 9,622,147 |
Slovakia | 5,236,812 |
Slovenia | 1,365,628 |
Spain | 28,050,584 |
Sweden | 6,719,603 |
Iceland | 112,624 |
Liechtenstein | 18,828 |
Norway | 1,119,845 |
Total EU | 240,901,314 |
Total EEA | 242,152,611 |
Measure 17.3
For both of the above Measures, and in order to build on the expertise of media literacy experts in the design, implementation, and impact measurement of tools, relevant Signatories will partner or consult with media literacy experts in the EU, including for instance the Commission's Media Literacy Expert Group, ERGA's Media Literacy Action Group, EDMO, its country-specific branches, or relevant Member State universities or organisations that have relevant expertise.
QRE 17.3.1
Relevant Signatories will describe how they involved and partnered with media literacy experts for the purposes of all Measures in this Commitment.
Commitment 18
Relevant Signatories commit to minimise the risks of viral propagation of Disinformation by adopting safe design practices as they develop their systems, policies, and features.
We signed up to the following measures of this commitment
Measure 18.1 Measure 18.2 Measure 18.3
In line with this commitment, did you deploy new implementation measures (e.g. changes to your terms of service, new tools, new policies, etc)?
If yes, list these implementation measures here
Do you plan to put further implementation measures in place in the next 6 months to substantially improve the maturity of the implementation of this commitment?
If yes, which further implementation measures do you plan to put in place in the next 6 months?
Measure 18.2
Relevant Signatories will develop and enforce publicly documented, proportionate policies to limit the spread of harmful false or misleading information (as depends on the service, such as prohibiting, downranking, or not recommending harmful false or misleading information, adapted to the severity of the impacts and with due regard to freedom of expression and information); and take action on webpages or actors that persistently violate these policies.
QRE 18.2.1
Relevant Signatories will report on the policies or terms of service that are relevant to Measure 18.2 and on their approach towards persistent violations of these policies.
SLI 18.2.1
Relevant Signatories will report on actions taken in response to violations of policies relevant to Measure 18.2, at the Member State level. The metrics shall include: Total number of violations and Meaningful metrics to measure the impact of these actions (such as their impact on the visibility of or the engagement with content that was actioned upon).
Country | Number of videos removed | Number of videos removed with 0 views | Number of videos removed with 1-10 views | Number of videos removed with 11-100 views | Number of videos removed with 101-1,000 views | Number of videos removed with 1,001-10,000 views | Number of videos removed with >10,000 views |
---|---|---|---|---|---|---|---|
Austria | 196 | 19 | 59 | 55 | 28 | 26 | 9 |
Belgium | 200 | 30 | 53 | 56 | 32 | 22 | 7 |
Bulgaria | 128 | 28 | 27 | 20 | 30 | 15 | 8 |
Croatia | 54 | 9 | 12 | 17 | 8 | 6 | 2 |
Cyprus | 71 | 5 | 15 | 13 | 14 | 17 | 7 |
Czech Republic | 95 | 7 | 19 | 31 | 16 | 8 | 14 |
Denmark | 112 | 7 | 23 | 36 | 30 | 12 | 4 |
Estonia | 74 | 5 | 22 | 19 | 17 | 9 | 2 |
Finland | 110 | 19 | 32 | 22 | 22 | 13 | 2 |
France | 1,019 | 115 | 312 | 283 | 150 | 102 | 57 |
Germany | 1,808 | 205 | 453 | 498 | 362 | 201 | 89 |
Greece | 225 | 30 | 45 | 42 | 42 | 39 | 27 |
Hungary | 69 | 6 | 26 | 19 | 9 | 5 | 4 |
Ireland | 614 | 68 | 233 | 158 | 87 | 52 | 16 |
Italy | 1,279 | 123 | 390 | 348 | 243 | 113 | 62 |
Latvia | 87 | 8 | 26 | 24 | 14 | 11 | 4 |
Lithuania | 88 | 8 | 27 | 27 | 13 | 9 | 4 |
Luxembourg | 9 | 3 | 0 | 5 | 0 | 1 | 0 |
Malta | 10 | 1 | 2 | 1 | 3 | 3 | 0 |
Netherlands | 723 | 77 | 183 | 200 | 123 | 85 | 55 |
Poland | 237 | 38 | 54 | 66 | 38 | 25 | 16 |
Portugal | 242 | 39 | 66 | 54 | 50 | 23 | 10 |
Romania | 154 | 24 | 39 | 38 | 31 | 18 | 4 |
Slovakia | 34 | 3 | 13 | 10 | 3 | 2 | 3 |
Slovenia | 90 | 8 | 28 | 24 | 27 | 2 | 1 |
Spain | 2,075 | 271 | 539 | 488 | 428 | 244 | 105 |
Sweden | 303 | 26 | 82 | 69 | 76 | 37 | 13 |
Iceland | 10 | 1 | 1 | 2 | 6 | 0 | 0 |
Liechtenstein | 1 | 0 | 0 | 0 | 0 | 1 | 0 |
Norway | 227 | 17 | 43 | 51 | 65 | 43 | 8 |
Total EU | 10,106 | 1,182 | 2,780 | 2,623 | 1,896 | 1,100 | 525 |
Total EEA | 10,344 | 1,200 | 2,824 | 2,676 | 1,967 | 1,144 | 533 |
Measure 18.3
Relevant Signatories will invest and/or participate in research efforts on the spread of harmful Disinformation online and related safe design practices, will make findings available to the public or report on those to the Code's taskforce. They will disclose and discuss findings within the permanent Task-force, and explain how they intend to use these findings to improve existing safe design practices and features or develop new ones.
QRE 18.3.1
Relevant Signatories will describe research efforts, both in-house and in partnership with third-party organisations, on the spread of harmful Disinformation online and relevant safe design practices, as well as actions or changes as a result of this research. Relevant Signatories will include where possible information on financial investments in said research. Wherever possible, they will make their findings available to the general public.
- Accuracy Prompts (APs): APs remind users to think about accuracy. The prompts work by serving users bite-sized digital literacy tips at a moment when it might matter. Lab studies conducted across 16 countries with over 30,000 participants, suggest that APs increase engagement with accurate information and decrease engagement with less accurate information. Small experiments on YouTube suggest users enjoy the experience and report that it makes them feel safer online.
Commitment 19
Relevant Signatories using recommender systems commit to make them transparent to the recipients regarding the main criteria and parameters used for prioritising or deprioritising information, and provide options to users about recommender systems, and make available information on those options.
We signed up to the following measures of this commitment
Measure 19.1 Measure 19.2
In line with this commitment, did you deploy new implementation measures (e.g. changes to your terms of service, new tools, new policies, etc)?
If yes, list these implementation measures here
Do you plan to put further implementation measures in place in the next 6 months to substantially improve the maturity of the implementation of this commitment?
If yes, which further implementation measures do you plan to put in place in the next 6 months?
Measure 19.1
Relevant Signatories will make available to their users, including through the Transparency Centre and in their terms and conditions, in a clear, accessible and easily comprehensible manner, information outlining the main parameters their recommender systems employ.
QRE 19.1.1
Relevant Signatories will provide details of the policies and measures put in place to implement the above-mentioned measures accessible to EU users, especially by publishing information outlining the main parameters their recommender systems employ in this regard. This information should also be included in the Transparency Centre.
- Homepage: A user’s homepage is what they typically see when they first open YouTube.
- Up Next: The Up Next panel appears when a user is watching a video. It suggests additional content based on what they are currently watching and personalised signals (details below).
- Shorts: Shorts are ranked based on their performance and relevancy to that individual viewer.
- Watch history: YouTube’s system uses the videos a user watches to give better recommendations, remember where a user left off, and more.
- Search history: YouTube’s system uses what a user searches for on YouTube to influence future recommendations.
- Channel subscriptions: YouTube’s system uses information about the channels a user subscribes to in order to recommend videos they may like.
- Likes: YouTube’s system uses a user’s likes information to try to predict the likelihood that they will be interested in similar videos in the future.
- Dislikes: YouTube’s system uses videos a user dislikes to inform what to avoid recommending in the future.
- 'Not interested' feedback selections: YouTube’s system uses videos a user marks as 'Not interested' to inform what to avoid recommending in the future.
- 'Don’t recommend channel' feedback selections: YouTube’s system uses 'Don’t recommend channel' feedback selections as a signal that the channel content likely is not something a user enjoyed watching.
- Satisfaction surveys: YouTube’s system uses user surveys that ask a user to rate videos that they watched, which helps the system understand satisfaction, not just watch time.
Additional information about how a user can manage their recommendation settings are outlined here in YouTube’s Help Centre.
Measure 19.2
Relevant Signatories will provide options for the recipients of the service to select and to modify at any time their preferred options for relevant recommender systems, including giving users transparency about those options.
SLI 19.2.1
Relevant Signatories will provide aggregated information on effective user settings, such as the number of times users have actively engaged with these settings within the reporting period or over a sample representative timeframe, and clearly denote shifts in configuration patterns.
Country | Percentage of daily active users that are signed in |
---|---|
Austria | 69% |
Belgium | 71% |
Bulgaria | 73% |
Croatia | 74% |
Cyprus | 75% |
Czech Republic | 72% |
Denmark | 65% |
Estonia | 73% |
Finland | 70% |
France | 72% |
Germany | 69% |
Greece | 74% |
Hungary | 73% |
Ireland | 67% |
Italy | 76% |
Latvia | 73% |
Lithuania | 75% |
Luxembourg | 67% |
Malta | 74% |
Netherlands | 70% |
Poland | 75% |
Portugal | 76% |
Romania | 76% |
Slovakia | 73% |
Slovenia | 72% |
Spain | 76% |
Sweden | 66% |
Iceland | 67% |
Liechtenstein | 57% |
Norway | 63% |
Total EU | 72% |
Total EEA | 72% |
Commitment 22
Relevant Signatories commit to provide users with tools to help them make more informed decisions when they encounter online information that may be false or misleading, and to facilitate user access to tools and information to assess the trustworthiness of information sources, such as indicators of trustworthiness for informed online navigation, particularly relating to societal issues or debates of general interest.
We signed up to the following measures of this commitment
Measure 22.7
In line with this commitment, did you deploy new implementation measures (e.g. changes to your terms of service, new tools, new policies, etc)?
If yes, list these implementation measures here
Do you plan to put further implementation measures in place in the next 6 months to substantially improve the maturity of the implementation of this commitment?
If yes, which further implementation measures do you plan to put in place in the next 6 months?
Measure 22.7
Relevant Signatories will design and apply products and features (e.g. information panels, banners, pop-ups, maps and prompts, trustworthiness indicators) that lead users to authoritative sources on topics of particular public and societal interest or in crisis situations.
QRE 22.7.1
Relevant Signatories will outline the products and features they deploy across their services and will specify whether those are available across Member States.
- Panels on topics prone to misinformation: Topics that are prone to misinformation, such as the moon landing, may display an information panel at the top of search results or under a video. These information panels show basic background information, sourced from independent, third-party partners, to give more context on a topic. The panels also link to the third-party partner’s website. YouTube continues to assess and update the topics prone to misinformation that receive additional context from information panels. More details found here.
- Election information panels: The election-related features are only available in select countries/regions during election cycles. Users may see candidate information panels, voting information panels, election integrity information panels, or election results information panels. More details found here.
- Health-related information panels: Health-related topics, such as cancer treatment misinformation, may have a health information panel in your search results. These panels show info like symptoms, prevention and treatment options. More details found here.
- Crisis resource panels: These panels let users connect with live support, 24/7 from recognised service partners. The panels may surface on the Watch page, when a user watches videos on topics related to suicide or self-harm, or in search results, when a user searches for topics related to certain health crises or emotional distress. More details found here.
SLI 22.7.1
Relevant Signatories will report on the reach and/or user interactions with the products or features, at the Member State level, via the metrics of impressions and interactions (clicks, click-through rates (as relevant to the tools and services in question) and shares (as relevant to the tools and services in question).
Country | Impressions of information panels (excluding fact-check panels, crisis resource panels and non-COVID medical panels) |
---|---|
Austria | 35,930,356 |
Belgium | 140,278,448 |
Bulgaria | 34,494,718 |
Croatia | 45,489,297 |
Cyprus | 4,709,568 |
Czech Republic | 76,755,521 |
Denmark | 18,153,587 |
Estonia | 13,864,098 |
Finland | 14,400,111 |
France | 909,171,599 |
Germany | 1,931,996,858 |
Greece | 29,433,930 |
Hungary | 55,347,902 |
Ireland | 68,473,652 |
Italy | 559,067,820 |
Latvia | 39,720,895 |
Lithuania | 36,214,789 |
Luxembourg | 2,825,126 |
Malta | 2,407,322 |
Netherlands | 357,656,982 |
Poland | 187,672,506 |
Portugal | 36,677,338 |
Romania | 90,075,363 |
Slovakia | 25,112,829 |
Slovenia | 14,414,991 |
Spain | 417,913,504 |
Sweden | 109,624,386 |
Iceland | 1,117,258 |
Liechtenstein | 149,057 |
Norway | 19,947,673 |
Total EU | 5,257,883,496 |
Total EEA | 5,279,097,484 |
Commitment 23
Relevant Signatories commit to provide users with the functionality to flag harmful false and/or misleading information that violates Signatories policies or terms of service.
We signed up to the following measures of this commitment
Measure 23.1 Measure 23.2
In line with this commitment, did you deploy new implementation measures (e.g. changes to your terms of service, new tools, new policies, etc)?
If yes, list these implementation measures here
Do you plan to put further implementation measures in place in the next 6 months to substantially improve the maturity of the implementation of this commitment?
If yes, which further implementation measures do you plan to put in place in the next 6 months?
Measure 23.1
Relevant Signatories will develop or continue to make available on all their services and in all Member States languages in which their services are provided a user-friendly functionality for users to flag harmful false and/or misleading information that violates Signatories' policies or terms of service. The functionality should lead to appropriate, proportionate and consistent follow-up actions, in full respect of the freedom of expression.
QRE 23.1.1
Relevant Signatories will report on the availability of flagging systems for their policies related to harmful false and/or misleading information across EU Member States and specify the different steps that are required to trigger the systems.
Measure 23.2
Relevant Signatories will take the necessary measures to ensure that this functionality is duly protected from human or machine-based abuse (e.g., the tactic of 'mass-flagging' to silence other voices).
QRE 23.2.1
Relevant Signatories will report on the general measures they take to ensure the integrity of their reporting and appeals systems, while steering clear of disclosing information that would help would-be abusers find and exploit vulnerabilities in their defences.
- Having a dedicated team to identify and mitigate the impact of sophisticated bad actors on YouTube at scale, while protecting the broader community;
- Partnering with Google’s Threat Analysis Group (TAG) and Trust & Safety Teams to monitor malicious actors around the globe, disable their accounts, and remove the content that they post (See QRE 16.1.1 and QRE 16.2.1);
- Educating users about Community Guidelines violations through its guided policy experience;
- Providing clear communication on appeals processes and notifications, and regular policy updates on its Help Centre;
- Investing in automated systems to provide efficient detection of content to be evaluated by human reviewers.
For more detailed information about YouTube’s complaint handling systems (i.e. appeals), please see the latest VLOSE/VLOP Transparency Report under the European Union Digital Services Act (EU DSA).
Commitment 24
Relevant Signatories commit to inform users whose content or accounts has been subject to enforcement actions (content/accounts labelled, demoted or otherwise enforced on) taken on the basis of violation of policies relevant to this section (as outlined in Measure 18.2), and provide them with the possibility to appeal against the enforcement action at issue and to handle complaints in a timely, diligent, transparent, and objective manner and to reverse the action without undue delay where the complaint is deemed to be founded.
We signed up to the following measures of this commitment
Measure 24.1
In line with this commitment, did you deploy new implementation measures (e.g. changes to your terms of service, new tools, new policies, etc)?
If yes, list these implementation measures here
Do you plan to put further implementation measures in place in the next 6 months to substantially improve the maturity of the implementation of this commitment?
If yes, which further implementation measures do you plan to put in place in the next 6 months?
Measure 24.1
Relevant Signatories commit to provide users with information on why particular content or accounts have been labelled, demoted, or otherwise enforced on, on the basis of violation of policies relevant to this section, as well as the basis for such enforcement action, and the possibility for them to appeal through a transparent mechanism.
QRE 24.1.1
Relevant Signatories will report on the availability of their notification and appeals systems across Member States and languages and provide details on the steps of the appeals procedure.
- Appeal a Community Guidelines strike;
- Appeal a Community Guidelines video removal;
- Appeal the age restriction of a video;
- Appeal playlist or thumbnail removals;
- Appeal a channel termination.
After a creator submits an appeal
- If YouTube finds that a user’s content followed YouTube’s Community Guidelines, YouTube will reinstate it and remove the strike from their channel. If a user appeals a warning and the appeal is granted, the next offence will be a warning.
- If YouTube finds that a user’s content followed YouTube’s Community Guidelines, but is not appropriate for all audiences, YouTube will apply an age-restriction. If it is a video, it will not be visible to users who are signed out, are under 18 years of age, or have Restricted Mode turned on. If it is a custom thumbnail, it will be removed.
- If YouTube finds that a user’s content was in violation of YouTube’s Community Guidelines, the strike will stay and the video will remain down from the site. There is no additional penalty for appeals that are rejected.
For more information about YouTube’s median time needed to action a complaint, please see the latest VLOSE/VLOP Transparency Report under the European Union Digital Services Act (EU DSA).
SLI 24.1.1
Relevant Signatories provide information on the number and nature of enforcement actions for policies described in response to Measure 18.2, the numbers of such actions that were subsequently appealed, the results of these appeals, information, and to the extent possible metrics, providing insight into the duration or effectiveness of processing of appeals process, and publish this information on the Transparency Centre.
Country | Number of videos removed that were subsequently appealed | Number of videos removed that were then reinstated following a creator’s appeal |
---|---|---|
Austria | 46 | 8 |
Belgium | 26 | 4 |
Bulgaria | 16 | 0 |
Croatia | 10 | 1 |
Cyprus | 4 | 1 |
Czech Republic | 11 | 3 |
Denmark | 18 | 3 |
Estonia | 13 | 2 |
Finland | 28 | 2 |
France | 127 | 18 |
Germany | 282 | 34 |
Greece | 47 | 4 |
Hungary | 11 | 2 |
Ireland | 101 | 5 |
Italy | 186 | 33 |
Latvia | 7 | 0 |
Lithuania | 9 | 1 |
Luxembourg | 0 | 0 |
Malta | 3 | 0 |
Netherlands | 121 | 12 |
Poland | 63 | 7 |
Portugal | 26 | 1 |
Romania | 25 | 2 |
Slovakia | 3 | 0 |
Slovenia | 13 | 0 |
Spain | 276 | 28 |
Sweden | 32 | 4 |
Iceland | 1 | 0 |
Liechtenstein | 0 | 0 |
Norway | 25 | 2 |
Total EU | 1,504 | 175 |
Total EEA | 1,530 | 177 |
Empowering Researchers
Commitment 26
Relevant Signatories commit to provide access, wherever safe and practicable, to continuous, real-time or near real-time, searchable stable access to non-personal data and anonymised, aggregated, or manifestly-made public data for research purposes on Disinformation through automated means such as APIs or other open and accessible technical solutions allowing the analysis of said data.
We signed up to the following measures of this commitment
Measure 26.1 Measure 26.2 Measure 26.3
In line with this commitment, did you deploy new implementation measures (e.g. changes to your terms of service, new tools, new policies, etc)?
If yes, list these implementation measures here
Do you plan to put further implementation measures in place in the next 6 months to substantially improve the maturity of the implementation of this commitment?
If yes, which further implementation measures do you plan to put in place in the next 6 months?
Measure 26.1
Relevant Signatories will provide public access to non-personal data and anonymised, aggregated or manifestly-made public data pertinent to undertaking research on Disinformation on their services, such as engagement and impressions (views) of content hosted by their services, with reasonable safeguards to address risks of abuse (e.g. API policies prohibiting malicious or commercial uses).
QRE 26.1.1
Relevant Signatories will describe the tools and processes in place to provide public access to non-personal data and anonymised, aggregated and manifestly-made public data pertinent to undertaking research on Disinformation, as well as the safeguards in place to address risks of abuse.
Users can also query the same set of results using the YouTube Data API. Use is subject to YouTube’s API Terms of Service.
QRE 26.1.2
Relevant Signatories will publish information related to data points available via Measure 25.1, as well as details regarding the technical protocols to be used to access these data points, in the relevant help centre. This information should also be reachable from the Transparency Centre. At minimum, this information will include definitions of the data points available, technical and methodological information about how they were created, and information about the representativeness of the data.
- Real-time data - a sample covering the last seven days;
- Non-realtime data - a separate sample from real-time data that goes as far back as 2004 and up to 72 hours before one’s search.
- Claim made by: Name of the publisher making the claim;
- Rating text: True or False;
- Fact Check article: The fact-checking article on the publisher's site;
- Claim reviewed: A short summary of the claim being evaluated;
- Tags: The tags that show up next to the claim.
- Search: Access to an API for limited scraping with a budget for quota;
- YouTube: Permission for scraping limited to metadata.
- Paid product placements
- Videos about a product or service because there is a connection between the creator and the maker of the product or service;
- Videos created for a company or business in exchange for compensation or free of charge products/services;
- Videos where that company or business’s brand, message, or product is included directly in the content and the company has given the creator money or free of charge products to make the video.
- Endorsements - Videos created for an advertiser or marketer that contains a message that reflects the opinions, beliefs, or experiences of the creator.
- Sponsorships - Videos that have been financed in whole or in part by a company, without integrating the brand, message, or product directly into the content. Sponsorships generally promote the brand, message, or product of the third party.
SLI 26.1.1
Relevant Signatories will provide quantitative information on the uptake of the tools and processes described in Measure 26.1, such as number of users.
Country | Number of Google Trends users researching YouTube |
---|---|
Austria | 1,535 |
Belgium | 1,748 |
Bulgaria | 1,366 |
Croatia | 702 |
Cyprus | 607 |
Czech Republic | 1,582 |
Denmark | 1,403 |
Estonia | 390 |
Finland | 1,073 |
France | 11,281 |
Germany | 16,423 |
Greece | 1,947 |
Hungary | 2,107 |
Ireland | 2,030 |
Italy | 9,452 |
Latvia | 550 |
Lithuania | 784 |
Luxembourg | 203 |
Malta | 210 |
Netherlands | 5,890 |
Poland | 6,697 |
Portugal | 3,111 |
Romania | 3,000 |
Slovakia | 712 |
Slovenia | 454 |
Spain | 10,955 |
Sweden | 2,726 |
Iceland | 63 |
Liechtenstein | 10 |
Norway | 1,408 |
Total EU | 88,938 |
Total EEA | 90,419 |
Measure 26.2
Relevant Signatories will provide real-time or near real-time, machine-readable access to non-personal data and anonymised, aggregated or manifestly-made public data on their service for research purposes, such as accounts belonging to public figures such as elected official, news outlets and government accounts subject to an application process which is not overly cumbersome.
QRE 26.2.1
Relevant Signatories will describe the tools and processes in place to provide real-time or near real-time access to non-personal data and anonymised, aggregated and manifestly-made public data for research purposes as described in Measure 26.2.
QRE 26.2.2
Relevant Signatories will describe the scope of manifestly-made public data as applicable to their services.
QRE 26.2.3
Relevant Signatories will describe the application process in place to in order to gain the access to non-personal data and anonymised, aggregated and manifestly-made public data described in Measure 26.2.
- Review and confirm the applicant’s eligibility;
- Submit an application, which requires a Google account;
- If approved, the applicant gains permission to access public data relevant to their research.
- YouTube verifies the applicant is an academic researcher affiliated with an accredited, higher-learning institution;
- The Researcher creates an API project in the Google Cloud Console and enables the relevant YouTube APIs. They can learn more by visiting the enabled APIs page;
- The Researcher applies with their institutional email (e.g. with a .edu suffix), includes as much detail as possible, and confirms that all of their information is accurate.
SLI 26.2.1
Relevant Signatories will provide meaningful metrics on the uptake, swiftness, and acceptance level of the tools and processes in Measure 26.2, such as: Number of monthly users (or users over a sample representative timeframe), Number of applications received, rejected, and accepted (over a reporting period or a sample representative timeframe), Average response time (over a reporting period or a sample representative timeframe).
- Cells with '0' under applications received signify that there were no applications submitted by a researcher from that country. Similarly, cells with '0' signify that there were no applications approved, rejected, or under review for that country.
- Applications under review reflect those applications still being processed at the end of the reporting period. The outcomes of these applications will be included in the next reporting period.
- Researchers accessing the Researcher Program API from 1 July 2024 to 31 December 2024 may have been approved before H2 2024. There can be more than one researcher per application.
- Median Application Resolution time is the median number of days from application creation to application resolution. Applications may go back and forth between the applicant and API Ops Agents throughout the approval process. This metric does not reflect YouTube’s first response back to the applicant.
Country | Applications Received | Applications Approved | Applications Rejected | Applications under Review | Number of unique researchers accessing the API | Median application resolution time |
---|---|---|---|---|---|---|
Austria | 3 | 0 | 1 | 2 | 2 | - |
Belgium | 1 | 0 | 0 | 1 | 2 | - |
Bulgaria | 0 | 0 | 0 | 0 | 0 | - |
Croatia | 0 | 0 | 0 | 0 | 0 | - |
Cyprus | 0 | 0 | 0 | 0 | 0 | - |
Czech Republic | 0 | 0 | 0 | 0 | 0 | - |
Denmark | 1 | 0 | 1 | 0 | 1 | - |
Estonia | 0 | 0 | 0 | 0 | 0 | - |
Finland | 1 | 0 | 1 | 0 | 0 | - |
France | 2 | 0 | 1 | 1 | 5 | - |
Germany | 14 | 3 | 5 | 6 | 16 | - |
Greece | 0 | 0 | 0 | 0 | 0 | - |
Hungary | 0 | 0 | 0 | 0 | 0 | - |
Ireland | 0 | 0 | 0 | 0 | 0 | - |
Italy | 4 | 1 | 1 | 2 | 6 | - |
Latvia | 0 | 0 | 0 | 0 | 0 | - |
Lithuania | 0 | 0 | 0 | 0 | 0 | - |
Luxembourg | 0 | 0 | 0 | 0 | 0 | - |
Malta | 0 | 0 | 0 | 0 | 0 | - |
Netherlands | 4 | 2 | 2 | 0 | 3 | - |
Poland | 1 | 1 | 0 | 0 | 0 | - |
Portugal | 0 | 0 | 0 | 0 | 0 | - |
Romania | 0 | 0 | 0 | 0 | 1 | - |
Slovakia | 0 | 0 | 0 | 0 | 0 | - |
Slovenia | 0 | 0 | 0 | 0 | 0 | - |
Spain | 4 | 3 | 0 | 1 | 3 | - |
Sweden | 1 | 1 | 0 | 0 | 2 | - |
Iceland | 0 | 0 | 0 | 0 | 0 | - |
Liechtenstein | 0 | 0 | 0 | 0 | 0 | - |
Norway | 0 | 0 | 0 | 0 | 0 | - |
Total EU | 36 | 11 | 12 | 13 | 41 | 24.0 days |
Total EEA | 36 | 11 | 12 | 13 | 41 | 24.0 days |
Measure 26.3
Relevant Signatories will implement procedures for reporting the malfunctioning of access systems and for restoring access and repairing faulty functionalities in a reasonable time.
QRE 26.3.1
Relevant Signatories will describe the reporting procedures in place to comply with Measure 26.3 and provide information about their malfunction response procedure, as well as about malfunctions that would have prevented the use of the systems described above during the reporting period and how long it took to remediate them.
Commitment 28
COOPERATION WITH RESEARCHERS Relevant Signatories commit to support good faith research into Disinformation that involves their services.
We signed up to the following measures of this commitment
Measure 28.1 Measure 28.2 Measure 28.3 Measure 28.4
In line with this commitment, did you deploy new implementation measures (e.g. changes to your terms of service, new tools, new policies, etc)?
If yes, list these implementation measures here
- In 2024, Google hosted a workshop with over 30 attendees, including academics, at the Trust & Safety Forum in Lille, France exploring Safety by Design frameworks and implementation constraints, including misinformation.
- In October 2024, Google announced the first-ever Google Academic Research Award (GARA) winners. In this first cycle, the program will support 95 projects led by 143 researchers globally.
Do you plan to put further implementation measures in place in the next 6 months to substantially improve the maturity of the implementation of this commitment?
If yes, which further implementation measures do you plan to put in place in the next 6 months?
Measure 28.1
Relevant Signatories will ensure they have the appropriate human resources in place in order to facilitate research, and should set-up and maintain an open dialogue with researchers to keep track of the types of data that are likely to be in demand for research and to help researchers find relevant contact points in their organisations.
QRE 28.1.1
Relevant Signatories will describe the resources and processes they deploy to facilitate research and engage with the research community, including e.g. dedicated teams, tools, help centres, programs, or events.
Eligible EU researchers can apply for access to publicly available data across some of Google’s products, including Search and YouTube, through the Google Researcher Program. Search and YouTube will provide eligible researchers (including non-academics that meet predefined eligibility criteria) with access to limited metadata scraping for public data. This program aims to enhance the public’s understanding of Google’s services and their impact.
- YouTube provides a contact email alias to researchers who have been granted access to the program;
- YouTube API Code Samples at GitHub.
Measure 28.2
Relevant Signatories will be transparent on the data types they currently make available to researchers across Europe.
QRE 28.2.1
Relevant Signatories will describe what data types European researchers can currently access via their APIs or via dedicated teams, tools, help centres, programs, or events.
Measure 28.3
Relevant Signatories will not prohibit or discourage genuinely and demonstratively public interest good faith research into Disinformation on their platforms, and will not take adversarial action against researcher users or accounts that undertake or participate in good-faith research into Disinformation.
QRE 28.3.1
Relevant Signatories will collaborate with EDMO to run an annual consultation of European researchers to assess whether they have experienced adversarial actions or are otherwise prohibited or discouraged to run such research.
Measure 28.4
As part of the cooperation framework between the Signatories and the European research community, relevant Signatories will, with the assistance of the EDMO, make funds available for research on Disinformation, for researchers to independently manage and to define scientific priorities and transparent allocation procedures based on scientific merit.
QRE 28.4.1
Relevant Signatories will disclose the resources made available for the purposes of Measure 28.4 and procedures put in place to ensure the resources are independently managed.