Method and limits
Method, scoring grid and limits
Everything that makes up the score is written here. So is what the tool never says.
How the grid works
The score measures observable signs of transparency on a public website, never a company's legal situation. Each criterion starts at its maximum and loses points when a sign of a gap is observed; a criterion that does not apply keeps its maximum.
- Transparency of chatbots35 points
- Labelling of generated content25 points
- Basic site information20 points
- AI governance on display20 points
Each criterion starts at its maximum and loses points when a sign of a gap is observed.
| Criterion | Points | What is observed | Reference |
|---|---|---|---|
| Transparency of chatbots | 35 | A chat widget or bot builder on the page, and a notice saying the exchange is automated. No widget: the criterion does not apply and keeps its maximum. | Art. 50(1) — Regulation (EU) 2024/1689, applicable since 2 August 2026 |
| Labelling of generated content | 25 | Signs of generated content (leftover text, avatar videos, calls to an AI service from the page) and a visible label or provenance metadata. | Art. 50(2) providers and 50(4) deployers |
| Basic site information | 20 | Links to the legal notice and privacy policy from the home page. A page not found is reported as "not detected", never as missing. | Outside the AI Act (French LCEN, GDPR) — general good practice; Art. 50(3) refers to the GDPR |
| AI governance on display | 20 | An AI policy or charter page, a mention of staff training. This criterion only counts signs that are present: nothing requires these pages. | Voluntary good practice; Art. 4 (AI literacy) for information only |
Reading the score
Labels translated from the French grid.
- 0 – 39Serious signs — situation to document as a priority
- 40 – 69Several observable signs of a gap
- 70 – 89Points needing attention detected
- 90 – 100No sign of a gap detected on the observable points
| Score | Label shown |
|---|---|
| 90 – 100 | No sign of a gap detected on the observable points |
| 70 – 89 | Points needing attention detected |
| 40 – 69 | Several observable signs of a gap |
| 0 – 39 | Serious signs — situation to document as a priority |
What Pilot Conform never does
- Never use "compliant", "non-compliant", "in breach" or "illegal" about the scanned site
- Never calculate or show a personalised fine amount
- Never state that a live chat widget is an AI without checking: use "may include an AI agent"
- Always date the scan and state that it only covers the public pages analysed
Why this is not legal advice
Pilot Conform is a documentation tool. It records technical elements and links them to an article; it does not assess a situation, which is a lawyer's job. This boundary is written into the grid, and automated tests check that no displayed text crosses it. The sentence that comes with every score:
This score is an automated indicator based solely on technical elements that can be publicly observed on your website on the date of the scan. It is neither a legal audit, nor legal advice, nor an assessment of your compliance with Regulation (EU) 2024/1689 (AI Act) or any other regulation, and it can in no way be used to state that a company does or does not meet its legal obligations. Some obligations cannot be detected technically; some detected elements may be false positives (for example a chat widget run by humans). Pilot Conform is a documentation tool: it does not provide legal advice and does not replace the analysis of a lawyer, who alone can assess your individual situation. (Translation of the French clause shown with every score.)
The signatures detected
35 signatures, in four families. A negative weight makes the relevant criterion lose points unless something offsets it; a positive weight gives points back.
Chat widgets and chatbots (23)
| Signature | Effect on the score | Reliability |
|---|---|---|
| Crisp Chat | −15 | high |
| Intercom (Fin AI) | −25 | high |
| Tidio (Lyro AI) | −15 | high |
| Botpress Webchat | −30 | high |
| Drift (Salesloft) | −25 | high |
| HubSpot Conversations | −15 | high |
| Zendesk Web Widget / Sunshine | −15 | high |
| LiveChat | −15 | high |
| ChatBot.com | −30 | medium |
| Smartsupp | −15 | high |
| Brevo Conversations | −15 | high |
| Tawk.to | −15 | high |
| Freshchat (Freshworks) | −15 | medium |
| Chatwoot | −15 | medium |
| Landbot | −30 | high |
| Chatbase | −30 | high |
| Voiceflow Webchat | −30 | high |
| Ada Support | −30 | medium |
| iAdvize | −15 | medium |
| Userlike | −15 | medium |
| Gorgias Chat | −15 | medium |
| Kommunicate | −30 | medium |
| ElevenLabs Conversational AI | −30 | medium |
AI tools visible in the page (5)
| Signature | Effect on the score | Reliability |
|---|---|---|
| Appels OpenAI cote client | −20 | medium |
| Video Synthesia (avatar IA) | −10 | medium |
| Video HeyGen (avatar IA) | −10 | medium |
| Site construit par generateur IA | −5 | low |
| Residus de texte LLM non relu | −20 | high |
Content labelling and provenance (2)
| Signature | Effect on the score | Reliability |
|---|---|---|
| Content Credentials / C2PA | +10 | low |
| Label visible de contenu IA | +15 | medium |
Information and governance signs (5)
| Signature | Effect on the score | Reliability |
|---|---|---|
| Mention de transparence pres du chat | +30 | medium |
| Page politique / charte IA | +12 | medium |
| Page mentions legales | +10 | high |
| Politique de confidentialite | +10 | high |
| Mention littératie IA / art. 4 | +8 | low |