Security, trust, legislation

Security, trust, legislation

Hallucinations

The model optimises plausibility, not truth. Types: invented sources, wrong numbers, outdated information, a true fact from the wrong source, an “over-eager” answer. What helps: citations and checking them, grounding, calculations by tool.

Review ladder

LevelOutputCheck
1Internal draftsthe author checks it
2Decision supportverify numbers and sources, disclose AI use
3External outputssecond person + approval
4Legal, financial, safetyAI only prepares, a human decides
STOPAutomated decisions about people, emotionsprohibited

Grounding

graph LR Q["Question"] --> S["Search company documents"] S --> M["Model + retrieved passages"] M --> A["Answer with citation"]

Answer quality ≤ document quality. Watch for oversharing – Copilot sees everything the user can access.

Which data in which tool

DataPublic AI chatCopilot ChatM365 Copilot / CoworkFoundry (EU)
Public✓✓✓✓
Internal✕✓✓✓
Confidential✕!✓✓
Personal data✕!!!
Special-category, safety-critical✕✕!!

Agent risks

  • Prompt injection – EchoLeak (2025): an e-mail with hidden instructions could make M365 Copilot leak data.
  • Excessive permissions – PocketOS, OpenClaw (2026).
  • Runaway costs – pay-per-use.

Controls outside the agent: least privilege, approval of irreversible steps, audit, spending limits, kill switch and registry (Agent 365).

GDPR

Legal basis · transparency · DPIA · Art. 22 (a human decides) · minimisation · processor agreement. Supervisor in Slovakia: the Office for Personal Data Protection.

AI Act after the Digital Omnibus

DateWhat applies
2/2025prohibitions (e.g. emotion recognition at work) + AI literacy
8/2025general-purpose models
8/2026transparency (Art. 50) – chatbots, deepfakes
12/2027high risk – Annex III (hiring, rating people, road-traffic safety)
8/2028high risk – products (Annex I)

You are mostly a deployer; with AI in your own products, a provider. Not a legal interpretation.

An AI policy template is in the cheat sheets.

Exercise

➡ Traffic-light exercise