Insight
•
Making mapping decisions visible
Making mapping decisions visible
Making mapping decisions visible

Upstream data choices rarely remain visible once an AI product is deployed. Users encounter answers rather than the many classification and mapping decisions that helped make those answers possible. In cross-border law, however, some of those decisions may be important to evaluating the reliability of the resulting output.
Imagine that different national insolvency procedures have been mapped into a common category such as bankruptcy. The shared label makes information easier to organise and compare, even though the underlying procedures may differ significantly in their purpose, operation, creditor and debtor rights, and degree of judicial involvement.
If those distinctions were simplified during dataset construction, the resulting system may present a harmonised picture that is more coherent than the underlying legal reality. Some simplification is unavoidable in complex systems, so the relevant issue is whether significant simplifications can subsequently be identified and examined.
Organisations relying on AI in legally sensitive contexts may need to know how equivalence was determined, which distinctions were preserved, where uncertainty remains and on what basis comparative judgements were made. Comparative mapping consequently also raises questions of governance.
Traceability does not eliminate abstraction or uncertainty, but can make the boundaries of a system easier to understand. This is one reason structured legal data can offer advantages beyond supplying more information to a model. Structure allows relationships between concepts, and potentially the reasoning behind those relationships, to be recorded rather than disappearing into a body of text.
Users do not necessarily need to see every mapping decision whenever they use an application. However, important decisions should ideally exist somewhere in an inspectable form. As legal AI is used for increasingly consequential work, being able to understand what a system assumed and how those assumptions were reached is likely to become ever more important.
Upstream data choices rarely remain visible once an AI product is deployed. Users encounter answers rather than the many classification and mapping decisions that helped make those answers possible. In cross-border law, however, some of those decisions may be important to evaluating the reliability of the resulting output.
Imagine that different national insolvency procedures have been mapped into a common category such as bankruptcy. The shared label makes information easier to organise and compare, even though the underlying procedures may differ significantly in their purpose, operation, creditor and debtor rights, and degree of judicial involvement.
If those distinctions were simplified during dataset construction, the resulting system may present a harmonised picture that is more coherent than the underlying legal reality. Some simplification is unavoidable in complex systems, so the relevant issue is whether significant simplifications can subsequently be identified and examined.
Organisations relying on AI in legally sensitive contexts may need to know how equivalence was determined, which distinctions were preserved, where uncertainty remains and on what basis comparative judgements were made. Comparative mapping consequently also raises questions of governance.
Traceability does not eliminate abstraction or uncertainty, but can make the boundaries of a system easier to understand. This is one reason structured legal data can offer advantages beyond supplying more information to a model. Structure allows relationships between concepts, and potentially the reasoning behind those relationships, to be recorded rather than disappearing into a body of text.
Users do not necessarily need to see every mapping decision whenever they use an application. However, important decisions should ideally exist somewhere in an inspectable form. As legal AI is used for increasingly consequential work, being able to understand what a system assumed and how those assumptions were reached is likely to become ever more important.


