Semantic heterogeneity
{{About|semantic differences in data|other uses|Heterogeneity (disambiguation)}}
Semantic heterogeneity is when database schema or datasets for the same domain are developed by independent parties, resulting in differences in meaning and interpretation of data values.{{cite journal |title=Why your data won't mix |author=Alon Halevy|journal=Queue |volume=3 |issue=8 |year=2005 |url=http://queue.acm.org/detail.cfm?id=1103836}} Beyond structured data, the problem of semantic heterogeneity is compounded due to the flexibility of semi-structured data and various tagging methods applied to documents or unstructured data. Semantic heterogeneity is one of the more important sources of differences in heterogeneous datasets.
Yet, for multiple data sources to interoperate with one another, it is essential to reconcile these semantic differences. Decomposing the various sources of semantic heterogeneities provides a basis for understanding how to map and transform data to overcome these differences.
Classification
One of the first known classification schemes applied to data semantics is from William Kent more than two decades ago.{{cite conference |title=The many forms of a single fact |author=William Kent |conference=Proceedings of the IEEE COMPCON |date=February 27 – March 3, 1989 |location=San Francisco |number=HPL-SAL-88-8, Hewlett-Packard Laboratories, Oct. 21, 1988 | at=13 pp. |url=http://www.bkent.net/Doc/manyform.htm}} Kent's approach dealt more with structural mapping issues than differences in meaning, which he pointed to data dictionaries as potentially solving.
One of the most comprehensive classifications is from Pluempitiwiriyawej and Hammer, "Classification Scheme for Semantic and Schematic Heterogeneities in XML Data Sources".{{cite news |title=A classification scheme for semantic and schematic heterogeneities in XML data sources |author=Charnyote Pluempitiwiriyawej and Joachim Hammer |publisher=University of Florida |at=Technical Report TR00-004 |location=Gainesville, Florida |date=September 2000 |url=https://cise.ufl.edu/tr/DOC/REP-2000-396.pdf}} They classify heterogeneities into three broad classes:
- Structural conflicts arise when the schema of the sources representing related or overlapping data exhibit discrepancies. Structural conflicts can be detected when comparing the underlying schema. The class of structural conflicts includes generalization conflicts, aggregation conflicts, internal path discrepancy, missing items, element ordering, constraint and type mismatch, and naming conflicts between the element types and attribute names.
- Domain conflicts arise when the semantics of the data sources that will be integrated exhibit discrepancies. Domain conflicts can be detected by looking at the information contained in the schema and using knowledge about the underlying data domains. The class of domain conflicts includes schematic discrepancy, scale or unit, precision, and data representation conflicts.
- Data conflicts refer to discrepancies among similar or related data values across multiple sources. Data conflicts can only be detected by comparing the underlying sources. The class of data conflicts includes ID-value, missing data, incorrect spelling, and naming conflicts between the element contents and the attribute values.
Moreover, mismatches or conflicts can occur between set elements (a "population" mismatch) or attributes (a "description" mismatch).
Michael Bergman expanded upon this schema by adding a fourth major explicit category of language, and also added some examples of each kind of semantic heterogeneity, resulting in about 40 distinct potential categories {{cite web |title=Sources and classification of semantic heterogeneities |author=M.K. Bergman |website=AI3:::Adaptive Information |date=6 June 2006 |accessdate=28 September 2014 |url=http://www.mkbergman.com/232/sources-and-classification-of-semantic-heterogeneities/}}
.{{cite web |title=Big structure and data interoperability |author=M.K. Bergman |website=AI3:::Adaptive Information |date=12 August 2014 |accessdate=28 September 2014 |url=http://www.mkbergman.com/1782/big-structure-and-data-interoperability/}} This table shows the combined 40 possible sources of semantic heterogeneities across sources:
| style="text-align: left; width: 100%;" border="1" cellpadding="3" cellspacing="0"
| style="vertical-align: middle; text-align: center; font-weight: bold; background: #EFEFEF" | Class | style="vertical-align: middle; text-align: center; font-weight: bold; background: #EFEFEF" | Category | style="vertical-align: middle; text-align: center; font-weight: bold; background: #EFEFEF" | Subcategory | style="vertical-align: middle; text-align: center; font-weight: bold; background: #EFEFEF" | Examples |
| rowspan="8" colspan="1" |
| rowspan="4" colspan="1" | | Ingest Encoding Mismatch | |
| Ingest Encoding Lacking
| Mis-recognition of tokens because not being parsed with the proper encoding |
| Query Encoding Mismatch
| For example, ASCII v UTF-8 in search |
| Query Encoding Lacking
| Mis-recognition of search tokens because not being parsed with the proper encoding |
| rowspan="4" colspan="1" | Languages
| Script Mismatch | Variations in how parsers handle, say, stemming, white spaces or hyphens |
| Parsing / Morphological Analysis Errors (many)
| Arabic languages (right-to-left) v Romance languages (left-to-right) |
| Syntactical Errors (many)
| Ambiguous sentence references, such as I'm glad I'm a man, and so is Lola (Lola by Ray Davies and the Kinks) |
| Semantics Errors (many)
| River bank v money bank v billiards bank shot |
| rowspan="17" colspan="1" | Conceptual
| rowspan="5" colspan="1" | Naming | Case Sensitivity | Uppercase v lower case v Camel case |
| Synonyms
| United States v USA v America v Uncle Sam v Great Satan |
| Acronyms
| United States v USA v US |
| Homonyms
| Such as when the same name refers to more than one concept, such as Name referring to a person v Name referring to a book |
| Misspellings
| As stated |
| rowspan="1" colspan="2" | Generalization / Specialization
| When single items in one schema are related to multiple items in another schema, or vice versa. For example, one schema may refer to "phone" but the other schema has multiple elements such as "home phone", "work phone" and "cell phone" |
| rowspan="2" colspan="1" | Aggregation
| Intra-aggregation | When the same population is divided differently (such as, Census v Federal regions for states, England v Great Britain v United Kingdom, or full person names v first-middle-last) |
| Inter-aggregation
| May occur when sums or counts are included as set members |
| rowspan="1" colspan="2" | Internal Path Discrepancy
| Can arise from different source-target retrieval paths in two different schemas (for example, hierarchical structures where the elements are different levels of remove) |
| rowspan="4" colspan="1" | Missing Item
| Content Discrepancy | Differences in set enumerations or including items or not (say, US territories) in a listing of US states |
| Missing Content
| Differences in scope coverage between two or more datasets for the same concept |
| Attribute List Discrepancy
| Differences in attribute completeness between two or more datasets |
| Missing Attribute
| Differences in scope coverage between two or more datasets for the same attribute |
| rowspan="2" colspan="2" | Item Equivalence
| When two types (classes or sets) are asserted as being the same when the scope and reference are not (for example, Berlin the city v Berlin the official city-state) |
| When two individuals are asserted as being the same when they are actually distinct (for example, John F. Kennedy the president v John F. Kennedy the aircraft carrier) |
| rowspan="1" colspan="2" | Type Mismatch
| When the same item is characterized by different types, such as a person being typed as an animal v human being v person |
| rowspan="1" colspan="2" | Constraint Mismatch
| When attributes referring to the same thing have different cardinalities or disjointedness assertions |
| rowspan="9" colspan="1" |
| rowspan="4" colspan="1" | Schematic Discrepancy | Element-value to Element-label Mapping | rowspan="4" colspan="1" | One of four errors that may occur when attribute names (say, Hair v Fur) may refer to the same attribute, or when same attribute names (say, Hair v Hair) may refer to different attribute scopes (say, Hair v Fur) or where values for these attributes may be the same but refer to different actual attributes or where values may differ but be for the same attribute and putative value. |
| Attribute-value to Element-label Mapping |
| Element-value to Attribute-label Mapping |
| Attribute-value to Attribute-label Mapping |
| rowspan="2" colspan="1" | Scale or Units
| Measurement Type | Differences, say, in the metric v English measurement systems, or currencies |
| Units
| Differences, say, in meters v centimeters v millimeters |
| rowspan="1" colspan="2" | Precision
| For example, a value of 4.1 inches in one dataset v 4.106 in another dataset |
| rowspan="2" colspan="1" |
| Primitive Data Type | Confusion often arises in the use of literals v URIs v object types |
| Data Format
| Delimiting decimals by period v commas; various date formats; using exponents or aggregate units (such as thousands or millions) |
| rowspan="8" colspan="1" |
| rowspan="5" colspan="1" | Naming | Case Sensitivity | Uppercase v lower case v Camel case |
| Synonyms
| For example, centimeters v cm |
| Acronyms
| For example, currency symbols v currency names |
| Homonyms
| Such as when the same name refers to more than one attribute, such as Name referring to a person v Name referring to a book |
| Misspellings
| As stated |
| rowspan="1" colspan="2" | ID Mismatch or Missing ID
| URIs can be a particular problem here, due to actual mismatches but also use of name spaces or not and truncated URIs |
| rowspan="1" colspan="2" | Missing Data
| A common problem, more acute with closed world approaches than with open world ones |
| rowspan="1" colspan="2" | Element Ordering
| Set members can be ordered or unordered, and if ordered, the sequences of individual members or values can differ |
A different approach toward classifying semantics and integration approaches is taken by Sheth et al.{{cite journal |title=Semantics for the semantic Web: the implicit, the formal and the powerful | author1=Amit P. Sheth|author2=Cartic Ramakrishnan|author3=Christopher Thomas|journal=International Journal on Semantic Web and Information Systems |volume=1 |issue=1 |pages=1–18 |date=2005 | doi=10.4018/jswis.2005010101|url=http://www.informatik.uni-trier.de/~ley/db/journals/ijswis/ijswis1.html|url-access=subscription }} Under their concept, they split semantics into three forms: implicit, formal and powerful. Implicit semantics are what is either largely present or can easily be extracted; formal languages, though relatively scarce, occur in the form of ontologies or other description logics; and powerful (soft) semantics are fuzzy and not limited to rigid set-based assignments. Sheth et al.'s main point is that first-order logic (FOL) or description logic is inadequate alone to properly capture the needed semantics.
Relevant applications
Besides data interoperability, relevant areas in information technology that depend on reconciling semantic heterogeneities include data mapping, semantic integration, and enterprise information integration, among many others. From the conceptual to actual data, there are differences in perspective, vocabularies, measures and conventions once any two data sources are brought together. Explicit attention to these semantic heterogeneities is one means to get the information to integrate or interoperate.
A mere twenty years ago, information technology systems expressed and stored data in a multitude of formats and systems. The Internet and Web protocols have done much to overcome these sources of differences. While there is a large number of categories of semantic heterogeneity, these categories are also patterned and can be anticipated and corrected. These patterned sources inform what kind of work must be done to overcome semantic differences where they still reside.
See also
References
Further reading
- [http://wiki.opensemanticframework.org/index.php/Classification_of_Semantic_Heterogeneity Classification of semantic heterogeneity]