Semantic Similarity of Hadiths
Text Matching and ClassificationSemantic Similarity of Hadiths
The Concept of Semantic Similarity
Sometimes two Hadiths do not share common word sequences lexically (verbally), but they refer to exactly the same meaning. Semantic similarity seeks to discover this type of similarity, which goes beyond mere lexical matching.
Definition of Related Hadith
A related Hadith in this system includes the following:
- Conceptual Matching: Two Hadiths that express the same concept
- Relative Connection: Hadiths that have a semantic relationship with each other
- Apparent Contradiction: Hadiths that may appear different on the surface but are semantically related
Implementation Methods
Extraction of Related Words Based on Word Co-occurrence Analysis in Large Hadith Collections
In this method, statistical analysis of word co-occurrence in a large collection of Hadiths is used to discover semantic relationships between words. Words that frequently appear together likely have a semantic connection.
Calculating Similarity Score Between Two Hadiths Based on the Aggregation of Their Word Similarities
To calculate the semantic similarity between two Hadiths, the similarity between word pairs from both Hadiths is first calculated, and then by combining these similarities, the final similarity score is determined.
Applications
- Discovering semantically related Hadiths to a given Hadith
- Grouping Hadiths by meaning (not just by wording)
- Helping researchers find synonymous narrations matching their search query
- Identifying Hadiths that, despite verbal differences, convey the same message