Hadith Detection

Hadith Detection Service

This service is designed to find Arabic Hadith texts in religious documents and link them to the "Jamia al-Ahadith" database. Jamia al-Ahadith is a specialized database containing well-known Shia narrative books.

By linking a Hadith text to the Jamia al-Ahadith database, researchers gain access to the precise source of the Hadith, translations, commentaries, similar Hadiths, and other features.

Technical Capabilities

This service can process both plain text and HTML format (used on websites) and provide output containing the linked Hadith text in exactly the same format as the input. Therefore, one can place a website with linked Hadiths into their personal database without any specific changes.

Algorithm and Multi-Stage Structure

The algorithm operates in a multi-stage structure to simultaneously provide the required accuracy and speed:

Stage 1 - Normalization and Text Division:
First, the input text is normalized and then divided into N-gram words.

Stage 2 - Searching the Hadith Collection:
Sequential searching of each of these N-grams is performed across a vast collection of approximately 400,000 Hadiths.

Stage 3 - Approximate Matching:
Using a specialized approximate matching algorithm that works with N-gram characters, we examine the matching of each candidate Hadith and select the best matches.

Stage 4 - Filtering Results:
Finally, the found Hadiths are filtered using various methods:
- Checking if the text is merely a Quranic verse
- Checking if it is only a Hadith chain (chain of narrators) using a specialized parsing algorithm
- Checking if it consists only of frequently repeated phrases
- Checking the length and extent of the matched text

These filters ensure that undesirable results based solely on superficial lexical similarity to parts of Hadiths do not appear in the output.

Performance and Speed

This program can find Hadiths in approximately 10 pages of Hadith-rich texts per second on the center's server with high accuracy.

Applications

• Religious Websites: Automatic linking of Hadiths to authoritative sources
• Islamic Software: Integration with the Jamia al-Ahadith database
• Hadith Research: Quick access to translations, commentaries, and similar Hadiths
• Religious Content Production: Verification and accurate referencing of Hadiths