In this project, I created an Arabic Fatwa ChatBot that aims to answer a different question

The data scraping was one of the most time consuming parts of this project because it’s difficult to navigate through the nested tables (the HTML). However, BeautifulSoup made it quite simple to grab the HTML and parse through it.

In this project I scraped from islamweb.net, I decided to start by scraping top of all Fatwa so that I could build out my chatbot. When I looked at the page that includes all fatwas. As a first step, I noticed that I need to collect all linkes of all fatwas then go into each fatwa to collect the needed information (Question and answer).

The next focus was to clean the data to build a better chatbot. I started by importing the CSV file that I had created into my Python environment then I read this file using dataframes.Next, I worked with the variables to make sure that they were able to be processed by applied the following:

• Remove duplicated fatwa
• Remove special charecter
• Remove number and stop words
• Remove harakat
• Stemming
• Shuffling Data

I used buildin library

For more details please viste Project Resource. This repo contains the following:

• scraping and cleaning code file.
• building chatbot code file.
• Project-05 pdf file that describe the project in details.

Thank you for reading!