One of my previous programmers made some PHP code for me that scrapes a certain website for data. This goes into my SQL database every 24 hours.
The scraping works but it is posting duplicates of the data which is not needed.
The data is also coming through in a messy format and needs to be fixed so it is more readable.
The code also posts onto pages where there should be no data
I am using socialengine for my website so if you are familiar with zend framework it will be useful