I need to tie two already built classes together to make one solution.
I need to fully scrape or mirror a website using already built ([url removed, login to view]) php crawler class.
I need this to scrape all content and download the content to a local folder on the server and or also allow me to save the content to my amazon S3 bucket or both at the same time all while recreating the same directory structure and maintaining the same file names. At the end I should have a working static copy of my site.
I also need it to check the local directories or amazon s3 for existing files and only overwrite files that have changed or are new. I need the report to be emailed to me at the end.
I would like the configuration settings at the top of the script so I can quickly change the variables of the site I'm scraping, directory location, s3 info and so on. I will only be scraping one domain at a time.
The php class for the Amazon S3 bucket is ([url removed, login to view]).
The coding required would be to add the saving of files to the directory, emailing the report and copying the data to S3 on amazon using the amazon class.
The coding is minimal on this job, the classes do 95% of what I need already.
33 freelancere byder i gennemsnit $285 for dette job
Custom sites, Wordpress Sites, All programming languages and database types. Sites include administrative back end systems. Would love to help you, contact me so we can move forward.
Hi I work towards providing reliable, relevant and robust IT solutions at most competitive prices to my customers. I ensure 100% customer satisfaction so lets start Thanks
Dear there Thank you for inviting me biding on this project. I'm expert with AWS, so it will be quick. Looking forward to work with you Thanks & B/R