Simple project. I have awarded this project already once. I was not impressed with the results. The software was not useable. So I am breaking down the requirements for this piece of software to every single feature in the hopes that you guys can give me an accurate quote to accomplish this goal. Take a look at these requirements and really consider if this is a good fit for you and what you might want to bid for it.
Project Overview: Create a custom Java application to take a look at internal links for a domain, generate a list, test those links, and export those links and anchor text to a JSON or XML file IF they resolve to a page that begins with OutOfStock.php.
I.e. if a link on the homepage for "Spicy Products" resolves to "http://www.sample.com/OutOfStock.php&q=Spicy Products" then the link gets added.
The software has to run 24/7 unattended once started.
These are the things the software NEEDS to do;
1) Must operate 24/7 once started (no memory leaks, no user input required after start)
1.1) User must input domain and location of sitemap file
2) Create a list of specific pages to test from sitemap file
3) Crawl each of these pages
4) Create a list of all internal testable links; Only internal (within the domain) links, do not test external links or "no follow" links
5) Remove duplicates from this list
4) Test each link
5) If the link resolves to a page that begins with [url removed, login to view] Add it to the list. Otherwise, ignore it.
6) Export the list in XML or JSON format
7) Time-stamp the file
8) Ensure the software runs the scan once every 24 hours
9) Ensure the software runs immediately after the user presses the "start" button and entering the domain / sitemap file locations.
10) Would prefer command line interface, no GUI required.
I took the time to think and break down the software requirements, so please take the time to read them.
19 freelancers are bidding on average $239 for this job
Hi, I'm an experienced java developer, and I'm interested in your project. I've worked with web crawlers before. Do you have an example domain and site map to test with? Thanks.
Hi, Love for this love and my favourite job, I would like to say that when I complete your work first you checked then pay me. I assure you I would not disappoint you. Thanks and best regards
Hi, I am experienced Java developer. I understand requirements which you have listed and I am sure that I could develop software which you require. Please contact me for more details. Regards, Mladen
With strong experience in Java programming language and Java platform I think I will be able to do your project well. Please contact me to discuss further details.
Hi Sir - I can help you on your project. I have done a similar project before. Please send me a message so we can discuss the details. Hope to hear from you soon. Thanks.
Hi, I had an experience of similar work as per your requirement in Java. You can have trust on me and I can guarantee the correct and timely delivery of the job. Thanks & Regards, Durga PK