Download Millions of Individual Websites as JSON

We need someone to download an entire Russian-language website consisting of millions of individual pages, preferably in JSON format:

[login to view URL]

This is not a straightforward job and will require advanced knowledge of HTML, Javascript, and AJAX. Simple website downloaders (such as SiteSucker) will not work. The website uses unique IDs to identify individual webpages, but the search function will not allow the complete archive to be shown at once.

Example: [login to view URL]

Russian speaker preferable (this site is in Russian and we require the JSONs to display the Russian text (not the translated English).


1. JSONs for all files from [login to view URL]

a. We need the JSONS for all document IDs on the website. We expect there to be upwards of 100 million individual JSON entries

b. It would be ideal to have some sort of validation to ensure we are getting the entire site, and not some incomplete portion

2. Programming code used to make requests from the API

a. This can be delivered at the end of the project.

b. We may require some explanation of the code so we can use it later on to fill in missing entries or redownload corrupted files.

Method of Delivery:

- Shared cloud storage to be agreed upon. JSON files should be split into batches of between 500MB and 1GB for easier processing.

Evner: AJAX, Data Scraping, HTML, Javascript, Python

Se mere: scrape data from website python, parsehub review, extract data from website to excel, extract data from webpage, free web scraper, extract data from website online, web scraper chrome, parsehub

Om arbejdsgiveren:
( 4 bedømmelser ) Washington, United States

Projekt ID: #17792622

Tildelt til:


OK, as we agreed on. I will make the script and will upload data into some file sharing system like dropbox. Once I have some chunk of file will upload it. Thx, let's do the great work!

$1200 USD in 1000 dage
(99 bedømmelser)

16 freelancere byder i gennemsnit $1098 på dette job


Honorable Seniors. How are you? I have experience in web scraping and data mining using python, java, c# with selenium enough. I will try to deliver great result with your satisfy all my best. Hope to meet you soon Flere

$1000 USD in 20 dage
(77 bedømmelser)

Hi dss3js, I find myself eligible for this job since I am having 7 years of extensive experience I am Good at AJAX, Data Scraping, HTML, Javascript, Python dss3js, Please Send a message so that we can discuss more abo Flere

$1250 USD in 11 dage
(21 bedømmelser)

Hello I am good in php/html/js/css etc and have a lot experience I am an effective web developer and can deliver exactly deadlines. I will do my best to satisfy you. Thank you for your time and consideration. I l Flere

$1250 USD in 20 dage
(54 bedømmelser)

i can download using python................................................................................................. Regards vasudha

$1250 USD in 20 dage
(15 bedømmelser)

Hi there, I am Faisal professional Mobile Responsive Web designer & developer. I read your project description and have few queries to discuss, Please come in private chat to discuss more in detail about Flere

$750 USD in 20 dage
(77 bedømmelser)

Hi.. How are you? I saw your description carefully your project. Owing to my rich experience in python, scrapy, data entry , i can say i can do this perfectly. I have many top skills like python, scrapy,CSS,HTML Flere

$1250 USD in 20 dage
(48 bedømmelser)

Hi, I have read your job description carefully and came to conclusion that I perfectly fit to your job. As an senior web developer, i have variety type of web scrapping experiences. Please check this site whic Flere

$1250 USD in 20 dage
(26 bedømmelser)

Hi there This is web scrapping job I have ever done it before Please contact me and discuss more detail on chat Kind Regards

$1250 USD in 20 dage
(24 bedømmelser)

Dear I am a full stack web developer with 8 years experience building web application. I'm expertise in major PHP MVC framework such as Laravel, CodeIgniter, Zend and Yii with MySQL database and MongoDB. And for fr Flere

$1250 USD in 20 dage
(19 bedømmelser)

Hello, Thank you for the job posting. It’s a pleasure to meet you. I’d really like to work with you on this one if possible! I do have a couple of questions, but first I’d like to make you an offer and some backgrou Flere

$1250 USD in 20 dage
(29 bedømmelser)

Hi... How are you?. I saw your description carefully. And if you want to see my skills please go this link: https://www.freelancer.com/u/crocodile305 When you have enough time to discuss about your project wi Flere

$750 USD in 3 dage
(8 bedømmelser)

I handle it with passion and great interest. It is the best kind of mode I’ve always wanted and gives me the chance to apply all types of creativity and resourcefulness. [login to view URL] www.beverlyhillshr. Flere

$1250 USD in 20 dage
(1 bedømmelse)
$750 USD in 20 dage
(13 bedømmelser)

Hello, I am a front-end expert so I will be able to help you on this project. I developed dozens of web sites which are being used front-end technology such as HTML5/CSS3, jQuery, Bootstrap, Angular and React. Flere

$1111 USD in 20 dage
(3 bedømmelser)

Dear American employer. Don't waste time and money. I have extensive experiences in these jobs. Please hire me. I will complete your project perfectly with your favorite budget. Please take a look. This is my re Flere

$750 USD in 7 dage
(0 bedømmelser)