Ram memory problem with ThreadPoolExecutor Python

Job Description:

Tengo un script que hago un scrapear a una pagina y estoy utilizando ThreadPoolExecutor el problema es que el script se queda pegado al llegar al limite de la memoria ram necesito una solucion para que el script no consuma toda la ram y pueda finalizar el scrapear.

I have a script that scrapes a page and I'm using ThreadPoolExecutor. The problem is that the script gets stuck when it reaches the limit of ram memory. I need a solution so that the script doesn't consume all the ram and can finish scraping.

Only people who know Python and multithreading.

Færdigheder: Python, Software Arkitektur, Web Skrabning

Om klienten:
( 4 bedømmelser ) Calabozo, Venezuela

Projekt ID: #35437930

7 freelancere byder i gennemsnit $19 timen for dette job


Hi! I'm an expert in python and scrappers, I can help you with that, I believe it's something simple to solve

$15 USD på 1 dag
(3 bedømmelser)

Hi There, I am professional python programmer with skills including Software Architecture, Python and Web Scraping. Please send a message to discuss more about this project. Thank you

$30 USD på 1 dag
(1 bedømmelse)

Hi there, I am Ahmed a Python developer, I have read your project requirements and I understand that your scrapper is eating all of your memory, this is happens because of the unmanaged threading. I can fix this and e Flere

$20 USD in 7 dage
(2 bedømmelser)

Hola, Gracias por compartir el requisito de su proyecto. Leemos su requerimiento y lo entendemos. Para entender más y aclarar nuestras dudas, queremos hablar contigo. Por eso, envíanos un mensaje para que lo analicemos Flere

$20 USD på 1 dag
(0 bedømmelser)

To be able to understand and solve this problem for you, would be necessary to check the code and see what exactly is happening. If you share your code with me I can help you with that. I'm a experienced Python develop Flere

$10 USD på 1 dag
(0 bedømmelser)

If I am hired for this project, I will be able to give it my full attention and will deliver on time. Apart from this, I possess all the skills that you have outlined, and can effectively work towards tight deadlines. Flere

$20 USD in 7 dage
(0 bedømmelser)