C# on IIS Import of xlarge XML files .1-500mb + JPG images

I have project where I need to import property data from XML feeds FTPd from an in-house server.

The XML feeds come in zip files, which need to be unpacked and also contain JPG images relevant to the property data.

The zip file size can be small to huge. Eg for the regular 15min updates the zip would be 1-2meg including images. The XML files would be 10-20kbs each.

When a full push of data is created the file size of the XML balloons out to well over 500mb (Just the XML) as there are 1000s of properties.

I require the XML file data to be inserted into a MSSQL Server DB, into 2 main tables residential_ & commercial_, along with 2 other tables resimages_ & commimages_ which will insert all the image file names and details.

The XML data is broken up into 3 parts, Res, Comm and Land, but I will supply the latest technical doc on the XML file structure.

It would obviously need to Insert or Update if the record is currently in the MSSQL db.

There also needs to be a check in place that XML files are not currently being uploaded before the script is actioned on the file to avoid cutting the file off and stopping the upload.

The website is hosted on latest IIS running Coldfusion 8 front end and custom CMS.

I require the all the images to be copied to a location in seperate propertyID folders as there are over 25,000 active images. This location also needs to be inserted with the image data.

While i'm not too familiar with machine code and C#, i've been told this is a great way import massive files like the XML at a fraction of the time it takes with CF or PHP etc. CF and PHP actually timeout when the file size reaches approx 3meg trying to import the XML.

If you require more information on the project to quote this kind of thing or would like to discuss, let me know.


UPDATE: I also require another table to import data to called residentialinspections_ with all the inspection data inside the XML record.

To clarify i require a check on the zip file before unpacking it to make sure its still not being uploaded.

Attached is a copy of some test XML data. The database table field correspond to the XML fields 95%.

This project will also not start for another 4 weeks due to various approvals, i'm also new to Freelancer so i'm learning the process.

Evner: C programmering, C# Programmering, IIS, Software Arkitektur

Se mere: upload 500mb xml, import jpg, the parts house, programming latest, php on iis, needs for c# programming, need of data structure, n.c. doc, machine programming, data structure programming in c, data structure and c, c programming website, comm server, 15min, xml file 500mb, C Sharp Programming, programming C, need xml file programming, mssql iis, massive data, jpg c, import XML, iis server, comm, c# MSSQL

Om arbejdsgiveren:
( 10 bedømmelser ) Gold Coast MC, United Kingdom

Projekt ID: #942966

23 freelancere byder i gennemsnit $1045 på dette job


hi,pls check your [login to view URL]

$1300 AUD in 10 dage
(19 bedømmelser)

I have experience importing xml data and images from zip files in a database. For the past few months I've been working on exactly this kind of projects. More details in PM.

$1300 AUD in 10 dage
(29 bedømmelser)

Hi. I can create you Import application. I have 13 Years of experience in Software development Windows and Web. Expert in Sql Server and .NET. Microsoft Certified as MCP, MCTS, MCPD, MCT.

$900 AUD in 20 dage
(7 bedømmelser)

Yes, that's correct. CF and PHP have a limitation for processing the file with size above 3 MB as they are loaded into memory of web server where the web server its self also implements the maximum file size can be pro Flere

$1000 AUD in 5 dage
(5 bedømmelser)

Hello, Please check PM!!

$1200 AUD in 25 dage
(5 bedømmelser)

Hello Sir, We have 9+ years of development experience in .net technologies like,, SQL Server. We are ready to start immediately. Please check PMB. Thanks, VirtuosoIT

$750 AUD in 20 dage
(8 bedømmelser)

Please see my PM, thanks

$860 AUD in 7 dage
(5 bedømmelser)

Please check PM

$1400 AUD in 10 dage
(1 bedømmelse)

I have 7+ years of experience in C# development. My specialty is XML importing to/exporting from MS SQL database. Many times synchronization and data imports were required for various (web) applications and sites redes Flere

$1200 AUD in 8 dage
(0 bedømmelser)

Insiso Ltd has implemented similar import solutions for bulk XML and image combined exports, full details outlined in PM. Feel free to contact me if you have any further questions or queries regarding our proposal.

$1400 AUD in 3 dage
(0 bedømmelser)

Yes, C# is a good choise for intensive processing.

$750 AUD in 10 dage
(0 bedømmelser)

Hi! I am interested in your project. Please check your PM. Thanks!

$1000 AUD in 20 dage
(0 bedømmelser)

i am senior developer in C#,please contact for good work

$800 AUD in 21 dage
(0 bedømmelser)

Experienced, Visual Studio .net, MSSQL Server 2000 - 2008 Programmer. I can give you better ideas on how to accomplish this. Thanks

$760 AUD in 4 dage
(0 bedømmelser)

I am a C# developer. I have two years of experience in .NET development. I have good deal of experience in handling and parsing XML files using C# and I have ideas as to how we can make SQL insertions more efficient. Flere

$750 AUD in 5 dage
(0 bedømmelser)

i did similer kind of work priviously devbeloped softwres as welll as similer application for different companies please check your mail box. thanks

$1200 AUD in 20 dage
(0 bedømmelser)

I'm professional developer with more than 10 years of extensive experience in c#

$800 AUD in 10 dage
(0 bedømmelser)

C# and can handle large and small files. Please check your inbox. Thanks

$1500 AUD in 4 dage
(0 bedømmelser)

Hi. Probably I can help you. See PM.

$800 AUD in 15 dage
(0 bedømmelser)

Hello, please check your inbox for bid details. Regards, Owen.

$1500 AUD in 10 dage
(0 bedømmelser)