Lukket

Server optimization and bottleneck troubleshooting.

We are not looking for someone to optimize the server on our behalf, instead we are looking for suggestions to what may be causing the unstability described below and possible fixes.

Background information:

We have two Dual-CPU 32GB RAM SSD servers. One is used as a web server and one is mysql database server, the servers are also privately connected through LAN. The server serves mostly PHP pages with only around 5% of requests requiring mysql lookups.

Currently, the web server hits a bottleneck at around around 150/requests per second. Once it hits the bottleneck the server becomes very slow and unresponsive (check the attachment graph).

We have checked the following:

* MySQL process list shows little or no current running query, meaning that SQL isnt the bottleneck

* When server becomes unstable, you can see lots of requests getting stuck in apache queue. Apache status would show thousands of current requests waiting in queue but are not even processing any of them, it looks as if one process is blocking all the other processes. When these requests are stuck the analytics would show a downfall in realtime traffic, after around 5~班seconds Apache starts processing the requests again, the thousands of processes gets completed by Apache causing a huge spike in analytics.

* We believe the hardware are not being fully utilized since when it hits the bottleneck, the CPU load on both server are very low.

We already tried the following:

* The server is running with fcgi+xcache with logging disabled to reduce disk IO.

* We have increased apache server numbers and limits, but didnt help at all.

* We have moved some caching into tmpfs but didnt help

Now we need suggestions on what else we could do to increase the system bottleneck.

Færdigheder: Linux, MySQL, PHP, System Administrator, Web Hosting

Se mere: increased web traffic, database caching, web server apache, xcache, query optimization, database optimization, apache web server, apache traffic server, apache server, graph optimization, sql server attachment, apache php troubleshooting, reduce sql, web server optimization, optimize server traffic, php mysql queue system, mysql caching, sql optimize, php xcache, php mysql queue list, sql reduce, database server system, apache optimize, optimization database, xcache php

Om arbejdsgiveren:
( 148 bedømmelser ) Brisbane, Australia

Projekt-ID: #5999440

22 freelancere byder i gennemsnit $120 for dette job

Teknowledge

Hi, I had the exact same problem. Your solution is to install nginx. Let me know if you want me to help you more. I will guaranty performance. Regards, Hussain

$206 USD in 3 dage
(50 bedømmelser)
7.6
pardusIT

Hello, I am simply an Linux expert with more than 12 years of experiences. Kindly take your 2 minutes to go over my previously completed projects (especially performance optimization projects) to qualify my experien Mere

$150 USD in 3 dage
(233 bedømmelser)
7.4
jfreyre

Hi, I suggest you to profile the script you are using to find the actual bottle neck, I mean guessing is like asking why a car is slow, there are a lot of factors on why a car is slow, the tires, the engine, spark plug Mere

$210 USD in 3 dage
(206 bedømmelser)
7.3
isurugiu

Greetings, I might say that this is a very interesting situation. Given the graph vs the hw requests I would start to look on the webserver side and see why the handles are being kept opened. I can show you an ex Mere

$155 USD in 2 dage
(223 bedømmelser)
6.3
rmmarconi

Please see here what I can do for your website: http://gtmetrix.com/reports/novidecor.com/m3TU5YKK http://gtmetrix.com/reports/4sale.is/fADNP7pB I'm a experienced System and Network administrator with more than 10 Mere

$277 USD in 5 dage
(34 bedømmelser)
6.2
codetrance

This is my specialty. I can help you. Do you have root access to your server?. I'm looking forwards to your response. Thank you.

$110 USD på 1 dag
(100 bedømmelser)
6.0
adilchang

Hello, I am an experience system admin and i can help you in this project. You can view my profile for similar projects i have completed. I am ready to start on it and if you have any query please feel free to ask. Mere

$79 USD på 1 dag
(105 bedømmelser)
5.8
minuthomas

Hi Boss, I have ample experience in linux server administration, website migration, installation and configuration of custom software with security. I can do this project for you. You may please have a look on my Mere

$140 USD in 2 dage
(54 bedømmelser)
5.5
HyderBangash

Hello, I'm not really bidding on this project, I just wanted to suggest you a great service to troubleshoot your issue - consider using newrelic.com to find out where the bottleneck is coming from. The fact that you Mere

$147 USD in 3 dage
(72 bedømmelser)
5.3
hamidnk

check my feedback at http://www.freelancer.com/users/feedback_434538.html 14 years experienced unix admin currently working for german Software House my experience matches your criteria,kindly review my cv for eva Mere

$55 USD in 0 dage
(55 bedømmelser)
5.2
tigertechsl

Hi, I have an MS in Computer Science. What are the values for KeepAliveTimeout and MaxClients on your server? Also, are the requests stuck with a R status or a W or one of the other status keys? We can proc Mere

$50 USD på 1 dag
(37 bedømmelser)
5.2
dungvit85

Hi, I am very interested with your project. If you are using CentOS as Linux operating system, please install an utility called "atop" and try to view the hardware stats, network stats, process stats in your server whe Mere

$155 USD in 3 dage
(55 bedømmelser)
5.1
globalresources

To be honest with you, I did not want to leave this message until I saw current status from jpg that you attached. First thing is that: You will need a memcache server (which can be created inside your existing s Mere

$105 USD in 4 dage
(18 bedømmelser)
5.0
tanujchugh

Hi, We are fast growing hosting company in India. We have expertise in Linux server setup with management. We used to work with many hosting panels like cpanel, plesk, webmin , direct admin , ispconfig, zpanel, web Mere

$55 USD på 1 dag
(14 bedømmelser)
4.8
b4rni

Hi I`m experienced linux/unix admin. Managing hundreds of linux systems on the daily basis. Have done many performance analyzes and troubleshooting`s in my life. I have RHCE Cert passed. Ready to take a look on You Mere

$222 USD in 3 dage
(15 bedømmelser)
4.7
odessky

I'm get ready to found bottleneck on your server My price is $30/h SSH root access is requied No TeamViewer or other. ************************************************************************************

$35 USD in 30 dage
(14 bedømmelser)
4.3
mk73rc

This is sure, problem would be resolved. We need to look into the server to know the reasons. we have server monitoring system, will monitor server for 24 hours to know the actual reason, timings, duration & check whic Mere

$150 USD in 3 dage
(8 bedømmelser)
3.8
grimeton

Hello, just a guess: Is your filesystem Ext4 or from the Ext-family? KR, Oliver =================

$55 USD in 3 dage
(10 bedømmelser)
3.7
dcnoye

A proposal has not yet been provided

$155 USD in 3 dage
(1 bedømmelse)
2.1
classon

I managed the Flickr.com database cluster during its early growth phase. This was a mysql database cluster with 1 master and 7 replicated slaves. The web front end contained over 50 apache/php servers. I built the sche Mere

$45 USD in 2 dage
(1 bedømmelse)
1.9