Server optimization and bottleneck troubleshooting.

We are not looking for someone to optimize the server on our behalf, instead we are looking for suggestions to what may be causing the unstability described below and possible fixes.

Background information:

We have two Dual-CPU 32GB RAM SSD servers. One is used as a web server and one is mysql database server, the servers are also privately connected through LAN. The server serves mostly PHP pages with only around 5% of requests requiring mysql lookups.

Currently, the web server hits a bottleneck at around around 150/requests per second. Once it hits the bottleneck the server becomes very slow and unresponsive (check the attachment graph).

We have checked the following:

* MySQL process list shows little or no current running query, meaning that SQL isnt the bottleneck

* When server becomes unstable, you can see lots of requests getting stuck in apache queue. Apache status would show thousands of current requests waiting in queue but are not even processing any of them, it looks as if one process is blocking all the other processes. When these requests are stuck the analytics would show a downfall in realtime traffic, after around 5~班seconds Apache starts processing the requests again, the thousands of processes gets completed by Apache causing a huge spike in analytics.

* We believe the hardware are not being fully utilized since when it hits the bottleneck, the CPU load on both server are very low.

We already tried the following:

* The server is running with fcgi+xcache with logging disabled to reduce disk IO.

* We have increased apache server numbers and limits, but didnt help at all.

* We have moved some caching into tmpfs but didnt help

Now we need suggestions on what else we could do to increase the system bottleneck.

Evner: Linux, MySQL, PHP, System Administrator, Web Hosting

Se mere: web analytics optimization, web analytics and optimization, increase web hits, increased web traffic, database caching, web server apache, xcache, Query optimization, database optimization, apache web server, Apache Traffic Server, Apache server , sql analytics, graph optimization, sql server attachment, apache php troubleshooting, reduce sql, web server optimization, optimize server traffic, php mysql queue system, mysql caching, sql optimize, php xcache, php mysql queue list, sql reduce

Om arbejdsgiveren:
( 148 bedømmelser ) Brisbane, Australia

Projekt ID: #5999440

22 freelancere byder i gennemsnit $120 på dette job


Hi, I had the exact same problem. Your solution is to install nginx. Let me know if you want me to help you more. I will guaranty performance. Regards, Hussain

$206 USD in 3 dage
(50 bedømmelser)

Hello, I am simply an Linux expert with more than 12 years of experiences. Kindly take your 2 minutes to go over my previously completed projects (especially performance optimization projects) to qualify my experien Flere

$150 USD in 3 dage
(233 bedømmelser)

Hi, I suggest you to profile the script you are using to find the actual bottle neck, I mean guessing is like asking why a car is slow, there are a lot of factors on why a car is slow, the tires, the engine, spark plug Flere

$210 USD in 3 dage
(206 bedømmelser)

Greetings, I might say that this is a very interesting situation. Given the graph vs the hw requests I would start to look on the webserver side and see why the handles are being kept opened. I can show you an ex Flere

$155 USD in 2 dage
(223 bedømmelser)

Please see here what I can do for your website: [url removed, login to view] [url removed, login to view] I'm a experienced System and Network administrator with more than 10 Flere

$277 USD in 5 dage
(34 bedømmelser)

This is my specialty. I can help you. Do you have root access to your server?. I'm looking forwards to your response. Thank you.

$110 USD på 1 dag
(100 bedømmelser)

Hello, I am an experience system admin and i can help you in this project. You can view my profile for similar projects i have completed. I am ready to start on it and if you have any query please feel free to ask. Flere

$79 USD på 1 dag
(105 bedømmelser)

Hi Boss, I have ample experience in linux server administration, website migration, installation and configuration of custom software with security. I can do this project for you. You may please have a look on my Flere

$140 USD in 2 dage
(54 bedømmelser)

Hello, I'm not really bidding on this project, I just wanted to suggest you a great service to troubleshoot your issue - consider using [url removed, login to view] to find out where the bottleneck is coming from. The fact that you Flere

$147 USD in 3 dage
(72 bedømmelser)

check my feedback at 14 years experienced unix admin currently working for german Software House my experience matches your criteria,kindly review my cv for eva Flere

$55 USD in 0 dage
(55 bedømmelser)

Hi, I have an MS in Computer Science. What are the values for KeepAliveTimeout and MaxClients on your server? Also, are the requests stuck with a R status or a W or one of the other status keys? We can proc Flere

$50 USD på 1 dag
(37 bedømmelser)

Hi, I am very interested with your project. If you are using CentOS as Linux operating system, please install an utility called "atop" and try to view the hardware stats, network stats, process stats in your server whe Flere

$155 USD in 3 dage
(55 bedømmelser)

To be honest with you, I did not want to leave this message until I saw current status from jpg that you attached. First thing is that: You will need a memcache server (which can be created inside your existing s Flere

$105 USD in 4 dage
(18 bedømmelser)

Hi, We are fast growing hosting company in India. We have expertise in Linux server setup with management. We used to work with many hosting panels like cpanel, plesk, webmin , direct admin , ispconfig, zpanel, web Flere

$55 USD på 1 dag
(14 bedømmelser)

Hi I`m experienced linux/unix admin. Managing hundreds of linux systems on the daily basis. Have done many performance analyzes and troubleshooting`s in my life. I have RHCE Cert passed. Ready to take a look on You Flere

$222 USD in 3 dage
(15 bedømmelser)

I'm get ready to found bottleneck on your server My price is $30/h SSH root access is requied No TeamViewer or other. ************************************************************************************

$35 USD in 30 dage
(14 bedømmelser)

This is sure, problem would be resolved. We need to look into the server to know the reasons. we have server monitoring system, will monitor server for 24 hours to know the actual reason, timings, duration & check whic Flere

$150 USD in 3 dage
(8 bedømmelser)

Hello, just a guess: Is your filesystem Ext4 or from the Ext-family? KR, Oliver =================

$55 USD in 3 dage
(10 bedømmelser)

A proposal has not yet been provided

$155 USD in 3 dage
(1 bedømmelse)

I managed the [url removed, login to view] database cluster during its early growth phase. This was a mysql database cluster with 1 master and 7 replicated slaves. The web front end contained over 50 apache/php servers. I built the sche Flere

$45 USD in 2 dage
(1 bedømmelse)