Discussion:
[modwsgi] Apache+mod_wsgi+django results in timeout when reading response headers from daemon process
Paul Royik
2015-10-12 12:55:32 UTC
Permalink
Hi Graham and everyone.

I have a site that runs heavy math calculations using external math library.

I already wrote about it nearly half a year ago. In that case there was
timeout issue, but now I've fixed it.


But there is another issue.
Nearly the same time I got 503 error: Timeout when reading response headers
from daemon process.
This lasts for approximately 2 hours and then 503 error disappears.

I use Django 1.8.4 with mod_wsgi 4.4.13.

What configurations should I use in httpd.conf to avoid this error.
How to queue requests?
What is the number of sumultaneous requests?
....


What I want to do is avoid 503 error, limit number of simultaneous requests
and queue other requests.


My log file:
[Mon Oct 12 11:47:09.445618 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45625] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:47:14.432179 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45632] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/?f=tan%28x%2F2%29+%2B+%281%2F%28x%5E2%2B4%29%29&a=0&b=2&n=8&steps=on
[Mon Oct 12 11:47:20.201940 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45700] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:47:20.608201 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45704] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:08.984176 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45707] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:48:09.505969 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45730] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:14.492629 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45731] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:20.262302 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45732] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:20.668421 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45737] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.co.uk/
[Mon Oct 12 11:49:09.044532 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45744] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.co.uk/
[Mon Oct 12 11:49:09.566430 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45789] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:49:14.552970 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45795] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.co.uk/
[Mon Oct 12 11:49:20.322179 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45799] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:49:20.728784 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45803] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:50:09.104426 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45816] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=ln+x+&var=x&steps=on
[Mon Oct 12 11:50:09.626783 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45819] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%2F2%29%2B%281%2F%282*y%5E%281%2F2%29%29%29&var=&a=3&b=9
[Mon Oct 12 11:50:14.613330 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45820] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/
[Mon Oct 12 11:50:20.382640 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45832] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:50:20.789229 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45846] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.co.uk/
[Mon Oct 12 11:51:09.164863 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45848] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.co.uk/
[Mon Oct 12 11:51:09.634602 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45879] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw
[Mon Oct 12 11:51:14.639873 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45914] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.co.uk/
[Mon Oct 12 11:51:20.443005 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45918] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.com/
[Mon Oct 12 11:51:20.849576 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45920] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.ge/
[Mon Oct 12 11:52:09.225178 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45922] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:52:09.694485 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45936] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:52:14.671605 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45945] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:52:20.503359 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45950] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x3-x%2B8x-4&denom=2x-1&steps=on
[Mon Oct 12 11:52:20.909837 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45993] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw&cad=rja
[Mon Oct 12 11:53:09.285607 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46014] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:53:09.754914 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46023] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/?var=x&steps=on&calcid=36&f=e%255E%2528-x%2529%252Acos%2528n%252Ax%2529
[Mon Oct 12 11:53:14.731428 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46025] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:53:20.563428 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46026] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.google.co.uk/url?sa=t&rct=j&q=&esrc=s&source=web&cd=2&ved=0CCYQFjABahUKEwjjltCA7LzIAhVCvxQKHfBSCp8&url=http%3A%2F%2Fwww.emathhelp.net%2Fcalculators%2Fcalculus-2%2Fsimpsons-rule-calculator%2F&usg=AFQjCNHj3Aq2ZX5FyNMjo3ZLfkh_YTjl6Q
[Mon Oct 12 11:53:20.969433 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46031] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.co.nz/
[Mon Oct 12 11:54:09.345978 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46041] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/algebra-1/
[Mon Oct 12 11:54:09.815250 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46044] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.co.uk/
[Mon Oct 12 11:54:14.791866 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46049] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.co.nz/
[Mon Oct 12 11:54:20.623426 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46050] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:54:21.029911 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46113] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.co.nz/
[Mon Oct 12 11:55:09.406413 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46119] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.co.nz/
[Mon Oct 12 11:55:09.863209 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46133] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:55:14.852263 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46138] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:55:20.683175 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46159] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.co.nz/
[Mon Oct 12 11:55:21.090180 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46163] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:56:09.466178 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46166] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/algebra-1/
[Mon Oct 12 11:56:09.923661 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46168] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:56:14.912643 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46199] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:56:20.743628 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46214] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:56:21.150586 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46215] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:57:09.526178 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46227] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:57:09.983178 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46228] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.co.nz/
[Mon Oct 12 11:57:14.973070 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46232] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:57:20.782657 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46245] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:57:21.210175 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46250] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.co.nz/
[Mon Oct 12 11:58:09.586684 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46282] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.co.uk/
[Mon Oct 12 11:58:10.043640 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46296] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.co.uk/
[Mon Oct 12 11:58:15.033461 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46303] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
https://www.google.nl
[Mon Oct 12 11:58:20.843056 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46347] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:58:21.270190 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46357] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:09.647160 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46358] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:10.104071 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46360] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:15.093941 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46362] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:20.903456 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46366] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:21.330199 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46367] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:35.919450 2015] [wsgi:error] [pid 10210:tid
139829400610560] (11)Resource temporarily unavailable: [client
127.0.0.1:46419] mod_wsgi (pid=10210): Unable to connect to WSGI daemon
process 'django_math' on
'/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after
multiple attempts as listener backlog limit was exceeded.
[Mon Oct 12 11:59:36.345433 2015] [wsgi:error] [pid 10210:tid
139829283116800] (11)Resource temporarily unavailable: [client
127.0.0.1:46444] mod_wsgi (pid=10210): Unable to connect to WSGI daemon
process 'django_math' on
'/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after
multiple attempts as listener backlog limit was exceeded., referer:
http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%29%5E3%2F3-y%5E%281%2F2%29&var=&a=3&b=11
[Mon Oct 12 11:59:50.935597 2015] [wsgi:error] [pid 10210:tid
139829400610560] (11)Resource temporarily unavailable: [client
127.0.0.1:46489] mod_wsgi (pid=10210): Unable to connect to WSGI daemon
process 'django_math' on
'/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after
multiple attempts as listener backlog limit was exceeded.
[Mon Oct 12 11:59:51.361244 2015] [wsgi:error] [pid 10210:tid
139829283116800] (11)Resource temporarily unavailable: [client
127.0.0.1:46532] mod_wsgi (pid=10210): Unable to connect to WSGI daemon
process 'django_math' on
'/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after
multiple attempts as listener backlog limit was exceeded.
[Mon Oct 12 12:00:01.987886 2015] [core:warn] [pid 21414:tid
140401755707200] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:00:01.990053 2015] [mpm_worker:notice] [pid 21414:tid
140401755707200] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:00:01.990090 2015] [core:notice] [pid 21414:tid
140401755707200] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:01:01.141488 2015] [core:warn] [pid 22714:tid
139862846170944] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:01:01.148104 2015] [mpm_worker:notice] [pid 22714:tid
139862846170944] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:01:01.148136 2015] [core:notice] [pid 22714:tid
139862846170944] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:02:01.287286 2015] [core:warn] [pid 23392:tid
140227605587776] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:02:01.288063 2015] [mpm_worker:notice] [pid 23392:tid
140227605587776] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:02:01.288087 2015] [core:notice] [pid 23392:tid
140227605587776] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:03:01.464154 2015] [core:warn] [pid 24460:tid
139893862491968] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:03:01.464941 2015] [mpm_worker:notice] [pid 24460:tid
139893862491968] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:03:01.464973 2015] [core:notice] [pid 24460:tid
139893862491968] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:04:01.604819 2015] [core:warn] [pid 25540:tid
140530401601344] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:04:01.605673 2015] [mpm_worker:notice] [pid 25540:tid
140530401601344] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:04:01.605700 2015] [core:notice] [pid 25540:tid
140530401601344] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:04:13.617169 2015] [mpm_worker:error] [pid 25540:tid
140530401601344] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:05:01.702670 2015] [core:warn] [pid 26818:tid
140673843578688] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:05:01.703557 2015] [mpm_worker:notice] [pid 26818:tid
140673843578688] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:05:01.703589 2015] [core:notice] [pid 26818:tid
140673843578688] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:06:01.168476 2015] [core:warn] [pid 27705:tid
140135096485696] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:06:01.169291 2015] [mpm_worker:notice] [pid 27705:tid
140135096485696] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:06:01.169321 2015] [core:notice] [pid 27705:tid
140135096485696] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:06:04.172416 2015] [mpm_worker:error] [pid 27705:tid
140135096485696] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:07:01.315453 2015] [core:warn] [pid 28977:tid
139863950853952] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:07:01.316160 2015] [mpm_worker:notice] [pid 28977:tid
139863950853952] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:07:01.316183 2015] [core:notice] [pid 28977:tid
139863950853952] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:08:01.481740 2015] [core:warn] [pid 29982:tid
140057512040256] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:08:01.482526 2015] [mpm_worker:notice] [pid 29982:tid
140057512040256] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:08:01.482552 2015] [core:notice] [pid 29982:tid
140057512040256] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:09:01.632513 2015] [core:warn] [pid 30824:tid
139820490385216] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:09:01.633261 2015] [mpm_worker:notice] [pid 30824:tid
139820490385216] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:09:01.633286 2015] [core:notice] [pid 30824:tid
139820490385216] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:10:01.834855 2015] [core:warn] [pid 31509:tid
139907320584000] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:10:01.835689 2015] [mpm_worker:notice] [pid 31509:tid
139907320584000] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:10:01.835720 2015] [core:notice] [pid 31509:tid
139907320584000] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:10:34.863291 2015] [mpm_worker:error] [pid 31509:tid
139907320584000] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:11:01.316507 2015] [core:warn] [pid 577:tid 140572886275904]
AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid
overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:11:01.317261 2015] [mpm_worker:notice] [pid 577:tid
140572886275904] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:11:01.317285 2015] [core:notice] [pid 577:tid
140572886275904] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:12:01.544480 2015] [core:warn] [pid 1229:tid
139806001137472] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:12:01.545347 2015] [mpm_worker:notice] [pid 1229:tid
139806001137472] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:12:01.545376 2015] [core:notice] [pid 1229:tid
139806001137472] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:13:01.665928 2015] [core:warn] [pid 1837:tid
140557903468352] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:13:01.666710 2015] [mpm_worker:notice] [pid 1837:tid
140557903468352] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:13:01.666740 2015] [core:notice] [pid 1837:tid
140557903468352] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:14:01.803243 2015] [core:warn] [pid 2774:tid
140014261192512] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:14:01.804066 2015] [mpm_worker:notice] [pid 2774:tid
140014261192512] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:14:01.804094 2015] [core:notice] [pid 2774:tid
140014261192512] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:15:01.096911 2015] [core:warn] [pid 3478:tid
140715269289792] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:15:01.097723 2015] [mpm_worker:notice] [pid 3478:tid
140715269289792] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:15:01.097752 2015] [core:notice] [pid 3478:tid
140715269289792] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:16:01.134802 2015] [core:warn] [pid 4302:tid
140108755814208] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:16:01.135609 2015] [mpm_worker:notice] [pid 4302:tid
140108755814208] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:16:01.135636 2015] [core:notice] [pid 4302:tid
140108755814208] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:17:01.733951 2015] [core:warn] [pid 5038:tid
140272983287616] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:17:01.737885 2015] [mpm_worker:notice] [pid 5038:tid
140272983287616] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:17:01.737926 2015] [core:notice] [pid 5038:tid
140272983287616] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:18:02.045728 2015] [core:warn] [pid 5682:tid
140594909615936] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:18:02.046517 2015] [mpm_worker:notice] [pid 5682:tid
140594909615936] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:18:02.046547 2015] [core:notice] [pid 5682:tid
140594909615936] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:19:01.217200 2015] [core:warn] [pid 6435:tid
140558806185792] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:19:01.218046 2015] [mpm_worker:notice] [pid 6435:tid
140558806185792] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:19:01.218079 2015] [core:notice] [pid 6435:tid
140558806185792] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:20:01.457074 2015] [core:warn] [pid 7275:tid
140253779760960] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:20:01.457906 2015] [mpm_worker:notice] [pid 7275:tid
140253779760960] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:20:01.457932 2015] [core:notice] [pid 7275:tid
140253779760960] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:20:38.489662 2015] [mpm_worker:error] [pid 7275:tid
140253779760960] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:21:02.039561 2015] [core:warn] [pid 8716:tid
139837019592512] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:21:02.040348 2015] [mpm_worker:notice] [pid 8716:tid
139837019592512] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:21:02.040371 2015] [core:notice] [pid 8716:tid
139837019592512] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:22:01.180471 2015] [core:warn] [pid 9337:tid
140238174787392] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:22:01.184044 2015] [mpm_worker:notice] [pid 9337:tid
140238174787392] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:22:01.184074 2015] [core:notice] [pid 9337:tid
140238174787392] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:23:01.317485 2015] [core:warn] [pid 10078:tid
140717883950912] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:23:01.318230 2015] [mpm_worker:notice] [pid 10078:tid
140717883950912] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:23:01.318257 2015] [core:notice] [pid 10078:tid
140717883950912] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:23:44.356167 2015] [mpm_worker:error] [pid 10078:tid
140717883950912] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:24:01.486308 2015] [core:warn] [pid 11333:tid
139789441775424] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:24:01.487085 2015] [mpm_worker:notice] [pid 11333:tid
139789441775424] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:24:01.487121 2015] [core:notice] [pid 11333:tid
139789441775424] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:25:01.515113 2015] [core:warn] [pid 12038:tid
140570421385024] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:25:01.524388 2015] [mpm_worker:notice] [pid 12038:tid
140570421385024] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:25:01.524429 2015] [core:notice] [pid 12038:tid
140570421385024] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:26:01.118480 2015] [core:warn] [pid 12634:tid
140358443927360] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:26:01.119468 2015] [mpm_worker:notice] [pid 12634:tid
140358443927360] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:26:01.119496 2015] [core:notice] [pid 12634:tid
140358443927360] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:27:01.314705 2015] [core:warn] [pid 13279:tid
140626937759552] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:27:01.315425 2015] [mpm_worker:notice] [pid 13279:tid
140626937759552] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:27:01.315452 2015] [core:notice] [pid 13279:tid
140626937759552] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:27:39.349709 2015] [mpm_worker:error] [pid 13279:tid
140626937759552] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:28:01.442096 2015] [core:warn] [pid 14111:tid
140654334797632] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:28:01.442914 2015] [mpm_worker:notice] [pid 14111:tid
140654334797632] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:28:01.442946 2015] [core:notice] [pid 14111:tid
140654334797632] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:28:43.481396 2015] [mpm_worker:error] [pid 14111:tid
140654334797632] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:29:01.937561 2015] [core:warn] [pid 15126:tid
139717356287808] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:29:01.938273 2015] [mpm_worker:notice] [pid 15126:tid
139717356287808] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:29:01.938300 2015] [core:notice] [pid 15126:tid
139717356287808] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:29:35.969195 2015] [mpm_worker:error] [pid 15126:tid
139717356287808] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:30:01.312220 2015] [core:warn] [pid 16200:tid
139880597911360] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:30:01.313099 2015] [mpm_worker:notice] [pid 16200:tid
139880597911360] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:30:01.313126 2015] [core:notice] [pid 16200:tid
139880597911360] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:31:01.543513 2015] [core:warn] [pid 17782:tid
140568985847616] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:31:01.544308 2015] [mpm_worker:notice] [pid 17782:tid
140568985847616] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:31:01.544341 2015] [core:notice] [pid 17782:tid
140568985847616] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:31:44.581778 2015] [mpm_worker:error] [pid 17782:tid
140568985847616] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:32:01.670552 2015] [core:warn] [pid 18609:tid
139854616069952] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:32:01.671239 2015] [mpm_worker:notice] [pid 18609:tid
139854616069952] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:32:01.671264 2015] [core:notice] [pid 18609:tid
139854616069952] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:33:01.811278 2015] [core:warn] [pid 19482:tid
140212412380992] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:33:01.812041 2015] [mpm_worker:notice] [pid 19482:tid
140212412380992] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:33:01.812068 2015] [core:notice] [pid 19482:tid
140212412380992] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:34:01.949781 2015] [core:warn] [pid 20223:tid
139964921952064] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:34:01.950563 2015] [mpm_worker:notice] [pid 20223:tid
139964921952064] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:34:01.950592 2015] [core:notice] [pid 20223:tid
139964921952064] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:35:01.172351 2015] [core:warn] [pid 21521:tid
139944632571712] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:35:01.173181 2015] [mpm_worker:notice] [pid 21521:tid
139944632571712] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:35:01.173214 2015] [core:notice] [pid 21521:tid
139944632571712] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:36:01.746357 2015] [core:warn] [pid 22214:tid
139932455020352] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:36:01.751491 2015] [mpm_worker:notice] [pid 22214:tid
139932455020352] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:36:01.751539 2015] [core:notice] [pid 22214:tid
139932455020352] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:37:01.337972 2015] [core:warn] [pid 23006:tid
140537644132160] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:37:01.338785 2015] [mpm_worker:notice] [pid 23006:tid
140537644132160] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:37:01.338809 2015] [core:notice] [pid 23006:tid
140537644132160] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:37:04.340452 2015] [mpm_worker:error] [pid 23006:tid
140537644132160] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:38:01.647836 2015] [core:warn] [pid 25452:tid
140147500345152] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:38:01.648723 2015] [mpm_worker:notice] [pid 25452:tid
140147500345152] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:38:01.648752 2015] [core:notice] [pid 25452:tid
140147500345152] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:39:01.802239 2015] [core:warn] [pid 26338:tid
140464090150720] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:39:01.803034 2015] [mpm_worker:notice] [pid 26338:tid
140464090150720] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:39:01.803059 2015] [core:notice] [pid 26338:tid
140464090150720] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:40:01.998717 2015] [core:warn] [pid 27904:tid
140290780882752] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:40:01.999597 2015] [mpm_worker:notice] [pid 27904:tid
140290780882752] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:40:01.999625 2015] [core:notice] [pid 27904:tid
140290780882752] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:40:27.639550 2015] [core:warn] [pid 29126:tid
140117719406400] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:40:27.640177 2015] [mpm_worker:notice] [pid 29126:tid
140117719406400] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:40:27.640200 2015] [core:notice] [pid 29126:tid
140117719406400] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:41:01.647222 2015] [core:warn] [pid 29666:tid
140713509250880] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:41:01.647958 2015] [mpm_worker:notice] [pid 29666:tid
140713509250880] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:41:01.647984 2015] [core:notice] [pid 29666:tid
140713509250880] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:41:33.678548 2015] [mpm_worker:error] [pid 29666:tid
140713509250880] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:42:01.809229 2015] [core:warn] [pid 30628:tid
139889849755456] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:42:01.809926 2015] [mpm_worker:notice] [pid 30628:tid
139889849755456] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:42:01.809953 2015] [core:notice] [pid 30628:tid
139889849755456] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:43:01.935269 2015] [core:warn] [pid 31459:tid
140529499887424] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:43:01.936034 2015] [mpm_worker:notice] [pid 31459:tid
140529499887424] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:43:01.936060 2015] [core:notice] [pid 31459:tid
140529499887424] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:44:01.102682 2015] [core:warn] [pid 32278:tid
140438296102720] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:44:01.103500 2015] [mpm_worker:notice] [pid 32278:tid
140438296102720] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:44:01.103530 2015] [core:notice] [pid 32278:tid
140438296102720] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:45:01.388288 2015] [core:warn] [pid 519:tid 140380587255616]
AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid
overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:45:01.389640 2015] [mpm_worker:notice] [pid 519:tid
140380587255616] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:45:01.389675 2015] [core:notice] [pid 519:tid
140380587255616] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:46:01.618101 2015] [core:warn] [pid 1335:tid
140607028426560] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:46:01.618876 2015] [mpm_worker:notice] [pid 1335:tid
140607028426560] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:46:01.618903 2015] [core:notice] [pid 1335:tid
140607028426560] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:47:01.767558 2015] [core:warn] [pid 2088:tid
139756179154752] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:47:01.776160 2015] [mpm_worker:notice] [pid 2088:tid
139756179154752] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:47:01.776194 2015] [core:notice] [pid 2088:tid
139756179154752] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:48:01.912653 2015] [core:warn] [pid 2826:tid
140123083999040] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:48:01.913357 2015] [mpm_worker:notice] [pid 2826:tid
140123083999040] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:48:01.913381 2015] [core:notice] [pid 2826:tid
140123083999040] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:49:01.099705 2015] [core:warn] [pid 3609:tid
140536305137472] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:49:01.100379 2015] [mpm_worker:notice] [pid 3609:tid
140536305137472] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:49:01.100403 2015] [core:notice] [pid 3609:tid
140536305137472] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:50:01.295724 2015] [core:warn] [pid 4472:tid
140208124761920] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:50:01.301078 2015] [mpm_worker:notice] [pid 4472:tid
140208124761920] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:50:01.301108 2015] [core:notice] [pid 4472:tid
140208124761920] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:51:01.924682 2015] [core:warn] [pid 5771:tid
139905499400000] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:51:01.925430 2015] [mpm_worker:notice] [pid 5771:tid
139905499400000] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:51:01.925457 2015] [core:notice] [pid 5771:tid
139905499400000] AH00094: Command line:
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'



My httpd.conf:
ServerRoot "/home/simamura/webapps/django_math/apache2"

LoadModule alias_module modules/mod_alias.so
LoadModule authz_core_module modules/mod_authz_core.so
LoadModule dir_module modules/mod_dir.so
LoadModule env_module modules/mod_env.so
LoadModule log_config_module modules/mod_log_config.so
LoadModule mime_module modules/mod_mime.so
LoadModule rewrite_module modules/mod_rewrite.so
LoadModule setenvif_module modules/mod_setenvif.so
LoadModule wsgi_module modules/mod_wsgi.so
LoadModule unixd_module modules/mod_unixd.so

LogFormat "%{X-Forwarded-For}i %l %u %t \"%r\" %>s %b \"%{Referer}i\"
\"%{User-Agent}i\"" combined
CustomLog /home/simamura/logs/user/access_django_math.log combined
ErrorLog /home/simamura/logs/user/error_django_math.log

Listen 17084
KeepAlive Off
SetEnvIf X-Forwarded-SSL on HTTPS=1
ServerLimit 1
StartServers 1
MaxRequestWorkers 5
MinSpareThreads 1
MaxSpareThreads 3
ThreadsPerChild 5

WSGIDaemonProcess django_math processes=2 threads=12
python-path=/home/simamura/webapps/django_math:/home/simamura/webapps/django_math/mathsite:/home/simamura/webapps/django_math/lib/python2.7
maximum-requests=300
WSGIProcessGroup django_math
WSGIRestrictEmbedded On
WSGILazyInitialization On
WSGIScriptAlias /
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an email to modwsgi+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at http://groups.google.com/group/modwsgi.
For more options, visit https://groups.google.com/d/optout.
Graham Dumpleton
2015-10-13 10:39:26 UTC
Permalink
The messages indicate that all the threads in the daemon process group were blocked.

Initially new requests will still get added to the socket listener queue for the daemon processes, which has a capacity for 100 queued requests by default. Because though the daemon process wasn’t actually accepted them and removing them from the queue, on the Apache child worker side where they were being proxied, they would timeout. That accounts for the message:

Timeout when reading response headers from daemon process

When that 100 queue depth was eventually exceeded, no more requests could be queued up. This then resulted in attempts to connect to the daemon processes failing outright, which is what the error:

Unable to connect to WSGI daemon process

is all about.

First up I would suggest you also ensure you are setting:

WSGIApplicationGroup %{GLOBAL}

This forces the application to run the in the main interpreter context of the daemon process groups.

This avoids problems with third party extension modules for Python that haven’t been implemented correctly so as to be able to be used in sub interpreter contexts. These can only work in the main interpreter context.

This is often a cause of thread deadlocks.

That said, that you say it lasts 2 hours and then disappears is interesting.

This is because 2 hours is the network keep alive timeout value.

So what may be happening is request threads are contacting some backend service and due to some network/router issue, the connection is being broken. In some circumstances, depending on what software is doing with the connection, such a condition may not be detected until the 2 hour network timeout occurs.

In light of that, what backend services does your application talk to and would that traffic traverse over any switching equipment. Have you been having any network issues.

Graham
Post by Paul Royik
Hi Graham and everyone.
I have a site that runs heavy math calculations using external math library.
I already wrote about it nearly half a year ago. In that case there was timeout issue, but now I've fixed it.
But there is another issue.
Nearly the same time I got 503 error: Timeout when reading response headers from daemon process.
This lasts for approximately 2 hours and then 503 error disappears.
I use Django 1.8.4 with mod_wsgi 4.4.13.
What configurations should I use in httpd.conf to avoid this error.
How to queue requests?
What is the number of sumultaneous requests?
....
What I want to do is avoid 503 error, limit number of simultaneous requests and queue other requests.
[Mon Oct 12 11:47:09.445618 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45625] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:47:14.432179 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45632] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/?f=tan%28x%2F2%29+%2B+%281%2F%28x%5E2%2B4%29%29&a=0&b=2&n=8&steps=on
[Mon Oct 12 11:47:20.201940 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45700] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:47:20.608201 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45704] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:08.984176 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45707] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:48:09.505969 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45730] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:14.492629 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45731] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:20.262302 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45732] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:20.668421 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45737] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/
[Mon Oct 12 11:49:09.044532 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45744] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/
[Mon Oct 12 11:49:09.566430 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45789] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:49:14.552970 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45795] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/
[Mon Oct 12 11:49:20.322179 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45799] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:49:20.728784 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45803] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:50:09.104426 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45816] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=ln+x+&var=x&steps=on
[Mon Oct 12 11:50:09.626783 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45819] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%2F2%29%2B%281%2F%282*y%5E%281%2F2%29%29%29&var=&a=3&b=9
[Mon Oct 12 11:50:14.613330 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45820] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/
[Mon Oct 12 11:50:20.382640 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45832] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:50:20.789229 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45846] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/
[Mon Oct 12 11:51:09.164863 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45848] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/
[Mon Oct 12 11:51:09.634602 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45879] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw
[Mon Oct 12 11:51:14.639873 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45914] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/
[Mon Oct 12 11:51:20.443005 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45918] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.com/
[Mon Oct 12 11:51:20.849576 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45920] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.ge/
[Mon Oct 12 11:52:09.225178 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45922] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:52:09.694485 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45936] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:52:14.671605 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45945] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:52:20.503359 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45950] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x3-x%2B8x-4&denom=2x-1&steps=on
[Mon Oct 12 11:52:20.909837 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45993] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw&cad=rja
[Mon Oct 12 11:53:09.285607 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:46014] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:53:09.754914 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:46023] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/?var=x&steps=on&calcid=36&f=e%255E%2528-x%2529%252Acos%2528n%252Ax%2529
[Mon Oct 12 11:53:14.731428 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:46025] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:53:20.563428 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:46026] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.google.co.uk/url?sa=t&rct=j&q=&esrc=s&source=web&cd=2&ved=0CCYQFjABahUKEwjjltCA7LzIAhVCvxQKHfBSCp8&url=http%3A%2F%2Fwww.emathhelp.net%2Fcalculators%2Fcalculus-2%2Fsimpsons-rule-calculator%2F&usg=AFQjCNHj3Aq2ZX5FyNMjo3ZLfkh_YTjl6Q
[Mon Oct 12 11:53:20.969433 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:46031] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.nz/
[Mon Oct 12 11:54:09.345978 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:46041] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-1/
[Mon Oct 12 11:54:09.815250 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:46044] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/
[Mon Oct 12 11:54:14.791866 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:46049] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.nz/
[Mon Oct 12 11:54:20.623426 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:46050] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:54:21.029911 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:46113] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.nz/
[Mon Oct 12 11:55:09.406413 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:46119] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.nz/
[Mon Oct 12 11:55:09.863209 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:46133] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:55:14.852263 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:46138] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:55:20.683175 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:46159] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.nz/
[Mon Oct 12 11:55:21.090180 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:46163] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:56:09.466178 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:46166] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-1/
[Mon Oct 12 11:56:09.923661 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:46168] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:56:14.912643 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:46199] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:56:20.743628 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:46214] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:56:21.150586 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:46215] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:57:09.526178 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:46227] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:57:09.983178 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:46228] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.nz/
[Mon Oct 12 11:57:14.973070 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:46232] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:57:20.782657 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:46245] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:57:21.210175 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:46250] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.nz/
[Mon Oct 12 11:58:09.586684 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:46282] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/
[Mon Oct 12 11:58:10.043640 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:46296] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/
[Mon Oct 12 11:58:15.033461 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:46303] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.nl
[Mon Oct 12 11:58:20.843056 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:46347] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:58:21.270190 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:46357] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:09.647160 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:46358] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:10.104071 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:46360] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:15.093941 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:46362] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:20.903456 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:46366] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:21.330199 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:46367] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:35.919450 2015] [wsgi:error] [pid 10210:tid 139829400610560] (11)Resource temporarily unavailable: [client 127.0.0.1:46419] mod_wsgi (pid=10210): Unable to connect to WSGI daemon process 'django_math' on '/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after multiple attempts as listener backlog limit was exceeded.
[Mon Oct 12 11:59:36.345433 2015] [wsgi:error] [pid 10210:tid 139829283116800] (11)Resource temporarily unavailable: [client 127.0.0.1:46444] mod_wsgi (pid=10210): Unable to connect to WSGI daemon process 'django_math' on '/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after multiple attempts as listener backlog limit was exceeded., referer: http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%29%5E3%2F3-y%5E%281%2F2%29&var=&a=3&b=11
[Mon Oct 12 11:59:50.935597 2015] [wsgi:error] [pid 10210:tid 139829400610560] (11)Resource temporarily unavailable: [client 127.0.0.1:46489] mod_wsgi (pid=10210): Unable to connect to WSGI daemon process 'django_math' on '/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after multiple attempts as listener backlog limit was exceeded.
[Mon Oct 12 11:59:51.361244 2015] [wsgi:error] [pid 10210:tid 139829283116800] (11)Resource temporarily unavailable: [client 127.0.0.1:46532] mod_wsgi (pid=10210): Unable to connect to WSGI daemon process 'django_math' on '/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after multiple attempts as listener backlog limit was exceeded.
[Mon Oct 12 12:00:01.987886 2015] [core:warn] [pid 21414:tid 140401755707200] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:00:01.990053 2015] [mpm_worker:notice] [pid 21414:tid 140401755707200] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:00:01.990090 2015] [core:notice] [pid 21414:tid 140401755707200] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:01:01.141488 2015] [core:warn] [pid 22714:tid 139862846170944] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:01:01.148104 2015] [mpm_worker:notice] [pid 22714:tid 139862846170944] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:01:01.148136 2015] [core:notice] [pid 22714:tid 139862846170944] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:02:01.287286 2015] [core:warn] [pid 23392:tid 140227605587776] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:02:01.288063 2015] [mpm_worker:notice] [pid 23392:tid 140227605587776] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:02:01.288087 2015] [core:notice] [pid 23392:tid 140227605587776] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:03:01.464154 2015] [core:warn] [pid 24460:tid 139893862491968] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:03:01.464941 2015] [mpm_worker:notice] [pid 24460:tid 139893862491968] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:03:01.464973 2015] [core:notice] [pid 24460:tid 139893862491968] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:04:01.604819 2015] [core:warn] [pid 25540:tid 140530401601344] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:04:01.605673 2015] [mpm_worker:notice] [pid 25540:tid 140530401601344] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:04:01.605700 2015] [core:notice] [pid 25540:tid 140530401601344] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:04:13.617169 2015] [mpm_worker:error] [pid 25540:tid 140530401601344] AH00286: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:05:01.702670 2015] [core:warn] [pid 26818:tid 140673843578688] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:05:01.703557 2015] [mpm_worker:notice] [pid 26818:tid 140673843578688] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:05:01.703589 2015] [core:notice] [pid 26818:tid 140673843578688] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:06:01.168476 2015] [core:warn] [pid 27705:tid 140135096485696] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:06:01.169291 2015] [mpm_worker:notice] [pid 27705:tid 140135096485696] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:06:01.169321 2015] [core:notice] [pid 27705:tid 140135096485696] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:06:04.172416 2015] [mpm_worker:error] [pid 27705:tid 140135096485696] AH00286: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:07:01.315453 2015] [core:warn] [pid 28977:tid 139863950853952] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:07:01.316160 2015] [mpm_worker:notice] [pid 28977:tid 139863950853952] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:07:01.316183 2015] [core:notice] [pid 28977:tid 139863950853952] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:08:01.481740 2015] [core:warn] [pid 29982:tid 140057512040256] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:08:01.482526 2015] [mpm_worker:notice] [pid 29982:tid 140057512040256] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:08:01.482552 2015] [core:notice] [pid 29982:tid 140057512040256] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:09:01.632513 2015] [core:warn] [pid 30824:tid 139820490385216] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:09:01.633261 2015] [mpm_worker:notice] [pid 30824:tid 139820490385216] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:09:01.633286 2015] [core:notice] [pid 30824:tid 139820490385216] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:10:01.834855 2015] [core:warn] [pid 31509:tid 139907320584000] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:10:01.835689 2015] [mpm_worker:notice] [pid 31509:tid 139907320584000] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:10:01.835720 2015] [core:notice] [pid 31509:tid 139907320584000] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:10:34.863291 2015] [mpm_worker:error] [pid 31509:tid 139907320584000] AH00286: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:11:01.316507 2015] [core:warn] [pid 577:tid 140572886275904] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:11:01.317261 2015] [mpm_worker:notice] [pid 577:tid 140572886275904] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:11:01.317285 2015] [core:notice] [pid 577:tid 140572886275904] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:12:01.544480 2015] [core:warn] [pid 1229:tid 139806001137472] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:12:01.545347 2015] [mpm_worker:notice] [pid 1229:tid 139806001137472] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:12:01.545376 2015] [core:notice] [pid 1229:tid 139806001137472] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:13:01.665928 2015] [core:warn] [pid 1837:tid 140557903468352] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:13:01.666710 2015] [mpm_worker:notice] [pid 1837:tid 140557903468352] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:13:01.666740 2015] [core:notice] [pid 1837:tid 140557903468352] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:14:01.803243 2015] [core:warn] [pid 2774:tid 140014261192512] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:14:01.804066 2015] [mpm_worker:notice] [pid 2774:tid 140014261192512] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:14:01.804094 2015] [core:notice] [pid 2774:tid 140014261192512] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:15:01.096911 2015] [core:warn] [pid 3478:tid 140715269289792] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:15:01.097723 2015] [mpm_worker:notice] [pid 3478:tid 140715269289792] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:15:01.097752 2015] [core:notice] [pid 3478:tid 140715269289792] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:16:01.134802 2015] [core:warn] [pid 4302:tid 140108755814208] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:16:01.135609 2015] [mpm_worker:notice] [pid 4302:tid 140108755814208] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:16:01.135636 2015] [core:notice] [pid 4302:tid 140108755814208] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:17:01.733951 2015] [core:warn] [pid 5038:tid 140272983287616] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:17:01.737885 2015] [mpm_worker:notice] [pid 5038:tid 140272983287616] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:17:01.737926 2015] [core:notice] [pid 5038:tid 140272983287616] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:18:02.045728 2015] [core:warn] [pid 5682:tid 140594909615936] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:18:02.046517 2015] [mpm_worker:notice] [pid 5682:tid 140594909615936] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:18:02.046547 2015] [core:notice] [pid 5682:tid 140594909615936] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:19:01.217200 2015] [core:warn] [pid 6435:tid 140558806185792] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:19:01.218046 2015] [mpm_worker:notice] [pid 6435:tid 140558806185792] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:19:01.218079 2015] [core:notice] [pid 6435:tid 140558806185792] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:20:01.457074 2015] [core:warn] [pid 7275:tid 140253779760960] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:20:01.457906 2015] [mpm_worker:notice] [pid 7275:tid 140253779760960] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:20:01.457932 2015] [core:notice] [pid 7275:tid 140253779760960] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:20:38.489662 2015] [mpm_worker:error] [pid 7275:tid 140253779760960] AH00286: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:21:02.039561 2015] [core:warn] [pid 8716:tid 139837019592512] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:21:02.040348 2015] [mpm_worker:notice] [pid 8716:tid 139837019592512] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:21:02.040371 2015] [core:notice] [pid 8716:tid 139837019592512] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:22:01.180471 2015] [core:warn] [pid 9337:tid 140238174787392] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:22:01.184044 2015] [mpm_worker:notice] [pid 9337:tid 140238174787392] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:22:01.184074 2015] [core:notice] [pid 9337:tid 140238174787392] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:23:01.317485 2015] [core:warn] [pid 10078:tid 140717883950912] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:23:01.318230 2015] [mpm_worker:notice] [pid 10078:tid 140717883950912] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:23:01.318257 2015] [core:notice] [pid 10078:tid 140717883950912] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:23:44.356167 2015] [mpm_worker:error] [pid 10078:tid 140717883950912] AH00286: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:24:01.486308 2015] [core:warn] [pid 11333:tid 139789441775424] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:24:01.487085 2015] [mpm_worker:notice] [pid 11333:tid 139789441775424] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:24:01.487121 2015] [core:notice] [pid 11333:tid 139789441775424] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:25:01.515113 2015] [core:warn] [pid 12038:tid 140570421385024] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:25:01.524388 2015] [mpm_worker:notice] [pid 12038:tid 140570421385024] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:25:01.524429 2015] [core:notice] [pid 12038:tid 140570421385024] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:26:01.118480 2015] [core:warn] [pid 12634:tid 140358443927360] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:26:01.119468 2015] [mpm_worker:notice] [pid 12634:tid 140358443927360] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:26:01.119496 2015] [core:notice] [pid 12634:tid 140358443927360] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:27:01.314705 2015] [core:warn] [pid 13279:tid 140626937759552] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:27:01.315425 2015] [mpm_worker:notice] [pid 13279:tid 140626937759552] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:27:01.315452 2015] [core:notice] [pid 13279:tid 140626937759552] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:27:39.349709 2015] [mpm_worker:error] [pid 13279:tid 140626937759552] AH00286: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:28:01.442096 2015] [core:warn] [pid 14111:tid 140654334797632] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:28:01.442914 2015] [mpm_worker:notice] [pid 14111:tid 140654334797632] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:28:01.442946 2015] [core:notice] [pid 14111:tid 140654334797632] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:28:43.481396 2015] [mpm_worker:error] [pid 14111:tid 140654334797632] AH00286: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:29:01.937561 2015] [core:warn] [pid 15126:tid 139717356287808] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:29:01.938273 2015] [mpm_worker:notice] [pid 15126:tid 139717356287808] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:29:01.938300 2015] [core:notice] [pid 15126:tid 139717356287808] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:29:35.969195 2015] [mpm_worker:error] [pid 15126:tid 139717356287808] AH00286: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:30:01.312220 2015] [core:warn] [pid 16200:tid 139880597911360] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:30:01.313099 2015] [mpm_worker:notice] [pid 16200:tid 139880597911360] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:30:01.313126 2015] [core:notice] [pid 16200:tid 139880597911360] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:31:01.543513 2015] [core:warn] [pid 17782:tid 140568985847616] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:31:01.544308 2015] [mpm_worker:notice] [pid 17782:tid 140568985847616] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:31:01.544341 2015] [core:notice] [pid 17782:tid 140568985847616] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:31:44.581778 2015] [mpm_worker:error] [pid 17782:tid 140568985847616] AH00286: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:32:01.670552 2015] [core:warn] [pid 18609:tid 139854616069952] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:32:01.671239 2015] [mpm_worker:notice] [pid 18609:tid 139854616069952] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:32:01.671264 2015] [core:notice] [pid 18609:tid 139854616069952] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:33:01.811278 2015] [core:warn] [pid 19482:tid 140212412380992] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:33:01.812041 2015] [mpm_worker:notice] [pid 19482:tid 140212412380992] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:33:01.812068 2015] [core:notice] [pid 19482:tid 140212412380992] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:34:01.949781 2015] [core:warn] [pid 20223:tid 139964921952064] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:34:01.950563 2015] [mpm_worker:notice] [pid 20223:tid 139964921952064] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:34:01.950592 2015] [core:notice] [pid 20223:tid 139964921952064] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:35:01.172351 2015] [core:warn] [pid 21521:tid 139944632571712] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:35:01.173181 2015] [mpm_worker:notice] [pid 21521:tid 139944632571712] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:35:01.173214 2015] [core:notice] [pid 21521:tid 139944632571712] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:36:01.746357 2015] [core:warn] [pid 22214:tid 139932455020352] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:36:01.751491 2015] [mpm_worker:notice] [pid 22214:tid 139932455020352] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:36:01.751539 2015] [core:notice] [pid 22214:tid 139932455020352] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:37:01.337972 2015] [core:warn] [pid 23006:tid 140537644132160] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:37:01.338785 2015] [mpm_worker:notice] [pid 23006:tid 140537644132160] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:37:01.338809 2015] [core:notice] [pid 23006:tid 140537644132160] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:37:04.340452 2015] [mpm_worker:error] [pid 23006:tid 140537644132160] AH00286: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:38:01.647836 2015] [core:warn] [pid 25452:tid 140147500345152] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:38:01.648723 2015] [mpm_worker:notice] [pid 25452:tid 140147500345152] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:38:01.648752 2015] [core:notice] [pid 25452:tid 140147500345152] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:39:01.802239 2015] [core:warn] [pid 26338:tid 140464090150720] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:39:01.803034 2015] [mpm_worker:notice] [pid 26338:tid 140464090150720] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:39:01.803059 2015] [core:notice] [pid 26338:tid 140464090150720] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:40:01.998717 2015] [core:warn] [pid 27904:tid 140290780882752] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:40:01.999597 2015] [mpm_worker:notice] [pid 27904:tid 140290780882752] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:40:01.999625 2015] [core:notice] [pid 27904:tid 140290780882752] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:40:27.639550 2015] [core:warn] [pid 29126:tid 140117719406400] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:40:27.640177 2015] [mpm_worker:notice] [pid 29126:tid 140117719406400] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:40:27.640200 2015] [core:notice] [pid 29126:tid 140117719406400] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:41:01.647222 2015] [core:warn] [pid 29666:tid 140713509250880] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:41:01.647958 2015] [mpm_worker:notice] [pid 29666:tid 140713509250880] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:41:01.647984 2015] [core:notice] [pid 29666:tid 140713509250880] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:41:33.678548 2015] [mpm_worker:error] [pid 29666:tid 140713509250880] AH00286: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:42:01.809229 2015] [core:warn] [pid 30628:tid 139889849755456] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:42:01.809926 2015] [mpm_worker:notice] [pid 30628:tid 139889849755456] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:42:01.809953 2015] [core:notice] [pid 30628:tid 139889849755456] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:43:01.935269 2015] [core:warn] [pid 31459:tid 140529499887424] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:43:01.936034 2015] [mpm_worker:notice] [pid 31459:tid 140529499887424] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:43:01.936060 2015] [core:notice] [pid 31459:tid 140529499887424] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:44:01.102682 2015] [core:warn] [pid 32278:tid 140438296102720] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:44:01.103500 2015] [mpm_worker:notice] [pid 32278:tid 140438296102720] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:44:01.103530 2015] [core:notice] [pid 32278:tid 140438296102720] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:45:01.388288 2015] [core:warn] [pid 519:tid 140380587255616] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:45:01.389640 2015] [mpm_worker:notice] [pid 519:tid 140380587255616] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:45:01.389675 2015] [core:notice] [pid 519:tid 140380587255616] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:46:01.618101 2015] [core:warn] [pid 1335:tid 140607028426560] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:46:01.618876 2015] [mpm_worker:notice] [pid 1335:tid 140607028426560] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:46:01.618903 2015] [core:notice] [pid 1335:tid 140607028426560] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:47:01.767558 2015] [core:warn] [pid 2088:tid 139756179154752] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:47:01.776160 2015] [mpm_worker:notice] [pid 2088:tid 139756179154752] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:47:01.776194 2015] [core:notice] [pid 2088:tid 139756179154752] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:48:01.912653 2015] [core:warn] [pid 2826:tid 140123083999040] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:48:01.913357 2015] [mpm_worker:notice] [pid 2826:tid 140123083999040] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:48:01.913381 2015] [core:notice] [pid 2826:tid 140123083999040] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:49:01.099705 2015] [core:warn] [pid 3609:tid 140536305137472] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:49:01.100379 2015] [mpm_worker:notice] [pid 3609:tid 140536305137472] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:49:01.100403 2015] [core:notice] [pid 3609:tid 140536305137472] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:50:01.295724 2015] [core:warn] [pid 4472:tid 140208124761920] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:50:01.301078 2015] [mpm_worker:notice] [pid 4472:tid 140208124761920] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:50:01.301108 2015] [core:notice] [pid 4472:tid 140208124761920] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:51:01.924682 2015] [core:warn] [pid 5771:tid 139905499400000] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:51:01.925430 2015] [mpm_worker:notice] [pid 5771:tid 139905499400000] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:51:01.925457 2015] [core:notice] [pid 5771:tid 139905499400000] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
ServerRoot "/home/simamura/webapps/django_math/apache2"
LoadModule alias_module modules/mod_alias.so
LoadModule authz_core_module modules/mod_authz_core.so
LoadModule dir_module modules/mod_dir.so
LoadModule env_module modules/mod_env.so
LoadModule log_config_module modules/mod_log_config.so
LoadModule mime_module modules/mod_mime.so
LoadModule rewrite_module modules/mod_rewrite.so
LoadModule setenvif_module modules/mod_setenvif.so
LoadModule wsgi_module modules/mod_wsgi.so
LoadModule unixd_module modules/mod_unixd.so
LogFormat "%{X-Forwarded-For}i %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\"" combined
CustomLog /home/simamura/logs/user/access_django_math.log combined
ErrorLog /home/simamura/logs/user/error_django_math.log
Listen 17084
KeepAlive Off
SetEnvIf X-Forwarded-SSL on HTTPS=1
ServerLimit 1
StartServers 1
MaxRequestWorkers 5
MinSpareThreads 1
MaxSpareThreads 3
ThreadsPerChild 5
WSGIDaemonProcess django_math processes=2 threads=12 python-path=/home/simamura/webapps/django_math:/home/simamura/webapps/django_math/mathsite:/home/simamura/webapps/django_math/lib/python2.7 maximum-requests=300
WSGIProcessGroup django_math
WSGIRestrictEmbedded On
WSGILazyInitialization On
WSGIScriptAlias / /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
Visit this group at http://groups.google.com/group/modwsgi <http://groups.google.com/group/modwsgi>.
For more options, visit https://groups.google.com/d/optout <https://groups.google.com/d/optout>.
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an email to modwsgi+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at http://groups.google.com/group/modwsgi.
For more options, visit https://groups.google.com/d/optout.
Paul Royik
2015-10-13 12:08:21 UTC
Permalink
Thank you for your answer.
I asked Webfaction to change machine and problem disappeared. Possibly was
some issue with server.

But still when I set maximum-requests=300, it gave me timeout.

Can you clarify what mod_wsgi parameters mean and how to tune server, so
that it consumes less memory?
I want to simultaneously serve only 3-5 requests and other requests should
be queued.
What should be a value of KeepAlive, ServerLimit, StartServers,
MaxRequestWorkers, MinSpareThreads, MaxSpareThreads, ThreadsPerChild,
Timeout, MaxKeepAliveRequests, KeepAliveTimeout, StartServers,
MaxRequestsPerChild, maximum-requests, processes, threads?

In addition, I want to know difference between processes and threads.


Thank you very much.
Post by Graham Dumpleton
The messages indicate that all the threads in the daemon process group were blocked.
Initially new requests will still get added to the socket listener queue
for the daemon processes, which has a capacity for 100 queued requests by
default. Because though the daemon process wasn’t actually accepted them
and removing them from the queue, on the Apache child worker side where
Timeout when reading response headers from daemon process
When that 100 queue depth was eventually exceeded, no more requests could
be queued up. This then resulted in attempts to connect to the daemon
Unable to connect to WSGI daemon process
is all about.
WSGIApplicationGroup %{GLOBAL}
This forces the application to run the in the main interpreter context of
the daemon process groups.
This avoids problems with third party extension modules for Python that
haven’t been implemented correctly so as to be able to be used in sub
interpreter contexts. These can only work in the main interpreter context.
This is often a cause of thread deadlocks.
That said, that you say it lasts 2 hours and then disappears is interesting.
This is because 2 hours is the network keep alive timeout value.
So what may be happening is request threads are contacting some backend
service and due to some network/router issue, the connection is being
broken. In some circumstances, depending on what software is doing with the
connection, such a condition may not be detected until the 2 hour network
timeout occurs.
In light of that, what backend services does your application talk to and
would that traffic traverse over any switching equipment. Have you been
having any network issues.
Graham
Hi Graham and everyone.
I have a site that runs heavy math calculations using external math library.
I already wrote about it nearly half a year ago. In that case there was
timeout issue, but now I've fixed it.
But there is another issue.
Nearly the same time I got 503 error: Timeout when reading response
headers from daemon process.
This lasts for approximately 2 hours and then 503 error disappears.
I use Django 1.8.4 with mod_wsgi 4.4.13.
What configurations should I use in httpd.conf to avoid this error.
How to queue requests?
What is the number of sumultaneous requests?
....
What I want to do is avoid 503 error, limit number of simultaneous
requests and queue other requests.
[Mon Oct 12 11:47:09.445618 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45625] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:47:14.432179 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45632] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/?f=tan%28x%2F2%29+%2B+%281%2F%28x%5E2%2B4%29%29&a=0&b=2&n=8&steps=on
[Mon Oct 12 11:47:20.201940 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45700] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:47:20.608201 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45704] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:08.984176 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45707] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:48:09.505969 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45730] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:14.492629 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45731] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:20.262302 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45732] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:20.668421 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45737] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:09.044532 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45744] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:09.566430 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45789] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:49:14.552970 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45795] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:20.322179 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45799] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:49:20.728784 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45803] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:50:09.104426 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45816] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=ln+x+&var=x&steps=on
[Mon Oct 12 11:50:09.626783 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45819] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%2F2%29%2B%281%2F%282*y%5E%281%2F2%29%29%29&var=&a=3&b=9
[Mon Oct 12 11:50:14.613330 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45820] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/
[Mon Oct 12 11:50:20.382640 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45832] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:50:20.789229 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45846] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:09.164863 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45848] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:09.634602 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45879] Timeout when reading response
http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw
[Mon Oct 12 11:51:14.639873 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45914] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:20.443005 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45918] Timeout when reading response
https://www.google.com/
[Mon Oct 12 11:51:20.849576 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45920] Timeout when reading response
https://www.google.ge/
[Mon Oct 12 11:52:09.225178 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45922] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:52:09.694485 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45936] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:52:14.671605 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45945] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:52:20.503359 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45950] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x3-x%2B8x-4&denom=2x-1&steps=on
[Mon Oct 12 11:52:20.909837 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45993] Timeout when reading response
http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw&cad=rja
[Mon Oct 12 11:53:09.285607 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46014] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:53:09.754914 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46023] Timeout when reading response
http://www.emathhelp.net/calculators/?var=x&steps=on&calcid=36&f=e%255E%2528-x%2529%252Acos%2528n%252Ax%2529
[Mon Oct 12 11:53:14.731428 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46025] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:53:20.563428 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46026] Timeout when reading response
http://www.google.co.uk/url?sa=t&rct=j&q=&esrc=s&source=web&cd=2&ved=0CCYQFjABahUKEwjjltCA7LzIAhVCvxQKHfBSCp8&url=http%3A%2F%2Fwww.emathhelp.net%2Fcalculators%2Fcalculus-2%2Fsimpsons-rule-calculator%2F&usg=AFQjCNHj3Aq2ZX5FyNMjo3ZLfkh_YTjl6Q
[Mon Oct 12 11:53:20.969433 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46031] Timeout when reading response
https://www.google.co.nz/
[Mon Oct 12 11:54:09.345978 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46041] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/
[Mon Oct 12 11:54:09.815250 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46044] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:54:14.791866 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46049] Timeout when reading response
https://www.google.co.nz/
[Mon Oct 12 11:54:20.623426 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46050] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:54:21.029911 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46113] Timeout when reading response
https://www.google.co.nz/
[Mon Oct 12 11:55:09.406413 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46119] Timeout when reading response
https://www.google.co.nz/
[Mon Oct 12 11:55:09.863209 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46133] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:55:14.852263 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46138] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:55:20.683175 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46159] Timeout when reading response
https://www.google.co.nz/
[Mon Oct 12 11:55:21.090180 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46163] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:56:09.466178 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46166] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/
[Mon Oct 12 11:56:09.923661 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46168] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:56:14.912643 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46199] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:56:20.743628 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46214] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:56:21.150586 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46215] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:57:09.526178 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46227] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:57:09.983178 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46228] Timeout when reading response
https://www.google.co.nz/
[Mon Oct 12 11:57:14.973070 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46232] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:57:20.782657 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46245] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:57:21.210175 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46250] Timeout when reading response
https://www.google.co.nz/
[Mon Oct 12 11:58:09.586684 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46282] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:58:10.043640 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46296] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:58:15.033461 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46303] Timeout when reading response
https://www.google.nl
[Mon Oct 12 11:58:20.843056 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46347] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:58:21.270190 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46357] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:09.647160 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46358] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:10.104071 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46360] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:15.093941 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46362] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:20.903456 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46366] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:21.330199 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46367] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:35.919450 2015] [wsgi:error] [pid 10210:tid
139829400610560] (11)Resource temporarily unavailable: [client
127.0.0.1:46419] mod_wsgi (pid=10210): Unable to connect to WSGI daemon
process 'django_math' on
'/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after
multiple attempts as listener backlog limit was exceeded.
[Mon Oct 12 11:59:36.345433 2015] [wsgi:error] [pid 10210:tid
139829283116800] (11)Resource temporarily unavailable: [client
127.0.0.1:46444] mod_wsgi (pid=10210): Unable to connect to WSGI daemon
process 'django_math' on
'/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after
http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%29%5E3%2F3-y%5E%281%2F2%29&var=&a=3&b=11
[Mon Oct 12 11:59:50.935597 2015] [wsgi:error] [pid 10210:tid
139829400610560] (11)Resource temporarily unavailable: [client
127.0.0.1:46489] mod_wsgi (pid=10210): Unable to connect to WSGI daemon
process 'django_math' on
'/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after
multiple attempts as listener backlog limit was exceeded.
[Mon Oct 12 11:59:51.361244 2015] [wsgi:error] [pid 10210:tid
139829283116800] (11)Resource temporarily unavailable: [client
127.0.0.1:46532] mod_wsgi (pid=10210): Unable to connect to WSGI daemon
process 'django_math' on
'/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after
multiple attempts as listener backlog limit was exceeded.
[Mon Oct 12 12:00:01.987886 2015] [core:warn] [pid 21414:tid
140401755707200] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:00:01.990053 2015] [mpm_worker:notice] [pid 21414:tid
140401755707200] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:00:01.990090 2015] [core:notice] [pid 21414:tid
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:01:01.141488 2015] [core:warn] [pid 22714:tid
139862846170944] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:01:01.148104 2015] [mpm_worker:notice] [pid 22714:tid
139862846170944] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:01:01.148136 2015] [core:notice] [pid 22714:tid
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:02:01.287286 2015] [core:warn] [pid 23392:tid
140227605587776] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:02:01.288063 2015] [mpm_worker:notice] [pid 23392:tid
140227605587776] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:02:01.288087 2015] [core:notice] [pid 23392:tid
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:03:01.464154 2015] [core:warn] [pid 24460:tid
139893862491968] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:03:01.464941 2015] [mpm_worker:notice] [pid 24460:tid
139893862491968] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:03:01.464973 2015] [core:notice] [pid 24460:tid
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:04:01.604819 2015] [core:warn] [pid 25540:tid
140530401601344] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:04:01.605673 2015] [mpm_worker:notice] [pid 25540:tid
140530401601344] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:04:01.605700 2015] [core:notice] [pid 25540:tid
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:04:13.617169 2015] [mpm_worker:error] [pid 25540:tid
140530401601344] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:05:01.702670 2015] [core:warn] [pid 26818:tid
140673843578688] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:05:01.703557 2015] [mpm_worker:notice] [pid 26818:tid
140673843578688] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:05:01.703589 2015] [core:notice] [pid 26818:tid
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:06:01.168476 2015] [core:warn] [pid 27705:tid
140135096485696] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:06:01.169291 2015] [mpm_worker:notice] [pid 27705:tid
140135096485696] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:06:01.169321 2015] [core:notice] [pid 27705:tid
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:06:04.172416 2015] [mpm_worker:error] [pid 27705:tid
140135096485696] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:07:01.315453 2015] [core:warn] [pid 28977:tid
139863950853952] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:07:01.316160 2015] [mpm_worker:notice] [pid 28977:tid
139863950853952] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:07:01.316183 2015] [core:notice] [pid 28977:tid
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_mat
...
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an email to modwsgi+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at http://groups.google.com/group/modwsgi.
For more options, visit https://groups.google.com/d/optout.
Paul Royik
2015-10-22 05:41:38 UTC
Permalink
Problem appeared again.
So, I will answer your questions.
I use third-party libraries sympy and sage. Didn't have any network issues.
Actually this happened when I sleep.
Exact error time is 2 hours 11 minutes (this value is always the same).

So, can I lower network keep alive timeout value?

If I set WSGIApplicationGroup %{GLOBAL}, will this help?

Thank you.
Post by Graham Dumpleton
The messages indicate that all the threads in the daemon process group were blocked.
Initially new requests will still get added to the socket listener queue
for the daemon processes, which has a capacity for 100 queued requests by
default. Because though the daemon process wasn’t actually accepted them
and removing them from the queue, on the Apache child worker side where
Timeout when reading response headers from daemon process
When that 100 queue depth was eventually exceeded, no more requests could
be queued up. This then resulted in attempts to connect to the daemon
Unable to connect to WSGI daemon process
is all about.
WSGIApplicationGroup %{GLOBAL}
This forces the application to run the in the main interpreter context of
the daemon process groups.
This avoids problems with third party extension modules for Python that
haven’t been implemented correctly so as to be able to be used in sub
interpreter contexts. These can only work in the main interpreter context.
This is often a cause of thread deadlocks.
That said, that you say it lasts 2 hours and then disappears is interesting.
This is because 2 hours is the network keep alive timeout value.
So what may be happening is request threads are contacting some backend
service and due to some network/router issue, the connection is being
broken. In some circumstances, depending on what software is doing with the
connection, such a condition may not be detected until the 2 hour network
timeout occurs.
In light of that, what backend services does your application talk to and
would that traffic traverse over any switching equipment. Have you been
having any network issues.
Graham
Hi Graham and everyone.
I have a site that runs heavy math calculations using external math library.
I already wrote about it nearly half a year ago. In that case there was
timeout issue, but now I've fixed it.
But there is another issue.
Nearly the same time I got 503 error: Timeout when reading response
headers from daemon process.
This lasts for approximately 2 hours and then 503 error disappears.
I use Django 1.8.4 with mod_wsgi 4.4.13.
What configurations should I use in httpd.conf to avoid this error.
How to queue requests?
What is the number of sumultaneous requests?
....
What I want to do is avoid 503 error, limit number of simultaneous
requests and queue other requests.
[Mon Oct 12 11:47:09.445618 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45625] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:47:14.432179 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45632] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/?f=tan%28x%2F2%29+%2B+%281%2F%28x%5E2%2B4%29%29&a=0&b=2&n=8&steps=on
[Mon Oct 12 11:47:20.201940 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45700] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:47:20.608201 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45704] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:08.984176 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45707] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:48:09.505969 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45730] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:14.492629 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45731] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:20.262302 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45732] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:20.668421 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45737] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:09.044532 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45744] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:09.566430 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45789] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:49:14.552970 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45795] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:20.322179 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45799] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:49:20.728784 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45803] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:50:09.104426 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45816] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=ln+x+&var=x&steps=on
[Mon Oct 12 11:50:09.626783 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45819] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%2F2%29%2B%281%2F%282*y%5E%281%2F2%29%29%29&var=&a=3&b=9
[Mon Oct 12 11:50:14.613330 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45820] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/
[Mon Oct 12 11:50:20.382640 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45832] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:50:20.789229 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45846] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:09.164863 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45848] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:09.634602 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45879] Timeout when reading response
http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw
[Mon Oct 12 11:51:14.639873 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45914] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:20.443005 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45918] Timeout when reading response
https://www.google.com/
[Mon Oct 12 11:51:20.849576 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45920] Timeout when reading response
https://www.google.ge/
[Mon Oct 12 11:52:09.225178 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45922] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:52:09.694485 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45936] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:52:14.671605 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45945] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:52:20.503359 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45950] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x3-x%2B8x-4&denom=2x-1&steps=on
[Mon Oct 12 11:52:20.909837 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45993] Timeout when reading response
http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw&cad=rja
[Mon Oct 12 11:53:09.285607 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46014] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:53:09.754914 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46023] Timeout when reading response
http://www.emathhelp.net/calculators/?var=x&steps=on&calcid=36&f=e%255E%2528-x%2529%252Acos%2528n%252Ax%2529
[Mon Oct 12 11:53:14.731428 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46025] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:53:20.563428 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46026] Timeout when reading response
http://www.google.co.uk/url?sa=t&rct=j&q=&esrc=s&source=web&cd=2&ved=0CCYQFjABahUKEwjjltCA7LzIAhVCvxQKHfBSCp8&url=http%3A%2F%2Fwww.emathhelp.net%2Fcalculators%2Fcalculus-2%2Fsimpsons-rule-calculator%2F&usg=AFQjCNHj3Aq2ZX5FyNMjo3ZLfkh_YTjl6Q
[Mon Oct 12 11:53:20.969433 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46031] Timeout when reading response
https://www.google.co.nz/
[Mon Oct 12 11:54:09.345978 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46041] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/
[Mon Oct 12 11:54:09.815250 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46044] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:54:14.791866 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46049] Timeout when reading response
https://www.google.co.nz/
[Mon Oct 12 11:54:20.623426 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46050] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:54:21.029911 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46113] Timeout when reading response
https://www.google.co.nz/
[Mon Oct 12 11:55:09.406413 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46119] Timeout when reading response
https://www.google.co.nz/
[Mon Oct 12 11:55:09.863209 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46133] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:55:14.852263 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46138] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:55:20.683175 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46159] Timeout when reading response
https://www.google.co.nz/
[Mon Oct 12 11:55:21.090180 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46163] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:56:09.466178 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46166] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/
[Mon Oct 12 11:56:09.923661 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46168] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:56:14.912643 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46199] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:56:20.743628 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46214] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:56:21.150586 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46215] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:57:09.526178 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46227] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:57:09.983178 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46228] Timeout when reading response
https://www.google.co.nz/
[Mon Oct 12 11:57:14.973070 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46232] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:57:20.782657 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46245] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:57:21.210175 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46250] Timeout when reading response
https://www.google.co.nz/
[Mon Oct 12 11:58:09.586684 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46282] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:58:10.043640 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46296] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:58:15.033461 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46303] Timeout when reading response
https://www.google.nl
[Mon Oct 12 11:58:20.843056 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46347] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:58:21.270190 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46357] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:09.647160 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:46358] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:10.104071 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:46360] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:15.093941 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:46362] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:20.903456 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:46366] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:21.330199 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:46367] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on
[Mon Oct 12 11:59:35.919450 2015] [wsgi:error] [pid 10210:tid
139829400610560] (11)Resource temporarily unavailable: [client
127.0.0.1:46419] mod_wsgi (pid=10210): Unable to connect to WSGI daemon
process 'django_math' on
'/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after
multiple attempts as listener backlog limit was exceeded.
[Mon Oct 12 11:59:36.345433 2015] [wsgi:error] [pid 10210:tid
139829283116800] (11)Resource temporarily unavailable: [client
127.0.0.1:46444] mod_wsgi (pid=10210): Unable to connect to WSGI daemon
process 'django_math' on
'/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after
http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%29%5E3%2F3-y%5E%281%2F2%29&var=&a=3&b=11
[Mon Oct 12 11:59:50.935597 2015] [wsgi:error] [pid 10210:tid
139829400610560] (11)Resource temporarily unavailable: [client
127.0.0.1:46489] mod_wsgi (pid=10210): Unable to connect to WSGI daemon
process 'django_math' on
'/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after
multiple attempts as listener backlog limit was exceeded.
[Mon Oct 12 11:59:51.361244 2015] [wsgi:error] [pid 10210:tid
139829283116800] (11)Resource temporarily unavailable: [client
127.0.0.1:46532] mod_wsgi (pid=10210): Unable to connect to WSGI daemon
process 'django_math' on
'/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after
multiple attempts as listener backlog limit was exceeded.
[Mon Oct 12 12:00:01.987886 2015] [core:warn] [pid 21414:tid
140401755707200] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:00:01.990053 2015] [mpm_worker:notice] [pid 21414:tid
140401755707200] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:00:01.990090 2015] [core:notice] [pid 21414:tid
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:01:01.141488 2015] [core:warn] [pid 22714:tid
139862846170944] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:01:01.148104 2015] [mpm_worker:notice] [pid 22714:tid
139862846170944] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:01:01.148136 2015] [core:notice] [pid 22714:tid
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:02:01.287286 2015] [core:warn] [pid 23392:tid
140227605587776] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:02:01.288063 2015] [mpm_worker:notice] [pid 23392:tid
140227605587776] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:02:01.288087 2015] [core:notice] [pid 23392:tid
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:03:01.464154 2015] [core:warn] [pid 24460:tid
139893862491968] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:03:01.464941 2015] [mpm_worker:notice] [pid 24460:tid
139893862491968] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:03:01.464973 2015] [core:notice] [pid 24460:tid
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:04:01.604819 2015] [core:warn] [pid 25540:tid
140530401601344] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:04:01.605673 2015] [mpm_worker:notice] [pid 25540:tid
140530401601344] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:04:01.605700 2015] [core:notice] [pid 25540:tid
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:04:13.617169 2015] [mpm_worker:error] [pid 25540:tid
140530401601344] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:05:01.702670 2015] [core:warn] [pid 26818:tid
140673843578688] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:05:01.703557 2015] [mpm_worker:notice] [pid 26818:tid
140673843578688] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:05:01.703589 2015] [core:notice] [pid 26818:tid
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:06:01.168476 2015] [core:warn] [pid 27705:tid
140135096485696] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:06:01.169291 2015] [mpm_worker:notice] [pid 27705:tid
140135096485696] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:06:01.169321 2015] [core:notice] [pid 27705:tid
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:06:04.172416 2015] [mpm_worker:error] [pid 27705:tid
140135096485696] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:07:01.315453 2015] [core:warn] [pid 28977:tid
139863950853952] AH00098: pid file
/home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Mon Oct 12 12:07:01.316160 2015] [mpm_worker:notice] [pid 28977:tid
139863950853952] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9
configured -- resuming normal operations
[Mon Oct 12 12:07:01.316183 2015] [core:notice] [pid 28977:tid
'/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f
/home/simamura/webapps/django_mat
...
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an email to modwsgi+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at http://groups.google.com/group/modwsgi.
For more options, visit https://groups.google.com/d/optout.
Graham Dumpleton
2015-10-22 11:12:56 UTC
Permalink
No you cannot change the network keep alive timeout, or not readily and it isn’t something you should ever do. It is quite possibly nothing to do with that anyway.

As to WSGIApplicationGroup then it may help as I already outlined. Any reason you haven’t tried it as it is recommended practice to use it?

What exactly are you using simpy for anyway. Looking at the documentation for it it does various stuff with sub processes. Heavy or complicated use of sub processes from inside of the context of a web application, especially under Apache/mod_wsgi, is generally a bad idea. This is because it may not play well with Apache’s process model and so something like simpy may not work properly or could even interfere with the process management of Apache or mod_wsgi.

Graham
Post by Paul Royik
Problem appeared again.
So, I will answer your questions.
I use third-party libraries sympy and sage. Didn't have any network issues.
Actually this happened when I sleep.
Exact error time is 2 hours 11 minutes (this value is always the same).
So, can I lower network keep alive timeout value?
If I set WSGIApplicationGroup %{GLOBAL}, will this help?
Thank you.
The messages indicate that all the threads in the daemon process group were blocked.
Timeout when reading response headers from daemon process
Unable to connect to WSGI daemon process
is all about.
WSGIApplicationGroup %{GLOBAL}
This forces the application to run the in the main interpreter context of the daemon process groups.
This avoids problems with third party extension modules for Python that haven’t been implemented correctly so as to be able to be used in sub interpreter contexts. These can only work in the main interpreter context.
This is often a cause of thread deadlocks.
That said, that you say it lasts 2 hours and then disappears is interesting.
This is because 2 hours is the network keep alive timeout value.
So what may be happening is request threads are contacting some backend service and due to some network/router issue, the connection is being broken. In some circumstances, depending on what software is doing with the connection, such a condition may not be detected until the 2 hour network timeout occurs.
In light of that, what backend services does your application talk to and would that traffic traverse over any switching equipment. Have you been having any network issues.
Graham
Hi Graham and everyone.
I have a site that runs heavy math calculations using external math library.
I already wrote about it nearly half a year ago. In that case there was timeout issue, but now I've fixed it.
But there is another issue.
Nearly the same time I got 503 error: Timeout when reading response headers from daemon process.
This lasts for approximately 2 hours and then 503 error disappears.
I use Django 1.8.4 with mod_wsgi 4.4.13.
What configurations should I use in httpd.conf to avoid this error.
How to queue requests?
What is the number of sumultaneous requests?
....
What I want to do is avoid 503 error, limit number of simultaneous requests and queue other requests.
[Mon Oct 12 11:47:09.445618 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45625 <http://127.0.0.1:45625/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:47:14.432179 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45632 <http://127.0.0.1:45632/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/?f=tan%28x%2F2%29+%2B+%281%2F%28x%5E2%2B4%29%29&a=0&b=2&n=8&steps=on <http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/?f=tan%28x%2F2%29+%2B+%281%2F%28x%5E2%2B4%29%29&a=0&b=2&n=8&steps=on>
[Mon Oct 12 11:47:20.201940 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45700 <http://127.0.0.1:45700/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on <http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on>
[Mon Oct 12 11:47:20.608201 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45704 <http://127.0.0.1:45704/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:08.984176 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45707 <http://127.0.0.1:45707/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/ <http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/>
[Mon Oct 12 11:48:09.505969 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45730 <http://127.0.0.1:45730/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on <http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on>
[Mon Oct 12 11:48:14.492629 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45731 <http://127.0.0.1:45731/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:20.262302 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45732 <http://127.0.0.1:45732/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on <http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on>
[Mon Oct 12 11:48:20.668421 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45737 <http://127.0.0.1:45737/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:49:09.044532 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45744 <http://127.0.0.1:45744/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:49:09.566430 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45789 <http://127.0.0.1:45789/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on>
[Mon Oct 12 11:49:14.552970 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45795 <http://127.0.0.1:45795/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:49:20.322179 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45799 <http://127.0.0.1:45799/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/ <http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/>
[Mon Oct 12 11:49:20.728784 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45803 <http://127.0.0.1:45803/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on <http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on>
[Mon Oct 12 11:50:09.104426 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45816 <http://127.0.0.1:45816/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=ln+x+&var=x&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=ln+x+&var=x&steps=on>
[Mon Oct 12 11:50:09.626783 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45819 <http://127.0.0.1:45819/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%2F2%29%2B%281%2F%282*y%5E%281%2F2%29%29%29&var=&a=3&b=9 <http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%2F2%29%2B%281%2F%282*y%5E%281%2F2%29%29%29&var=&a=3&b=9>
[Mon Oct 12 11:50:14.613330 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45820 <http://127.0.0.1:45820/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/ <http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/>
[Mon Oct 12 11:50:20.382640 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45832 <http://127.0.0.1:45832/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:50:20.789229 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45846 <http://127.0.0.1:45846/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:51:09.164863 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45848 <http://127.0.0.1:45848/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:51:09.634602 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45879 <http://127.0.0.1:45879/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw <http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw>
[Mon Oct 12 11:51:14.639873 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45914 <http://127.0.0.1:45914/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:51:20.443005 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45918 <http://127.0.0.1:45918/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.com/ <https://www.google.com/>
[Mon Oct 12 11:51:20.849576 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45920 <http://127.0.0.1:45920/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.ge/ <https://www.google.ge/>
[Mon Oct 12 11:52:09.225178 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45922 <http://127.0.0.1:45922/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:52:09.694485 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45936 <http://127.0.0.1:45936/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:52:14.671605 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45945 <http://127.0.0.1:45945/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on>
[Mon Oct 12 11:52:20.503359 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45950 <http://127.0.0.1:45950/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x3-x%2B8x-4&denom=2x-1&steps=on <http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x3-x%2B8x-4&denom=2x-1&steps=on>
[Mon Oct 12 11:52:20.909837 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45993 <http://127.0.0.1:45993/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw&cad=rja <http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw&cad=rja>
[Mon Oct 12 11:53:09.285607 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:46014 <http://127.0.0.1:46014/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:53:09.754914 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:46023 <http://127.0.0.1:46023/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/?var=x&steps=on&calcid=36&f=e%255E%2528-x%2529%252Acos%2528n%252Ax%2529 <http://www.emathhelp.net/calculators/?var=x&steps=on&calcid=36&f=e%255E%2528-x%2529%252Acos%2528n%252Ax%2529>
[Mon Oct 12 11:53:14.731428 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:46025 <http://127.0.0.1:46025/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:53:20.563428 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:46026 <http://127.0.0.1:46026/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.google.co.uk/url?sa=t&rct=j&q=&esrc=s&source=web&cd=2&ved=0CCYQFjABahUKEwjjltCA7LzIAhVCvxQKHfBSCp8&url=http%3A%2F%2Fwww.emathhelp.net%2Fcalculators%2Fcalculus-2%2Fsimpsons-rule-calculator%2F&usg=AFQjCNHj3Aq2ZX5FyNMjo3ZLfkh_YTjl6Q <http://www.google.co.uk/url?sa=t&rct=j&q=&esrc=s&source=web&cd=2&ved=0CCYQFjABahUKEwjjltCA7LzIAhVCvxQKHfBSCp8&url=http%3A%2F%2Fwww.emathhelp.net%2Fcalculators%2Fcalculus-2%2Fsimpsons-rule-calculator%2F&usg=AFQjCNHj3Aq2ZX5FyNMjo3ZLfkh_YTjl6Q>
[Mon Oct 12 11:53:20.969433 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:46031 <http://127.0.0.1:46031/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.nz/ <https://www.google.co.nz/>
[Mon Oct 12 11:54:09.345978 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:46041 <http://127.0.0.1:46041/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-1/ <http://www.emathhelp.net/calculators/algebra-1/>
[Mon Oct 12 11:54:09.815250 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:46044 <http://127.0.0.1:46044/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:54:14.791866 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:46049 <http://127.0.0.1:46049/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.nz/ <https://www.google.co.nz/>
[Mon Oct 12 11:54:20.623426 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:46050 <http://127.0.0.1:46050/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:54:21.029911 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:46113 <http://127.0.0.1:46113/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.nz/ <https://www.google.co.nz/>
[Mon Oct 12 11:55:09.406413 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:46119 <http://127.0.0.1:46119/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.nz/ <https://www.google.co.nz/>
[Mon Oct 12 11:55:09.863209 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:46133 <http://127.0.0.1:46133/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on <http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on>
[Mon Oct 12 11:55:14.852263 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:46138 <http://127.0.0.1:46138/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:55:20.683175 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:46159 <http://127.0.0.1:46159/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.nz/ <https://www.google.co.nz/>
[Mon Oct 12 11:55:21.090180 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:46163 <http://127.0.0.1:46163/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on>
[Mon Oct 12 11:56:09.466178 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:46166 <http://127.0.0.1:46166/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-1/ <http://www.emathhelp.net/calculators/algebra-1/>
[Mon Oct 12 11:56:09.923661 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:46168 <http://127.0.0.1:46168/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:56:14.912643 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:46199 <http://127.0.0.1:46199/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:56:20.743628 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:46214 <http://127.0.0.1:46214/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:56:21.150586 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:46215 <http://127.0.0.1:46215/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/ <http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/>
[Mon Oct 12 11:57:09.526178 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:46227 <http://127.0.0.1:46227/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on>
[Mon Oct 12 11:57:09.983178 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:46228 <http://127.0.0.1:46228/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.nz/ <https://www.google.co.nz/>
[Mon Oct 12 11:57:14.973070 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:46232 <http://127.0.0.1:46232/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on>
[Mon Oct 12 11:57:20.782657 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:46245 <http://127.0.0.1:46245/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on>
[Mon Oct 12 11:57:21.210175 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:46250 <http://127.0.0.1:46250/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.nz/ <https://www.google.co.nz/>
[Mon Oct 12 11:58:09.586684 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:46282 <http://127.0.0.1:46282/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:58:10.043640 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:46296 <http://127.0.0.1:46296/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:58:15.033461 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:46303 <http://127.0.0.1:46303/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.nl <https://www.google.nl/>
[Mon Oct 12 11:58:20.843056 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:46347 <http://127.0.0.1:46347/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5E%28x%5E%281%2F2%29%29%2Fx%5E%281%2F2%29&var=&steps=on>
[Mon Oct 12 11:58:21.270190 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:46357 <http://127.0.0.1:46357/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on>
[Mon Oct 12 11:59:09.647160 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:46358 <http://127.0.0.1:46358/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on>
[Mon Oct 12 11:59:10.104071 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:46360 <http://127.0.0.1:46360/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on>
[Mon Oct 12 11:59:15.093941 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:46362 <http://127.0.0.1:46362/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on>
[Mon Oct 12 11:59:20.903456 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:46366 <http://127.0.0.1:46366/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on>
[Mon Oct 12 11:59:21.330199 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:46367 <http://127.0.0.1:46367/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=%28e%5Ex%5E%281%2F2%29%29%2F%5E%281%2F2%29&var=&steps=on>
[Mon Oct 12 11:59:35.919450 2015] [wsgi:error] [pid 10210:tid 139829400610560] (11)Resource temporarily unavailable: [client 127.0.0.1:46419 <http://127.0.0.1:46419/>] mod_wsgi (pid=10210): Unable to connect to WSGI daemon process 'django_math' on '/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after multiple attempts as listener backlog limit was exceeded.
[Mon Oct 12 11:59:36.345433 2015] [wsgi:error] [pid 10210:tid 139829283116800] (11)Resource temporarily unavailable: [client 127.0.0.1:46444 <http://127.0.0.1:46444/>] mod_wsgi (pid=10210): Unable to connect to WSGI daemon process 'django_math' on '/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after multiple attempts as listener backlog limit was exceeded., referer: http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%29%5E3%2F3-y%5E%281%2F2%29&var=&a=3&b=11 <http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%29%5E3%2F3-y%5E%281%2F2%29&var=&a=3&b=11>
[Mon Oct 12 11:59:50.935597 2015] [wsgi:error] [pid 10210:tid 139829400610560] (11)Resource temporarily unavailable: [client 127.0.0.1:46489 <http://127.0.0.1:46489/>] mod_wsgi (pid=10210): Unable to connect to WSGI daemon process 'django_math' on '/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after multiple attempts as listener backlog limit was exceeded.
[Mon Oct 12 11:59:51.361244 2015] [wsgi:error] [pid 10210:tid 139829283116800] (11)Resource temporarily unavailable: [client 127.0.0.1:46532 <http://127.0.0.1:46532/>] mod_wsgi (pid=10210): Unable to connect to WSGI daemon process 'django_math' on '/home/simamura/webapps/django_math/apache2/logs/wsgi.10205.0.1.sock' after multiple attempts as listener backlog limit was exceeded.
[Mon Oct 12 12:00:01.987886 2015] [core:warn] [pid 21414:tid 140401755707200] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:00:01.990053 2015] [mpm_worker:notice] [pid 21414:tid 140401755707200] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:00:01.990090 2015] [core:notice] [pid 21414:tid 140401755707200] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:01:01.141488 2015] [core:warn] [pid 22714:tid 139862846170944] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:01:01.148104 2015] [mpm_worker:notice] [pid 22714:tid 139862846170944] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:01:01.148136 2015] [core:notice] [pid 22714:tid 139862846170944] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:02:01.287286 2015] [core:warn] [pid 23392:tid 140227605587776] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:02:01.288063 2015] [mpm_worker:notice] [pid 23392:tid 140227605587776] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:02:01.288087 2015] [core:notice] [pid 23392:tid 140227605587776] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:03:01.464154 2015] [core:warn] [pid 24460:tid 139893862491968] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:03:01.464941 2015] [mpm_worker:notice] [pid 24460:tid 139893862491968] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:03:01.464973 2015] [core:notice] [pid 24460:tid 139893862491968] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:04:01.604819 2015] [core:warn] [pid 25540:tid 140530401601344] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:04:01.605673 2015] [mpm_worker:notice] [pid 25540:tid 140530401601344] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:04:01.605700 2015] [core:notice] [pid 25540:tid 140530401601344] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:04:13.617169 2015] [mpm_worker:error] [pid 25540:tid 140530401601344] AH00286: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:05:01.702670 2015] [core:warn] [pid 26818:tid 140673843578688] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:05:01.703557 2015] [mpm_worker:notice] [pid 26818:tid 140673843578688] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:05:01.703589 2015] [core:notice] [pid 26818:tid 140673843578688] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:06:01.168476 2015] [core:warn] [pid 27705:tid 140135096485696] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:06:01.169291 2015] [mpm_worker:notice] [pid 27705:tid 140135096485696] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:06:01.169321 2015] [core:notice] [pid 27705:tid 140135096485696] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_math/apache2/conf/httpd.conf'
[Mon Oct 12 12:06:04.172416 2015] [mpm_worker:error] [pid 27705:tid 140135096485696] AH00286: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting
[Mon Oct 12 12:07:01.315453 2015] [core:warn] [pid 28977:tid 139863950853952] AH00098: pid file /home/simamura/webapps/django_math/apache2/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Mon Oct 12 12:07:01.316160 2015] [mpm_worker:notice] [pid 28977:tid 139863950853952] AH00292: Apache/2.4.16 (Unix) mod_wsgi/4.4.13 Python/2.7.9 configured -- resuming normal operations
[Mon Oct 12 12:07:01.316183 2015] [core:notice] [pid 28977:tid 139863950853952] AH00094: Command line: '/home/simamura/webapps/django_math/apache2/bin/httpd.worker -f /home/simamura/webapps/django_mat
...
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
Visit this group at http://groups.google.com/group/modwsgi <http://groups.google.com/group/modwsgi>.
For more options, visit https://groups.google.com/d/optout <https://groups.google.com/d/optout>.
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an email to modwsgi+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at http://groups.google.com/group/modwsgi.
For more options, visit https://groups.google.com/d/optout.
Paul Royik
2015-10-22 17:24:52 UTC
Permalink
I set WSGIApplicationGroup, but it doesn't help.

I used sympy all year, but problems begin only now. Maybe when I upgraded
to Apache 2.4

Anyway, in log file I got
[Thu Oct 22 17:08:55.697080 2015] [mpm_worker:error] [pid 658868:tid
140669018494784] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Thu Oct 22 17:09:26.399723 2015] [wsgi:error] [pid 667167:tid
140668926658304] [client 127.0.0.1:58424] Timeout when reading response
headers from daemon process 'django_math':
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer:
http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%282x%5E4%29%2F%28x%5E4-1%29&var=&a=2&b=3&steps=on

Will it help if I raise MaxRequestWorkers? What is the readonable number?
Post by Graham Dumpleton
No you cannot change the network keep alive timeout, or not readily and it
isn’t something you should ever do. It is quite possibly nothing to do with
that anyway.
As to WSGIApplicationGroup then it may help as I already outlined. Any
reason you haven’t tried it as it is recommended practice to use it?
What exactly are you using simpy for anyway. Looking at the documentation
for it it does various stuff with sub processes. Heavy or complicated use
of sub processes from inside of the context of a web application,
especially under Apache/mod_wsgi, is generally a bad idea. This is because
it may not play well with Apache’s process model and so something like
simpy may not work properly or could even interfere with the process
management of Apache or mod_wsgi.
Graham
Problem appeared again.
So, I will answer your questions.
I use third-party libraries sympy and sage. Didn't have any network issues.
Actually this happened when I sleep.
Exact error time is 2 hours 11 minutes (this value is always the same).
So, can I lower network keep alive timeout value?
If I set WSGIApplicationGroup %{GLOBAL}, will this help?
Thank you.
The messages indicate that all the threads in the daemon process group were blocked.
Initially new requests will still get added to the socket listener queue
for the daemon processes, which has a capacity for 100 queued requests by
default. Because though the daemon process wasn’t actually accepted them
and removing them from the queue, on the Apache child worker side where
Timeout when reading response headers from daemon process
When that 100 queue depth was eventually exceeded, no more requests could
be queued up. This then resulted in attempts to connect to the daemon
Unable to connect to WSGI daemon process
is all about.
WSGIApplicationGroup %{GLOBAL}
This forces the application to run the in the main interpreter context of
the daemon process groups.
This avoids problems with third party extension modules for Python that
haven’t been implemented correctly so as to be able to be used in sub
interpreter contexts. These can only work in the main interpreter context.
This is often a cause of thread deadlocks.
That said, that you say it lasts 2 hours and then disappears is interesting.
This is because 2 hours is the network keep alive timeout value.
So what may be happening is request threads are contacting some backend
service and due to some network/router issue, the connection is being
broken. In some circumstances, depending on what software is doing with the
connection, such a condition may not be detected until the 2 hour network
timeout occurs.
In light of that, what backend services does your application talk to and
would that traffic traverse over any switching equipment. Have you been
having any network issues.
Graham
Hi Graham and everyone.
I have a site that runs heavy math calculations using external math library.
I already wrote about it nearly half a year ago. In that case there was
timeout issue, but now I've fixed it.
But there is another issue.
Nearly the same time I got 503 error: Timeout when reading response
headers from daemon process.
This lasts for approximately 2 hours and then 503 error disappears.
I use Django 1.8.4 with mod_wsgi 4.4.13.
What configurations should I use in httpd.conf to avoid this error.
How to queue requests?
What is the number of sumultaneous requests?
....
What I want to do is avoid 503 error, limit number of simultaneous
requests and queue other requests.
[Mon Oct 12 11:47:09.445618 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45625] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:47:14.432179 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45632] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/?f=tan%28x%2F2%29+%2B+%281%2F%28x%5E2%2B4%29%29&a=0&b=2&n=8&steps=on
[Mon Oct 12 11:47:20.201940 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45700] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:47:20.608201 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45704] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:08.984176 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45707] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:48:09.505969 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45730] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:14.492629 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45731] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:20.262302 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45732] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:20.668421 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45737] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:09.044532 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45744] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:09.566430 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45789] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:49:14.552970 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45795] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:20.322179 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45799] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:49:20.728784 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45803] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:50:09.104426 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45816] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=ln+x+&var=x&steps=on
[Mon Oct 12 11:50:09.626783 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45819] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%2F2%29%2B%281%2F%282*y%5E%281%2F2%29%29%29&var=&a=3&b=9
[Mon Oct 12 11:50:14.613330 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45820] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/
[Mon Oct 12 11:50:20.382640 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45832] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:50:20.789229 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45846] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:09.164863 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45848] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:09.634602 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45879] Timeout when reading response
http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw
[Mon Oct 12 11:51:14.639873 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45914] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:20.443005 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45918] Timeout when reading response
https://www.google.com/
[Mon Oct 12 11:51:20.849576 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45920] Timeout when reading response
https://www.google.ge/
[Mon Oct 12 11:52:09.225178 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45922] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:52:09.694485 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45936] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:52:14.671605 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45945] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:52:20.503359 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45950] Timeout when reading response
headers from daemon process 'django_m
...
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an email to modwsgi+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at http://groups.google.com/group/modwsgi.
For more options, visit https://groups.google.com/d/optout.
Graham Dumpleton
2015-10-22 22:25:00 UTC
Permalink
No MaxRequestWorkers will not necessarily help. It doesn’t control how many processes/threads are available in the daemon processes used by mod_wsgi. Even changing the processes/threads for the daemon processes is only masking or delaying the occurrence of the issue. You need to work out the underlying cause.

I would suggest integrating the example code found in:

https://code.google.com/p/modwsgi/wiki/DebuggingTechniques#Extracting_Python_Stack_Traces <https://code.google.com/p/modwsgi/wiki/DebuggingTechniques#Extracting_Python_Stack_Traces>

This will give you a way of being able to get Python stack traces out of the application as to what it is doing when it appears to get stuck.

If you have a new enough mod_wsgi version, you can also try setting on WSGIDaemonProcess the option:

request-timeout=60

This will set a timeout on how long requests are allowed to run. If exceeded then the process will be forcibly restarted.

This will recover from processes which are locked up and then cause who Apache to run out of capacity.

Note that 60 means 60 seconds for a single request in case of single thread daemon process.

Things get more complicated for multiple process and the time value relates to average consumed time across all active requests. So technically a single request can run longer than the timeout.

As part of the process of restarting the process, mod_wsgi will attempt to dump Python stack traces as to where the code may have been running at that time, and so can work similar to the manual method mentioned in that link.

If you play with this option, set the timeout to be twice what your longest request would take. Although, if you have very long running requests, what to set it to may be a problem in itself.

Graham
Post by Paul Royik
I set WSGIApplicationGroup, but it doesn't help.
I used sympy all year, but problems begin only now. Maybe when I upgraded to Apache 2.4
Anyway, in log file I got
[Thu Oct 22 17:08:55.697080 2015] [mpm_worker:error] [pid 658868:tid 140669018494784] AH00286: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting
[Thu Oct 22 17:09:26.399723 2015] [wsgi:error] [pid 667167:tid 140668926658304] [client 127.0.0.1:58424] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%282x%5E4%29%2F%28x%5E4-1%29&var=&a=2&b=3&steps=on
Will it help if I raise MaxRequestWorkers? What is the readonable number?
No you cannot change the network keep alive timeout, or not readily and it isn’t something you should ever do. It is quite possibly nothing to do with that anyway.
As to WSGIApplicationGroup then it may help as I already outlined. Any reason you haven’t tried it as it is recommended practice to use it?
What exactly are you using simpy for anyway. Looking at the documentation for it it does various stuff with sub processes. Heavy or complicated use of sub processes from inside of the context of a web application, especially under Apache/mod_wsgi, is generally a bad idea. This is because it may not play well with Apache’s process model and so something like simpy may not work properly or could even interfere with the process management of Apache or mod_wsgi.
Graham
Problem appeared again.
So, I will answer your questions.
I use third-party libraries sympy and sage. Didn't have any network issues.
Actually this happened when I sleep.
Exact error time is 2 hours 11 minutes (this value is always the same).
So, can I lower network keep alive timeout value?
If I set WSGIApplicationGroup %{GLOBAL}, will this help?
Thank you.
The messages indicate that all the threads in the daemon process group were blocked.
Timeout when reading response headers from daemon process
Unable to connect to WSGI daemon process
is all about.
WSGIApplicationGroup %{GLOBAL}
This forces the application to run the in the main interpreter context of the daemon process groups.
This avoids problems with third party extension modules for Python that haven’t been implemented correctly so as to be able to be used in sub interpreter contexts. These can only work in the main interpreter context.
This is often a cause of thread deadlocks.
That said, that you say it lasts 2 hours and then disappears is interesting.
This is because 2 hours is the network keep alive timeout value.
So what may be happening is request threads are contacting some backend service and due to some network/router issue, the connection is being broken. In some circumstances, depending on what software is doing with the connection, such a condition may not be detected until the 2 hour network timeout occurs.
In light of that, what backend services does your application talk to and would that traffic traverse over any switching equipment. Have you been having any network issues.
Graham
Hi Graham and everyone.
I have a site that runs heavy math calculations using external math library.
I already wrote about it nearly half a year ago. In that case there was timeout issue, but now I've fixed it.
But there is another issue.
Nearly the same time I got 503 error: Timeout when reading response headers from daemon process.
This lasts for approximately 2 hours and then 503 error disappears.
I use Django 1.8.4 with mod_wsgi 4.4.13.
What configurations should I use in httpd.conf to avoid this error.
How to queue requests?
What is the number of sumultaneous requests?
....
What I want to do is avoid 503 error, limit number of simultaneous requests and queue other requests.
[Mon Oct 12 11:47:09.445618 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45625 <http://127.0.0.1:45625/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:47:14.432179 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45632 <http://127.0.0.1:45632/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/?f=tan%28x%2F2%29+%2B+%281%2F%28x%5E2%2B4%29%29&a=0&b=2&n=8&steps=on <http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/?f=tan%28x%2F2%29+%2B+%281%2F%28x%5E2%2B4%29%29&a=0&b=2&n=8&steps=on>
[Mon Oct 12 11:47:20.201940 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45700 <http://127.0.0.1:45700/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on <http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on>
[Mon Oct 12 11:47:20.608201 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45704 <http://127.0.0.1:45704/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:08.984176 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45707 <http://127.0.0.1:45707/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/ <http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/>
[Mon Oct 12 11:48:09.505969 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45730 <http://127.0.0.1:45730/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on <http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on>
[Mon Oct 12 11:48:14.492629 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45731 <http://127.0.0.1:45731/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:20.262302 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45732 <http://127.0.0.1:45732/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on <http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on>
[Mon Oct 12 11:48:20.668421 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45737 <http://127.0.0.1:45737/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:49:09.044532 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45744 <http://127.0.0.1:45744/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:49:09.566430 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45789 <http://127.0.0.1:45789/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on>
[Mon Oct 12 11:49:14.552970 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45795 <http://127.0.0.1:45795/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:49:20.322179 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45799 <http://127.0.0.1:45799/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/ <http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/>
[Mon Oct 12 11:49:20.728784 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45803 <http://127.0.0.1:45803/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on <http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on>
[Mon Oct 12 11:50:09.104426 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45816 <http://127.0.0.1:45816/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=ln+x+&var=x&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=ln+x+&var=x&steps=on>
[Mon Oct 12 11:50:09.626783 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45819 <http://127.0.0.1:45819/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%2F2%29%2B%281%2F%282*y%5E%281%2F2%29%29%29&var=&a=3&b=9 <http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%2F2%29%2B%281%2F%282*y%5E%281%2F2%29%29%29&var=&a=3&b=9>
[Mon Oct 12 11:50:14.613330 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45820 <http://127.0.0.1:45820/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/ <http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/>
[Mon Oct 12 11:50:20.382640 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45832 <http://127.0.0.1:45832/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:50:20.789229 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45846 <http://127.0.0.1:45846/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:51:09.164863 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45848 <http://127.0.0.1:45848/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:51:09.634602 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45879 <http://127.0.0.1:45879/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw <http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw>
[Mon Oct 12 11:51:14.639873 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45914 <http://127.0.0.1:45914/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:51:20.443005 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45918 <http://127.0.0.1:45918/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.com/ <https://www.google.com/>
[Mon Oct 12 11:51:20.849576 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45920 <http://127.0.0.1:45920/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.ge/ <https://www.google.ge/>
[Mon Oct 12 11:52:09.225178 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45922 <http://127.0.0.1:45922/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:52:09.694485 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45936 <http://127.0.0.1:45936/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:52:14.671605 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45945 <http://127.0.0.1:45945/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on>
[Mon Oct 12 11:52:20.503359 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45950 <http://127.0.0.1:45950/>] Timeout when reading response headers from daemon process 'django_m
...
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
Visit this group at http://groups.google.com/group/modwsgi <http://groups.google.com/group/modwsgi>.
For more options, visit https://groups.google.com/d/optout <https://groups.google.com/d/optout>.
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an email to modwsgi+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at http://groups.google.com/group/modwsgi.
For more options, visit https://groups.google.com/d/optout.
Paul Royik
2015-10-23 09:27:15 UTC
Permalink
The most long running request is 12 seconds.
I tried to set request-timeout, but it didn't help.
Post by Graham Dumpleton
No MaxRequestWorkers will not necessarily help. It doesn’t control how
many processes/threads are available in the daemon processes used by
mod_wsgi. Even changing the processes/threads for the daemon processes is
only masking or delaying the occurrence of the issue. You need to work out
the underlying cause.
https://code.google.com/p/modwsgi/wiki/DebuggingTechniques#Extracting_Python_Stack_Traces
This will give you a way of being able to get Python stack traces out of
the application as to what it is doing when it appears to get stuck.
If you have a new enough mod_wsgi version, you can also try setting on
request-timeout=60
This will set a timeout on how long requests are allowed to run. If
exceeded then the process will be forcibly restarted.
This will recover from processes which are locked up and then cause who
Apache to run out of capacity.
Note that 60 means 60 seconds for a single request in case of single thread daemon process.
Things get more complicated for multiple process and the time value
relates to average consumed time across all active requests. So technically
a single request can run longer than the timeout.
As part of the process of restarting the process, mod_wsgi will attempt to
dump Python stack traces as to where the code may have been running at that
time, and so can work similar to the manual method mentioned in that link.
If you play with this option, set the timeout to be twice what your
longest request would take. Although, if you have very long running
requests, what to set it to may be a problem in itself.
Graham
I set WSGIApplicationGroup, but it doesn't help.
I used sympy all year, but problems begin only now. Maybe when I upgraded to Apache 2.4
Anyway, in log file I got
[Thu Oct 22 17:08:55.697080 2015] [mpm_worker:error] [pid 658868:tid
140669018494784] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Thu Oct 22 17:09:26.399723 2015] [wsgi:error] [pid 667167:tid
140668926658304] [client 127.0.0.1:58424] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%282x%5E4%29%2F%28x%5E4-1%29&var=&a=2&b=3&steps=on
Will it help if I raise MaxRequestWorkers? What is the readonable number?
No you cannot change the network keep alive timeout, or not readily and it
isn’t something you should ever do. It is quite possibly nothing to do with
that anyway.
As to WSGIApplicationGroup then it may help as I already outlined. Any
reason you haven’t tried it as it is recommended practice to use it?
What exactly are you using simpy for anyway. Looking at the documentation
for it it does various stuff with sub processes. Heavy or complicated use
of sub processes from inside of the context of a web application,
especially under Apache/mod_wsgi, is generally a bad idea. This is because
it may not play well with Apache’s process model and so something like
simpy may not work properly or could even interfere with the process
management of Apache or mod_wsgi.
Graham
Problem appeared again.
So, I will answer your questions.
I use third-party libraries sympy and sage. Didn't have any network issues.
Actually this happened when I sleep.
Exact error time is 2 hours 11 minutes (this value is always the same).
So, can I lower network keep alive timeout value?
If I set WSGIApplicationGroup %{GLOBAL}, will this help?
Thank you.
The messages indicate that all the threads in the daemon process group were blocked.
Initially new requests will still get added to the socket listener queue
for the daemon processes, which has a capacity for 100 queued requests by
default. Because though the daemon process wasn’t actually accepted them
and removing them from the queue, on the Apache child worker side where
Timeout when reading response headers from daemon process
When that 100 queue depth was eventually exceeded, no more requests could
be queued up. This then resulted in attempts to connect to the daemon
Unable to connect to WSGI daemon process
is all about.
WSGIApplicationGroup %{GLOBAL}
This forces the application to run the in the main interpreter context of
the daemon process groups.
This avoids problems with third party extension modules for Python that
haven’t been implemented correctly so as to be able to be used in sub
interpreter contexts. These can only work in the main interpreter context.
This is often a cause of thread deadlocks.
That said, that you say it lasts 2 hours and then disappears is interesting.
This is because 2 hours is the network keep alive timeout value.
So what may be happening is request threads are contacting some backend
service and due to some network/router issue, the connection is being
broken. In some circumstances, depending on what software is doing with the
connection, such a condition may not be detected until the 2 hour network
timeout occurs.
In light of that, what backend services does your application talk to and
would that traffic traverse over any switching equipment. Have you been
having any network issues.
Graham
Hi Graham and everyone.
I have a site that runs heavy math calculations using external math library.
I already wrote about it nearly half a year ago. In that case there was
timeout issue, but now I've fixed it.
But there is another issue.
Nearly the same time I got 503 error: Timeout when reading response
headers from daemon process.
This lasts for approximately 2 hours and then 503 error disappears.
I use Django 1.8.4 with mod_wsgi 4.4.13.
What configurations should I use in httpd.conf to avoid this error.
How to queue requests?
What is the number of sumultaneous requests?
....
What I want to do is avoid 503 error, limit number of simultaneous
requests and queue other requests.
[Mon Oct 12 11:47:09.445618 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45625] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:47:14.432179 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45632] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/?f=tan%28x%2F2%29+%2B+%281%2F%28x%5E2%2B4%29%29&a=0&b=2&n=8&steps=on
[Mon Oct 12 11:47:20.201940 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45700] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:47:20.608201 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45704] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:08.984176 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45707] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:48:09.505969 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45730] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:14.492629 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45731] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:20.262302 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45732] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:20.668421 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45737] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:09.044532 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45744] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:09.566430 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45789] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:49:14.552970 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45795] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:20.322179 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45799] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:49:20.728784 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45803] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:50:09.104426 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45816] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=ln+x+&var=x&steps=on
[Mon Oct 12 11:50:09.626783 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45819] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%2F2%29%2B%281%2F%282*y%5E%281%2F2%29%29%29&var=&a=3&b=9
[Mon Oct 12 11:50:14.613330 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45820] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/
[Mon Oct 12 11:50:20.382640 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45832] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:50:20.789229 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45846] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:09.164863 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45848] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:09.634602 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45879] Timeout when reading response
http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw
[Mon Oct 12 11:51:14.639873 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45914] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:20.443005 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45918] Timeout when reading response
https://www.google.com/
[Mon Oct 12 11:51:20.849576 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client
...
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an email to modwsgi+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at http://groups.google.com/group/modwsgi.
For more options, visit https://groups.google.com/d/optout.
Graham Dumpleton
2015-10-26 01:13:49 UTC
Permalink
Can you show me what your mod_wsgi configuration in Apache configuration file actually is? Ensure that the WSGIDaemonProcess directive is included.

Ensure that the LogLevel directive in Apache is set to ‘info’ and not ‘warn’ and provide the actual log messages from the Apache error log from when it occurs, including a dozen lines messages before and after so can see context. Prior and followup messages can contain important information which you might not think is helpful.

Graham
Post by Paul Royik
The most long running request is 12 seconds.
I tried to set request-timeout, but it didn't help.
No MaxRequestWorkers will not necessarily help. It doesn’t control how many processes/threads are available in the daemon processes used by mod_wsgi. Even changing the processes/threads for the daemon processes is only masking or delaying the occurrence of the issue. You need to work out the underlying cause.
https://code.google.com/p/modwsgi/wiki/DebuggingTechniques#Extracting_Python_Stack_Traces <https://code.google.com/p/modwsgi/wiki/DebuggingTechniques#Extracting_Python_Stack_Traces>
This will give you a way of being able to get Python stack traces out of the application as to what it is doing when it appears to get stuck.
request-timeout=60
This will set a timeout on how long requests are allowed to run. If exceeded then the process will be forcibly restarted.
This will recover from processes which are locked up and then cause who Apache to run out of capacity.
Note that 60 means 60 seconds for a single request in case of single thread daemon process.
Things get more complicated for multiple process and the time value relates to average consumed time across all active requests. So technically a single request can run longer than the timeout.
As part of the process of restarting the process, mod_wsgi will attempt to dump Python stack traces as to where the code may have been running at that time, and so can work similar to the manual method mentioned in that link.
If you play with this option, set the timeout to be twice what your longest request would take. Although, if you have very long running requests, what to set it to may be a problem in itself.
Graham
I set WSGIApplicationGroup, but it doesn't help.
I used sympy all year, but problems begin only now. Maybe when I upgraded to Apache 2.4
Anyway, in log file I got
[Thu Oct 22 17:08:55.697080 2015] [mpm_worker:error] [pid 658868:tid 140669018494784] AH00286: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting
[Thu Oct 22 17:09:26.399723 2015] [wsgi:error] [pid 667167:tid 140668926658304] [client 127.0.0.1:58424 <http://127.0.0.1:58424/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%282x%5E4%29%2F%28x%5E4-1%29&var=&a=2&b=3&steps=on <http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%282x%5E4%29%2F%28x%5E4-1%29&var=&a=2&b=3&steps=on>
Will it help if I raise MaxRequestWorkers? What is the readonable number?
No you cannot change the network keep alive timeout, or not readily and it isn’t something you should ever do. It is quite possibly nothing to do with that anyway.
As to WSGIApplicationGroup then it may help as I already outlined. Any reason you haven’t tried it as it is recommended practice to use it?
What exactly are you using simpy for anyway. Looking at the documentation for it it does various stuff with sub processes. Heavy or complicated use of sub processes from inside of the context of a web application, especially under Apache/mod_wsgi, is generally a bad idea. This is because it may not play well with Apache’s process model and so something like simpy may not work properly or could even interfere with the process management of Apache or mod_wsgi.
Graham
Problem appeared again.
So, I will answer your questions.
I use third-party libraries sympy and sage. Didn't have any network issues.
Actually this happened when I sleep.
Exact error time is 2 hours 11 minutes (this value is always the same).
So, can I lower network keep alive timeout value?
If I set WSGIApplicationGroup %{GLOBAL}, will this help?
Thank you.
The messages indicate that all the threads in the daemon process group were blocked.
Timeout when reading response headers from daemon process
Unable to connect to WSGI daemon process
is all about.
WSGIApplicationGroup %{GLOBAL}
This forces the application to run the in the main interpreter context of the daemon process groups.
This avoids problems with third party extension modules for Python that haven’t been implemented correctly so as to be able to be used in sub interpreter contexts. These can only work in the main interpreter context.
This is often a cause of thread deadlocks.
That said, that you say it lasts 2 hours and then disappears is interesting.
This is because 2 hours is the network keep alive timeout value.
So what may be happening is request threads are contacting some backend service and due to some network/router issue, the connection is being broken. In some circumstances, depending on what software is doing with the connection, such a condition may not be detected until the 2 hour network timeout occurs.
In light of that, what backend services does your application talk to and would that traffic traverse over any switching equipment. Have you been having any network issues.
Graham
Hi Graham and everyone.
I have a site that runs heavy math calculations using external math library.
I already wrote about it nearly half a year ago. In that case there was timeout issue, but now I've fixed it.
But there is another issue.
Nearly the same time I got 503 error: Timeout when reading response headers from daemon process.
This lasts for approximately 2 hours and then 503 error disappears.
I use Django 1.8.4 with mod_wsgi 4.4.13.
What configurations should I use in httpd.conf to avoid this error.
How to queue requests?
What is the number of sumultaneous requests?
....
What I want to do is avoid 503 error, limit number of simultaneous requests and queue other requests.
[Mon Oct 12 11:47:09.445618 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45625 <http://127.0.0.1:45625/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:47:14.432179 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45632 <http://127.0.0.1:45632/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/?f=tan%28x%2F2%29+%2B+%281%2F%28x%5E2%2B4%29%29&a=0&b=2&n=8&steps=on <http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/?f=tan%28x%2F2%29+%2B+%281%2F%28x%5E2%2B4%29%29&a=0&b=2&n=8&steps=on>
[Mon Oct 12 11:47:20.201940 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45700 <http://127.0.0.1:45700/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on <http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on>
[Mon Oct 12 11:47:20.608201 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45704 <http://127.0.0.1:45704/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:08.984176 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45707 <http://127.0.0.1:45707/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/ <http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/>
[Mon Oct 12 11:48:09.505969 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45730 <http://127.0.0.1:45730/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on <http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on>
[Mon Oct 12 11:48:14.492629 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45731 <http://127.0.0.1:45731/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:20.262302 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45732 <http://127.0.0.1:45732/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on <http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on>
[Mon Oct 12 11:48:20.668421 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45737 <http://127.0.0.1:45737/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:49:09.044532 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45744 <http://127.0.0.1:45744/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:49:09.566430 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45789 <http://127.0.0.1:45789/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on>
[Mon Oct 12 11:49:14.552970 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45795 <http://127.0.0.1:45795/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:49:20.322179 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45799 <http://127.0.0.1:45799/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/ <http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/>
[Mon Oct 12 11:49:20.728784 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45803 <http://127.0.0.1:45803/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on <http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on>
[Mon Oct 12 11:50:09.104426 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45816 <http://127.0.0.1:45816/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=ln+x+&var=x&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=ln+x+&var=x&steps=on>
[Mon Oct 12 11:50:09.626783 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45819 <http://127.0.0.1:45819/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%2F2%29%2B%281%2F%282*y%5E%281%2F2%29%29%29&var=&a=3&b=9 <http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%2F2%29%2B%281%2F%282*y%5E%281%2F2%29%29%29&var=&a=3&b=9>
[Mon Oct 12 11:50:14.613330 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45820 <http://127.0.0.1:45820/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/ <http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/>
[Mon Oct 12 11:50:20.382640 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45832 <http://127.0.0.1:45832/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:50:20.789229 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45846 <http://127.0.0.1:45846/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:51:09.164863 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45848 <http://127.0.0.1:45848/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:51:09.634602 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45879 <http://127.0.0.1:45879/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw <http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw>
[Mon Oct 12 11:51:14.639873 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45914 <http://127.0.0.1:45914/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:51:20.443005 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45918 <http://127.0.0.1:45918/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.com/ <https://www.google.com/>
[Mon Oct 12 11:51:20.849576 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client
...
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
Visit this group at http://groups.google.com/group/modwsgi <http://groups.google.com/group/modwsgi>.
For more options, visit https://groups.google.com/d/optout <https://groups.google.com/d/optout>.
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an email to modwsgi+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at http://groups.google.com/group/modwsgi.
For more options, visit https://groups.google.com/d/optout.
Paul Royik
2015-10-26 10:42:19 UTC
Permalink
ServerRoot "/home/simamura/webapps/django_math/apache2"

LoadModule alias_module modules/mod_alias.so
LoadModule authz_core_module modules/mod_authz_core.so
LoadModule dir_module modules/mod_dir.so
LoadModule env_module modules/mod_env.so
LoadModule log_config_module modules/mod_log_config.so
LoadModule mime_module modules/mod_mime.so
LoadModule rewrite_module modules/mod_rewrite.so
LoadModule setenvif_module modules/mod_setenvif.so
LoadModule wsgi_module modules/mod_wsgi.so
LoadModule unixd_module modules/mod_unixd.so

LogFormat "%{X-Forwarded-For}i %l %u %t \"%r\" %>s %b \"%{Referer}i\"
\"%{User-Agent}i\"" combined
CustomLog /home/simamura/logs/user/access_django_math.log combined
ErrorLog /home/simamura/logs/user/error_django_math.log

Listen 30821
KeepAlive Off
SetEnvIf X-Forwarded-SSL on HTTPS=1
ServerLimit 5
StartServers 1
MaxRequestWorkers 60
MinSpareThreads 1
MaxSpareThreads 3
ThreadsPerChild 12

WSGIApplicationGroup %{GLOBAL}
WSGIDaemonProcess django_math processes=5 threads=12
python-path=/home/simamura/webapps/django_math:/home/simamura/webapps/django_math/mathsite:/home/simamura/webapps/django_math/lib/python2.7
WSGIProcessGroup django_math
WSGIRestrictEmbedded On
WSGILazyInitialization On
WSGIScriptAlias /
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py

I changed a bit threadlimit as webfaction advised.
What should I do next?
Post by Graham Dumpleton
Can you show me what your mod_wsgi configuration in Apache configuration
file actually is? Ensure that the WSGIDaemonProcess directive is included.
Ensure that the LogLevel directive in Apache is set to ‘info’ and not
‘warn’ and provide the actual log messages from the Apache error log from
when it occurs, including a dozen lines messages before and after so can
see context. Prior and followup messages can contain important information
which you might not think is helpful.
Graham
The most long running request is 12 seconds.
I tried to set request-timeout, but it didn't help.
Post by Graham Dumpleton
No MaxRequestWorkers will not necessarily help. It doesn’t control how
many processes/threads are available in the daemon processes used by
mod_wsgi. Even changing the processes/threads for the daemon processes is
only masking or delaying the occurrence of the issue. You need to work out
the underlying cause.
https://code.google.com/p/modwsgi/wiki/DebuggingTechniques#Extracting_Python_Stack_Traces
This will give you a way of being able to get Python stack traces out of
the application as to what it is doing when it appears to get stuck.
If you have a new enough mod_wsgi version, you can also try setting on
request-timeout=60
This will set a timeout on how long requests are allowed to run. If
exceeded then the process will be forcibly restarted.
This will recover from processes which are locked up and then cause who
Apache to run out of capacity.
Note that 60 means 60 seconds for a single request in case of single
thread daemon process.
Things get more complicated for multiple process and the time value
relates to average consumed time across all active requests. So technically
a single request can run longer than the timeout.
As part of the process of restarting the process, mod_wsgi will attempt
to dump Python stack traces as to where the code may have been running at
that time, and so can work similar to the manual method mentioned in that
link.
If you play with this option, set the timeout to be twice what your
longest request would take. Although, if you have very long running
requests, what to set it to may be a problem in itself.
Graham
I set WSGIApplicationGroup, but it doesn't help.
I used sympy all year, but problems begin only now. Maybe when I upgraded to Apache 2.4
Anyway, in log file I got
[Thu Oct 22 17:08:55.697080 2015] [mpm_worker:error] [pid 658868:tid
140669018494784] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Thu Oct 22 17:09:26.399723 2015] [wsgi:error] [pid 667167:tid
140668926658304] [client 127.0.0.1:58424] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%282x%5E4%29%2F%28x%5E4-1%29&var=&a=2&b=3&steps=on
Will it help if I raise MaxRequestWorkers? What is the readonable number?
No you cannot change the network keep alive timeout, or not readily and
it isn’t something you should ever do. It is quite possibly nothing to do
with that anyway.
As to WSGIApplicationGroup then it may help as I already outlined. Any
reason you haven’t tried it as it is recommended practice to use it?
What exactly are you using simpy for anyway. Looking at the documentation
for it it does various stuff with sub processes. Heavy or complicated use
of sub processes from inside of the context of a web application,
especially under Apache/mod_wsgi, is generally a bad idea. This is because
it may not play well with Apache’s process model and so something like
simpy may not work properly or could even interfere with the process
management of Apache or mod_wsgi.
Graham
Problem appeared again.
So, I will answer your questions.
I use third-party libraries sympy and sage. Didn't have any network issues.
Actually this happened when I sleep.
Exact error time is 2 hours 11 minutes (this value is always the same).
So, can I lower network keep alive timeout value?
If I set WSGIApplicationGroup %{GLOBAL}, will this help?
Thank you.
The messages indicate that all the threads in the daemon process group were blocked.
Initially new requests will still get added to the socket listener queue
for the daemon processes, which has a capacity for 100 queued requests by
default. Because though the daemon process wasn’t actually accepted them
and removing them from the queue, on the Apache child worker side where
Timeout when reading response headers from daemon process
When that 100 queue depth was eventually exceeded, no more requests could
be queued up. This then resulted in attempts to connect to the daemon
Unable to connect to WSGI daemon process
is all about.
WSGIApplicationGroup %{GLOBAL}
This forces the application to run the in the main interpreter context of
the daemon process groups.
This avoids problems with third party extension modules for Python that
haven’t been implemented correctly so as to be able to be used in sub
interpreter contexts. These can only work in the main interpreter context.
This is often a cause of thread deadlocks.
That said, that you say it lasts 2 hours and then disappears is interesting.
This is because 2 hours is the network keep alive timeout value.
So what may be happening is request threads are contacting some backend
service and due to some network/router issue, the connection is being
broken. In some circumstances, depending on what software is doing with the
connection, such a condition may not be detected until the 2 hour network
timeout occurs.
In light of that, what backend services does your application talk to and
would that traffic traverse over any switching equipment. Have you been
having any network issues.
Graham
Hi Graham and everyone.
I have a site that runs heavy math calculations using external math library.
I already wrote about it nearly half a year ago. In that case there was
timeout issue, but now I've fixed it.
But there is another issue.
Nearly the same time I got 503 error: Timeout when reading response
headers from daemon process.
This lasts for approximately 2 hours and then 503 error disappears.
I use Django 1.8.4 with mod_wsgi 4.4.13.
What configurations should I use in httpd.conf to avoid this error.
How to queue requests?
What is the number of sumultaneous requests?
....
What I want to do is avoid 503 error, limit number of simultaneous
requests and queue other requests.
[Mon Oct 12 11:47:09.445618 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45625] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:47:14.432179 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45632] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/?f=tan%28x%2F2%29+%2B+%281%2F%28x%5E2%2B4%29%29&a=0&b=2&n=8&steps=on
[Mon Oct 12 11:47:20.201940 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45700] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:47:20.608201 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45704] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:08.984176 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45707] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:48:09.505969 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45730] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:14.492629 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45731] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:20.262302 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45732] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:20.668421 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45737] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:09.044532 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45744] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:09.566430 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45789] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:49:14.552970 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45795] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:20.322179 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45799] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:49:20.728784 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45803] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:50:09.104426 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45816] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=ln+x+&var=x&steps=on
[Mon Oct 12 11:50:09.626783 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45819] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%2F2%29%2B%281%2F%282*y%5E%281%2F2%29%29%29&var=&a=3&b=9
[Mon Oct 12 11:50:14.613330 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45820] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/
[Mon Oct 12 11:50:20.382640 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45832] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:50:20.789229 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45846] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:09.164863 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45848] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:09.634602 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45879] Timeout when reading response
http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw
[Mon Oct 12 11:51:14.639873 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45914] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:20.443005 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45918] Timeout when reading response
https://www.google.com/
[Mon Oct 12 11:51:20.849576 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client
...
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an
.
Visit this group at http://groups.google.com/group/modwsgi.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an email to modwsgi+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at http://groups.google.com/group/modwsgi.
For more options, visit https://groups.google.com/d/optout.
Graham Dumpleton
2015-10-26 10:46:29 UTC
Permalink
The next thing to do is set LogLevel to info and get the better logging from Apache error log for when the problems arise as already indicated.

Graham
Post by Paul Royik
ServerRoot "/home/simamura/webapps/django_math/apache2"
LoadModule alias_module modules/mod_alias.so
LoadModule authz_core_module modules/mod_authz_core.so
LoadModule dir_module modules/mod_dir.so
LoadModule env_module modules/mod_env.so
LoadModule log_config_module modules/mod_log_config.so
LoadModule mime_module modules/mod_mime.so
LoadModule rewrite_module modules/mod_rewrite.so
LoadModule setenvif_module modules/mod_setenvif.so
LoadModule wsgi_module modules/mod_wsgi.so
LoadModule unixd_module modules/mod_unixd.so
LogFormat "%{X-Forwarded-For}i %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\"" combined
CustomLog /home/simamura/logs/user/access_django_math.log combined
ErrorLog /home/simamura/logs/user/error_django_math.log
Listen 30821
KeepAlive Off
SetEnvIf X-Forwarded-SSL on HTTPS=1
ServerLimit 5
StartServers 1
MaxRequestWorkers 60
MinSpareThreads 1
MaxSpareThreads 3
ThreadsPerChild 12
WSGIApplicationGroup %{GLOBAL}
WSGIDaemonProcess django_math processes=5 threads=12 python-path=/home/simamura/webapps/django_math:/home/simamura/webapps/django_math/mathsite:/home/simamura/webapps/django_math/lib/python2.7
WSGIProcessGroup django_math
WSGIRestrictEmbedded On
WSGILazyInitialization On
WSGIScriptAlias / /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
I changed a bit threadlimit as webfaction advised.
What should I do next?
Can you show me what your mod_wsgi configuration in Apache configuration file actually is? Ensure that the WSGIDaemonProcess directive is included.
Ensure that the LogLevel directive in Apache is set to ‘info’ and not ‘warn’ and provide the actual log messages from the Apache error log from when it occurs, including a dozen lines messages before and after so can see context. Prior and followup messages can contain important information which you might not think is helpful.
Graham
Post by Paul Royik
The most long running request is 12 seconds.
I tried to set request-timeout, but it didn't help.
No MaxRequestWorkers will not necessarily help. It doesn’t control how many processes/threads are available in the daemon processes used by mod_wsgi. Even changing the processes/threads for the daemon processes is only masking or delaying the occurrence of the issue. You need to work out the underlying cause.
https://code.google.com/p/modwsgi/wiki/DebuggingTechniques#Extracting_Python_Stack_Traces <https://code.google.com/p/modwsgi/wiki/DebuggingTechniques#Extracting_Python_Stack_Traces>
This will give you a way of being able to get Python stack traces out of the application as to what it is doing when it appears to get stuck.
request-timeout=60
This will set a timeout on how long requests are allowed to run. If exceeded then the process will be forcibly restarted.
This will recover from processes which are locked up and then cause who Apache to run out of capacity.
Note that 60 means 60 seconds for a single request in case of single thread daemon process.
Things get more complicated for multiple process and the time value relates to average consumed time across all active requests. So technically a single request can run longer than the timeout.
As part of the process of restarting the process, mod_wsgi will attempt to dump Python stack traces as to where the code may have been running at that time, and so can work similar to the manual method mentioned in that link.
If you play with this option, set the timeout to be twice what your longest request would take. Although, if you have very long running requests, what to set it to may be a problem in itself.
Graham
I set WSGIApplicationGroup, but it doesn't help.
I used sympy all year, but problems begin only now. Maybe when I upgraded to Apache 2.4
Anyway, in log file I got
[Thu Oct 22 17:08:55.697080 2015] [mpm_worker:error] [pid 658868:tid 140669018494784] AH00286: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting
[Thu Oct 22 17:09:26.399723 2015] [wsgi:error] [pid 667167:tid 140668926658304] [client 127.0.0.1:58424 <http://127.0.0.1:58424/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%282x%5E4%29%2F%28x%5E4-1%29&var=&a=2&b=3&steps=on <http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%282x%5E4%29%2F%28x%5E4-1%29&var=&a=2&b=3&steps=on>
Will it help if I raise MaxRequestWorkers? What is the readonable number?
No you cannot change the network keep alive timeout, or not readily and it isn’t something you should ever do. It is quite possibly nothing to do with that anyway.
As to WSGIApplicationGroup then it may help as I already outlined. Any reason you haven’t tried it as it is recommended practice to use it?
What exactly are you using simpy for anyway. Looking at the documentation for it it does various stuff with sub processes. Heavy or complicated use of sub processes from inside of the context of a web application, especially under Apache/mod_wsgi, is generally a bad idea. This is because it may not play well with Apache’s process model and so something like simpy may not work properly or could even interfere with the process management of Apache or mod_wsgi.
Graham
Problem appeared again.
So, I will answer your questions.
I use third-party libraries sympy and sage. Didn't have any network issues.
Actually this happened when I sleep.
Exact error time is 2 hours 11 minutes (this value is always the same).
So, can I lower network keep alive timeout value?
If I set WSGIApplicationGroup %{GLOBAL}, will this help?
Thank you.
The messages indicate that all the threads in the daemon process group were blocked.
Timeout when reading response headers from daemon process
Unable to connect to WSGI daemon process
is all about.
WSGIApplicationGroup %{GLOBAL}
This forces the application to run the in the main interpreter context of the daemon process groups.
This avoids problems with third party extension modules for Python that haven’t been implemented correctly so as to be able to be used in sub interpreter contexts. These can only work in the main interpreter context.
This is often a cause of thread deadlocks.
That said, that you say it lasts 2 hours and then disappears is interesting.
This is because 2 hours is the network keep alive timeout value.
So what may be happening is request threads are contacting some backend service and due to some network/router issue, the connection is being broken. In some circumstances, depending on what software is doing with the connection, such a condition may not be detected until the 2 hour network timeout occurs.
In light of that, what backend services does your application talk to and would that traffic traverse over any switching equipment. Have you been having any network issues.
Graham
Hi Graham and everyone.
I have a site that runs heavy math calculations using external math library.
I already wrote about it nearly half a year ago. In that case there was timeout issue, but now I've fixed it.
But there is another issue.
Nearly the same time I got 503 error: Timeout when reading response headers from daemon process.
This lasts for approximately 2 hours and then 503 error disappears.
I use Django 1.8.4 with mod_wsgi 4.4.13.
What configurations should I use in httpd.conf to avoid this error.
How to queue requests?
What is the number of sumultaneous requests?
....
What I want to do is avoid 503 error, limit number of simultaneous requests and queue other requests.
[Mon Oct 12 11:47:09.445618 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45625 <http://127.0.0.1:45625/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:47:14.432179 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45632 <http://127.0.0.1:45632/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/?f=tan%28x%2F2%29+%2B+%281%2F%28x%5E2%2B4%29%29&a=0&b=2&n=8&steps=on <http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/?f=tan%28x%2F2%29+%2B+%281%2F%28x%5E2%2B4%29%29&a=0&b=2&n=8&steps=on>
[Mon Oct 12 11:47:20.201940 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45700 <http://127.0.0.1:45700/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on <http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on>
[Mon Oct 12 11:47:20.608201 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45704 <http://127.0.0.1:45704/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:08.984176 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45707 <http://127.0.0.1:45707/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/ <http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/>
[Mon Oct 12 11:48:09.505969 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45730 <http://127.0.0.1:45730/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on <http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on>
[Mon Oct 12 11:48:14.492629 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45731 <http://127.0.0.1:45731/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:20.262302 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45732 <http://127.0.0.1:45732/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on <http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on>
[Mon Oct 12 11:48:20.668421 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45737 <http://127.0.0.1:45737/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:49:09.044532 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45744 <http://127.0.0.1:45744/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:49:09.566430 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45789 <http://127.0.0.1:45789/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on>
[Mon Oct 12 11:49:14.552970 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45795 <http://127.0.0.1:45795/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:49:20.322179 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45799 <http://127.0.0.1:45799/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/ <http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/>
[Mon Oct 12 11:49:20.728784 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45803 <http://127.0.0.1:45803/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on <http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on>
[Mon Oct 12 11:50:09.104426 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45816 <http://127.0.0.1:45816/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=ln+x+&var=x&steps=on <http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=ln+x+&var=x&steps=on>
[Mon Oct 12 11:50:09.626783 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45819 <http://127.0.0.1:45819/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%2F2%29%2B%281%2F%282*y%5E%281%2F2%29%29%29&var=&a=3&b=9 <http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%2F2%29%2B%281%2F%282*y%5E%281%2F2%29%29%29&var=&a=3&b=9>
[Mon Oct 12 11:50:14.613330 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45820 <http://127.0.0.1:45820/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/ <http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/>
[Mon Oct 12 11:50:20.382640 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45832 <http://127.0.0.1:45832/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:50:20.789229 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client 127.0.0.1:45846 <http://127.0.0.1:45846/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:51:09.164863 2015] [wsgi:error] [pid 10210:tid 139829304096512] [client 127.0.0.1:45848 <http://127.0.0.1:45848/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:51:09.634602 2015] [wsgi:error] [pid 10210:tid 139829293606656] [client 127.0.0.1:45879 <http://127.0.0.1:45879/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw <http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw>
[Mon Oct 12 11:51:14.639873 2015] [wsgi:error] [pid 10210:tid 139829390120704] [client 127.0.0.1:45914 <http://127.0.0.1:45914/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.co.uk/ <https://www.google.co.uk/>
[Mon Oct 12 11:51:20.443005 2015] [wsgi:error] [pid 10210:tid 139829400610560] [client 127.0.0.1:45918 <http://127.0.0.1:45918/>] Timeout when reading response headers from daemon process 'django_math': /home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py, referer: https://www.google.com/ <https://www.google.com/>
[Mon Oct 12 11:51:20.849576 2015] [wsgi:error] [pid 10210:tid 139829283116800] [client
...
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
Visit this group at http://groups.google.com/group/modwsgi <http://groups.google.com/group/modwsgi>.
For more options, visit https://groups.google.com/d/optout <https://groups.google.com/d/optout>.
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
Visit this group at http://groups.google.com/group/modwsgi <http://groups.google.com/group/modwsgi>.
For more options, visit https://groups.google.com/d/optout <https://groups.google.com/d/optout>.
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an email to modwsgi+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at http://groups.google.com/group/modwsgi.
For more options, visit https://groups.google.com/d/optout.
Paul Royik
2015-10-26 10:56:49 UTC
Permalink
Done. Will tell you when error appears again.
Post by Graham Dumpleton
The next thing to do is set LogLevel to info and get the better logging
from Apache error log for when the problems arise as already indicated.
Graham
ServerRoot "/home/simamura/webapps/django_math/apache2"
LoadModule alias_module modules/mod_alias.so
LoadModule authz_core_module modules/mod_authz_core.so
LoadModule dir_module modules/mod_dir.so
LoadModule env_module modules/mod_env.so
LoadModule log_config_module modules/mod_log_config.so
LoadModule mime_module modules/mod_mime.so
LoadModule rewrite_module modules/mod_rewrite.so
LoadModule setenvif_module modules/mod_setenvif.so
LoadModule wsgi_module modules/mod_wsgi.so
LoadModule unixd_module modules/mod_unixd.so
LogFormat "%{X-Forwarded-For}i %l %u %t \"%r\" %>s %b \"%{Referer}i\"
\"%{User-Agent}i\"" combined
CustomLog /home/simamura/logs/user/access_django_math.log combined
ErrorLog /home/simamura/logs/user/error_django_math.log
Listen 30821
KeepAlive Off
SetEnvIf X-Forwarded-SSL on HTTPS=1
ServerLimit 5
StartServers 1
MaxRequestWorkers 60
MinSpareThreads 1
MaxSpareThreads 3
ThreadsPerChild 12
WSGIApplicationGroup %{GLOBAL}
WSGIDaemonProcess django_math processes=5 threads=12
python-path=/home/simamura/webapps/django_math:/home/simamura/webapps/django_math/mathsite:/home/simamura/webapps/django_math/lib/python2.7
WSGIProcessGroup django_math
WSGIRestrictEmbedded On
WSGILazyInitialization On
WSGIScriptAlias /
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
I changed a bit threadlimit as webfaction advised.
What should I do next?
Can you show me what your mod_wsgi configuration in Apache configuration
file actually is? Ensure that the WSGIDaemonProcess directive is included.
Ensure that the LogLevel directive in Apache is set to ‘info’ and not
‘warn’ and provide the actual log messages from the Apache error log from
when it occurs, including a dozen lines messages before and after so can
see context. Prior and followup messages can contain important information
which you might not think is helpful.
Graham
The most long running request is 12 seconds.
I tried to set request-timeout, but it didn't help.
No MaxRequestWorkers will not necessarily help. It doesn’t control how
many processes/threads are available in the daemon processes used by
mod_wsgi. Even changing the processes/threads for the daemon processes is
only masking or delaying the occurrence of the issue. You need to work out
the underlying cause.
https://code.google.com/p/modwsgi/wiki/DebuggingTechniques#Extracting_Python_Stack_Traces
This will give you a way of being able to get Python stack traces out of
the application as to what it is doing when it appears to get stuck.
If you have a new enough mod_wsgi version, you can also try setting on
request-timeout=60
This will set a timeout on how long requests are allowed to run. If
exceeded then the process will be forcibly restarted.
This will recover from processes which are locked up and then cause who
Apache to run out of capacity.
Note that 60 means 60 seconds for a single request in case of single thread daemon process.
Things get more complicated for multiple process and the time value
relates to average consumed time across all active requests. So technically
a single request can run longer than the timeout.
As part of the process of restarting the process, mod_wsgi will attempt to
dump Python stack traces as to where the code may have been running at that
time, and so can work similar to the manual method mentioned in that link.
If you play with this option, set the timeout to be twice what your
longest request would take. Although, if you have very long running
requests, what to set it to may be a problem in itself.
Graham
I set WSGIApplicationGroup, but it doesn't help.
I used sympy all year, but problems begin only now. Maybe when I upgraded to Apache 2.4
Anyway, in log file I got
[Thu Oct 22 17:08:55.697080 2015] [mpm_worker:error] [pid 658868:tid
140669018494784] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Thu Oct 22 17:09:26.399723 2015] [wsgi:error] [pid 667167:tid
140668926658304] [client 127.0.0.1:58424] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%282x%5E4%29%2F%28x%5E4-1%29&var=&a=2&b=3&steps=on
Will it help if I raise MaxRequestWorkers? What is the readonable number?
No you cannot change the network keep alive timeout, or not readily and it
isn’t something you should ever do. It is quite possibly nothing to do with
that anyway.
As to WSGIApplicationGroup then it may help as I already outlined. Any
reason you haven’t tried it as it is recommended practice to use it?
What exactly are you using simpy for anyway. Looking at the documentation
for it it does various stuff with sub processes. Heavy or complicated use
of sub processes from inside of the context of a web application,
especially under Apache/mod_wsgi, is generally a bad idea. This is because
it may not play well with Apache’s process model and so something like
simpy may not work properly or could even interfere with the process
management of Apache or mod_wsgi.
Graham
Problem appeared again.
So, I will answer your questions.
I use third-party libraries sympy and sage. Didn't have any network issues.
Actually this happened when I sleep.
Exact error time is 2 hours 11 minutes (this value is always the same).
So, can I lower network keep alive timeout value?
If I set WSGIApplicationGroup %{GLOBAL}, will this help?
Thank you.
The messages indicate that all the threads in the daemon process group were blocked.
Initially new requests will still get added to the socket listener queue
for the daemon processes, which has a capacity for 100 queued requests by
default. Because though the daemon process wasn’t actually accepted them
and removing them from the queue, on the Apache child worker side where
Timeout when reading response headers from daemon process
When that 100 queue depth was eventually exceeded, no more requests could
be queued up. This then resulted in attempts to connect to the daemon
Unable to connect to WSGI daemon process
is all about.
WSGIApplicationGroup %{GLOBAL}
This forces the application to run the in the main interpreter context of
the daemon process groups.
This avoids problems with third party extension modules for Python that
haven’t been implemented correctly so as to be able to be used in sub
interpreter contexts. These can only work in the main interpreter context.
This is often a cause of thread deadlocks.
That said, that you say it lasts 2 hours and then disappears is interesting.
This is because 2 hours is the network keep alive timeout value.
So what may be happening is request threads are contacting some backend
service and due to some network/router issue, the connection is being
broken. In some circumstances, depending on what software is doing with the
connection, such a condition may not be detected until the 2 hour network
timeout occurs.
In light of that, what backend services does your application talk to and
would that traffic traverse over any switching equipment. Have you been
having any network issues.
Graham
Hi Graham and everyone.
I have a site that runs heavy math calculations using external math library.
I already wrote about it nearly half a year ago. In that case there was
timeout issue, but now I've fixed it.
But there is another issue.
Nearly the same time I got 503 error: Timeout when reading response
headers from daemon process.
This lasts for approximately 2 hours and then 503 error disappears.
I use Django 1.8.4 with mod_wsgi 4.4.13.
What configurations should I use in httpd.conf to avoid this error.
How to queue requests?
What is the number of sumultaneous requests?
....
What I want to do is avoid 503 error, limit number of simultaneous
requests and queue other requests.
[Mon Oct 12 11:47:09.445618 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45625] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:47:14.432179 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45632] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/?f=tan%28x%2F2%29+%2B+%281%2F%28x%5E2%2B4%29%29&a=0&b=2&n=8&steps=on
[Mon Oct 12 11:47:20.201940 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45700] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:47:20.608201 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45704] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:08.984176 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45707] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:48:09.505969 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45730] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:14.492629 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45731] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:20.262302 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45732] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:20.668421 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45737] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:09.044532 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45744] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:09.566430 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45789] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:49:14.552970 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45795] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:20.322179 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45799] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:49:20.728784 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45803] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:50:09.104426 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45816] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=ln+x+&var=x&steps=on
[Mon Oct 12 11:50:09.626783 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45819] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%2F2%29%2B%281%2F%282*y%5E%281%2F2%29%29%29&var=&a=3&b=9
[Mon Oct 12 11:50:14.613330 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45820] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/
[Mon Oct 12 11:50:20.382640 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45832] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:50:20.789229 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45846] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:09.164863 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45848] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:09.634602 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45879] Timeout when reading response
http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw
[Mon Oct 12 11:51:14.639873 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45914] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:20.443005 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45918] Timeout when reading response
https://www.google.com/
[Mon Oct 12 11:51:20.849576 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client
...
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/modwsgi.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an
.
Visit this group at http://groups.google.com/group/modwsgi.
...
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an email to modwsgi+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at http://groups.google.com/group/modwsgi.
For more options, visit https://groups.google.com/d/optout.
Paul Royik
2015-10-26 19:00:08 UTC
Permalink
Done. Will tell you when error appears again.
Post by Graham Dumpleton
The next thing to do is set LogLevel to info and get the better logging
from Apache error log for when the problems arise as already indicated.
Graham
ServerRoot "/home/simamura/webapps/django_math/apache2"
LoadModule alias_module modules/mod_alias.so
LoadModule authz_core_module modules/mod_authz_core.so
LoadModule dir_module modules/mod_dir.so
LoadModule env_module modules/mod_env.so
LoadModule log_config_module modules/mod_log_config.so
LoadModule mime_module modules/mod_mime.so
LoadModule rewrite_module modules/mod_rewrite.so
LoadModule setenvif_module modules/mod_setenvif.so
LoadModule wsgi_module modules/mod_wsgi.so
LoadModule unixd_module modules/mod_unixd.so
LogFormat "%{X-Forwarded-For}i %l %u %t \"%r\" %>s %b \"%{Referer}i\"
\"%{User-Agent}i\"" combined
CustomLog /home/simamura/logs/user/access_django_math.log combined
ErrorLog /home/simamura/logs/user/error_django_math.log
Listen 30821
KeepAlive Off
SetEnvIf X-Forwarded-SSL on HTTPS=1
ServerLimit 5
StartServers 1
MaxRequestWorkers 60
MinSpareThreads 1
MaxSpareThreads 3
ThreadsPerChild 12
WSGIApplicationGroup %{GLOBAL}
WSGIDaemonProcess django_math processes=5 threads=12
python-path=/home/simamura/webapps/django_math:/home/simamura/webapps/django_math/mathsite:/home/simamura/webapps/django_math/lib/python2.7
WSGIProcessGroup django_math
WSGIRestrictEmbedded On
WSGILazyInitialization On
WSGIScriptAlias /
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
I changed a bit threadlimit as webfaction advised.
What should I do next?
Can you show me what your mod_wsgi configuration in Apache configuration
file actually is? Ensure that the WSGIDaemonProcess directive is included.
Ensure that the LogLevel directive in Apache is set to ‘info’ and not
‘warn’ and provide the actual log messages from the Apache error log from
when it occurs, including a dozen lines messages before and after so can
see context. Prior and followup messages can contain important information
which you might not think is helpful.
Graham
The most long running request is 12 seconds.
I tried to set request-timeout, but it didn't help.
No MaxRequestWorkers will not necessarily help. It doesn’t control how
many processes/threads are available in the daemon processes used by
mod_wsgi. Even changing the processes/threads for the daemon processes is
only masking or delaying the occurrence of the issue. You need to work out
the underlying cause.
https://code.google.com/p/modwsgi/wiki/DebuggingTechniques#Extracting_Python_Stack_Traces
This will give you a way of being able to get Python stack traces out of
the application as to what it is doing when it appears to get stuck.
If you have a new enough mod_wsgi version, you can also try setting on
request-timeout=60
This will set a timeout on how long requests are allowed to run. If
exceeded then the process will be forcibly restarted.
This will recover from processes which are locked up and then cause who
Apache to run out of capacity.
Note that 60 means 60 seconds for a single request in case of single thread daemon process.
Things get more complicated for multiple process and the time value
relates to average consumed time across all active requests. So technically
a single request can run longer than the timeout.
As part of the process of restarting the process, mod_wsgi will attempt to
dump Python stack traces as to where the code may have been running at that
time, and so can work similar to the manual method mentioned in that link.
If you play with this option, set the timeout to be twice what your
longest request would take. Although, if you have very long running
requests, what to set it to may be a problem in itself.
Graham
I set WSGIApplicationGroup, but it doesn't help.
I used sympy all year, but problems begin only now. Maybe when I upgraded to Apache 2.4
Anyway, in log file I got
[Thu Oct 22 17:08:55.697080 2015] [mpm_worker:error] [pid 658868:tid
140669018494784] AH00286: server reached MaxRequestWorkers setting,
consider raising the MaxRequestWorkers setting
[Thu Oct 22 17:09:26.399723 2015] [wsgi:error] [pid 667167:tid
140668926658304] [client 127.0.0.1:58424] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%282x%5E4%29%2F%28x%5E4-1%29&var=&a=2&b=3&steps=on
Will it help if I raise MaxRequestWorkers? What is the readonable number?
No you cannot change the network keep alive timeout, or not readily and it
isn’t something you should ever do. It is quite possibly nothing to do with
that anyway.
As to WSGIApplicationGroup then it may help as I already outlined. Any
reason you haven’t tried it as it is recommended practice to use it?
What exactly are you using simpy for anyway. Looking at the documentation
for it it does various stuff with sub processes. Heavy or complicated use
of sub processes from inside of the context of a web application,
especially under Apache/mod_wsgi, is generally a bad idea. This is because
it may not play well with Apache’s process model and so something like
simpy may not work properly or could even interfere with the process
management of Apache or mod_wsgi.
Graham
Problem appeared again.
So, I will answer your questions.
I use third-party libraries sympy and sage. Didn't have any network issues.
Actually this happened when I sleep.
Exact error time is 2 hours 11 minutes (this value is always the same).
So, can I lower network keep alive timeout value?
If I set WSGIApplicationGroup %{GLOBAL}, will this help?
Thank you.
The messages indicate that all the threads in the daemon process group were blocked.
Initially new requests will still get added to the socket listener queue
for the daemon processes, which has a capacity for 100 queued requests by
default. Because though the daemon process wasn’t actually accepted them
and removing them from the queue, on the Apache child worker side where
Timeout when reading response headers from daemon process
When that 100 queue depth was eventually exceeded, no more requests could
be queued up. This then resulted in attempts to connect to the daemon
Unable to connect to WSGI daemon process
is all about.
WSGIApplicationGroup %{GLOBAL}
This forces the application to run the in the main interpreter context of
the daemon process groups.
This avoids problems with third party extension modules for Python that
haven’t been implemented correctly so as to be able to be used in sub
interpreter contexts. These can only work in the main interpreter context.
This is often a cause of thread deadlocks.
That said, that you say it lasts 2 hours and then disappears is interesting.
This is because 2 hours is the network keep alive timeout value.
So what may be happening is request threads are contacting some backend
service and due to some network/router issue, the connection is being
broken. In some circumstances, depending on what software is doing with the
connection, such a condition may not be detected until the 2 hour network
timeout occurs.
In light of that, what backend services does your application talk to and
would that traffic traverse over any switching equipment. Have you been
having any network issues.
Graham
Hi Graham and everyone.
I have a site that runs heavy math calculations using external math library.
I already wrote about it nearly half a year ago. In that case there was
timeout issue, but now I've fixed it.
But there is another issue.
Nearly the same time I got 503 error: Timeout when reading response
headers from daemon process.
This lasts for approximately 2 hours and then 503 error disappears.
I use Django 1.8.4 with mod_wsgi 4.4.13.
What configurations should I use in httpd.conf to avoid this error.
How to queue requests?
What is the number of sumultaneous requests?
....
What I want to do is avoid 503 error, limit number of simultaneous
requests and queue other requests.
[Mon Oct 12 11:47:09.445618 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45625] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:47:14.432179 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45632] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/?f=tan%28x%2F2%29+%2B+%281%2F%28x%5E2%2B4%29%29&a=0&b=2&n=8&steps=on
[Mon Oct 12 11:47:20.201940 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45700] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:47:20.608201 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45704] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:08.984176 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45707] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:48:09.505969 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45730] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:14.492629 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45731] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:48:20.262302 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45732] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-1/synthetic-division-calculator/?numer=2x%5E3-7x%5E2%2B12x-9&denom=2x-3&steps=on
[Mon Oct 12 11:48:20.668421 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45737] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:09.044532 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45744] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:09.566430 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45789] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=sin%5E5+%28x%29&var=&steps=on
[Mon Oct 12 11:49:14.552970 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45795] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:49:20.322179 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45799] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/simpsons-rule-calculator/
[Mon Oct 12 11:49:20.728784 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45803] Timeout when reading response
http://www.emathhelp.net/calculators/algebra-2/partial-fraction-decomposition-calculator/?numer=4x%5E&denom=x%5E2%28x%5E2%2B1%29&steps=on
[Mon Oct 12 11:50:09.104426 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45816] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/integral-calculator/?f=ln+x+&var=x&steps=on
[Mon Oct 12 11:50:09.626783 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45819] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/definite-integral-calculator/?f=%28y%5E%281%2F2%29%2F2%29%2B%281%2F%282*y%5E%281%2F2%29%29%29&var=&a=3&b=9
[Mon Oct 12 11:50:14.613330 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45820] Timeout when reading response
http://www.emathhelp.net/calculators/calculus-2/trapezoidal-rule-calculator/
[Mon Oct 12 11:50:20.382640 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45832] Timeout when reading response
/home/simamura/webapps/django_math/mathsite/mathsite/wsgi.py
[Mon Oct 12 11:50:20.789229 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client 127.0.0.1:45846] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:09.164863 2015] [wsgi:error] [pid 10210:tid
139829304096512] [client 127.0.0.1:45848] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:09.634602 2015] [wsgi:error] [pid 10210:tid
139829293606656] [client 127.0.0.1:45879] Timeout when reading response
http://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CFAQFjAJahUKEwje1pz16rzIAhXKGI4KHVrPAzA&url=http%3A%2F%2Fwww.emathhelp.net%2Fnotes%2Fcalculus-1%2Fdrawing-graphs-of-functions%2Fsteps-for-sketching-graph-of-function%2F&usg=AFQjCNGAABCyCB7rhd4yAI83Dd0NDLTrPw
[Mon Oct 12 11:51:14.639873 2015] [wsgi:error] [pid 10210:tid
139829390120704] [client 127.0.0.1:45914] Timeout when reading response
https://www.google.co.uk/
[Mon Oct 12 11:51:20.443005 2015] [wsgi:error] [pid 10210:tid
139829400610560] [client 127.0.0.1:45918] Timeout when reading response
https://www.google.com/
[Mon Oct 12 11:51:20.849576 2015] [wsgi:error] [pid 10210:tid
139829283116800] [client
...
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/modwsgi.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an
.
Visit this group at http://groups.google.com/group/modwsgi.
...
--
You received this message because you are subscribed to the Google Groups "modwsgi" group.
To unsubscribe from this group and stop receiving emails from it, send an email to modwsgi+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at http://groups.google.com/group/modwsgi.
For more options, visit https://groups.google.com/d/optout.
Loading...