You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
310 lines
20 KiB
310 lines
20 KiB
<html lang="en">
|
|
<head>
|
|
<meta charset="utf-8" />
|
|
<title>Chamilo Optimization Guide</title>
|
|
<link rel="stylesheet" href="../main/css/base.css" type="text/css" media="screen,projection" />
|
|
<link rel="stylesheet" href="default.css" type="text/css" media="screen,projection" />
|
|
<link rel="shortcut icon" href="../favicon.ico" type="image/x-icon" />
|
|
</head>
|
|
<body>
|
|
<div class="navbar navbar-fixed-top">
|
|
<div class="navbar-inner">
|
|
<div class="container-fluid">
|
|
<a class="btn btn-navbar" data-toggle="collapse" data-target=".nav-collapse">
|
|
<span class="icon-bar"></span>
|
|
<span class="icon-bar"></span>
|
|
<span class="icon-bar"></span>
|
|
</a>
|
|
<a class="brand" href="index.html">Chamilo - Documentation</a>
|
|
<div class="nav-collapse">
|
|
<ul class="nav">
|
|
<li><a href="index.html">Home</a></li>
|
|
<li><a href="readme.html">About</a></li>
|
|
<li><a href="license.html">License</a></li>
|
|
<li><a href="credits.html">Credits</a></li>
|
|
<li><a href="dependencies.html">Dependencies</a></li>
|
|
<li><a href="changelog.html">Changelog</a></li>
|
|
</ul>
|
|
</div><!--/.nav-collapse -->
|
|
</div>
|
|
</div>
|
|
</div>
|
|
<div class="container">
|
|
<h1>Chamilo : Optimization Guide</h1>
|
|
|
|
<a href="index.html">Documentation</a> > Optimization Guide
|
|
|
|
<p>In seldom cases, you will need to start looking into efficiency issues with Chamilo. This guide is a work in progress intended to help administrators optimize their Chamilo installation.</p>
|
|
|
|
|
|
<h2><b>Contents</b></h2>
|
|
<ol>
|
|
<li><a href="#1.Using-XCache">Using xCache or APC</a></li>
|
|
<li><a href="#2.Slow-queries">Slow queries</a></li>
|
|
<li><a href="#3.Indexes-caching">Indexes caching</a></li>
|
|
<li><a href="#4.Sessions-directories">Sessions directories</a></li>
|
|
<li><a href="#5.Users-upload-directories">Users upload directories</a></li>
|
|
<li><a href="#6.Zlib-compression">Zlib compressed output</a></li>
|
|
<li><a href="#7.High-numbers-memory">Memory considerations for high numbers of users</a></li>
|
|
<li><a href="#8.HTTP-caching-media">HTTP caching for media</a></li>
|
|
</ol>
|
|
|
|
<h2><a name="1.Using-XCache"></a>1. Using xCache or APC</h2>
|
|
See <a href="http://xcache.lighttpd.net/">xCache's website</a> for summary documentation.<br />
|
|
<ul>
|
|
<li>On Debian/Ubuntu: sudo apt-get install php5-xcache</li>
|
|
</ul>
|
|
Set your xcache.ini configuration (/etc/php5/conf.d/xcache.ini) to match your system. For example, you *could* have something like this (intentionally hiding comments here):
|
|
<pre>
|
|
xcache.shm_scheme = "mmap"
|
|
xcache.size = 32M
|
|
xcache.count = 2
|
|
xcache.slots = 8K
|
|
xcache.ttl = 0
|
|
xcache.gc_interval = 0
|
|
xcache.var_size = 16M
|
|
xcache.var_count = 16
|
|
xcache.var_slots = 8K
|
|
xcache.var_ttl = 60
|
|
xcache.var_maxttl = 300
|
|
xcache.var_gc_interval = 300
|
|
xcache.test = Off
|
|
</pre>
|
|
xCache will feel useless until you actually start to put some variables in cache. If you're showing the "Who is online" counter, that's one of the best item there is to implement xCache.<br />
|
|
For example, you could implement it this way (in main/inc/lib/banner.lib.php):<br />
|
|
<pre>
|
|
$xc = function_exists('xcache_isset');
|
|
$number = 0;
|
|
if ((api_get_setting('showonline', 'world') == 'true' AND !$user_id) OR (api_get_setting('showonline', 'users') == 'true' AND $user_id) OR (api_get_setting('showonline', 'course') == 'true' AND $user_id AND $course_id)) {
|
|
if ($xc && xcache_isset('campus_chamilo_org_whoisonline_count_simple')) {
|
|
$number = xcache_get('campus_chamilo_org_whoisonline_count_simple');
|
|
} else {
|
|
$number = who_is_online_count(api_get_setting('time_limit_whosonline'));
|
|
xcache_set('campus_chamilo_org_whoisonline_count_simple',$number);
|
|
}
|
|
}
|
|
$number_online_in_course = 0;
|
|
if(!empty($_course['id'])) {
|
|
if ($xc && xcache_isset('campus_chamilo_org_whoisonline_count_simple_'.$_course['id'])) {
|
|
$number_online_in_course = xcache_get('campus_chamilo_org_whoisonline_count_simple_'.$_course['id']);
|
|
} else {
|
|
$number_online_in_course = who_is_online_in_this_course_count(api_get_user_id(), api_get_setting('time_limit_whosonline'), $_course['id']);
|
|
xcache_set('campus_chamilo_org_whoisonline_count_simple_'.$_course['id'],$number_online_in_course);
|
|
}
|
|
}
|
|
</pre>
|
|
Note that, as xCache is a shared caching system, it is very important to prefix your variables with a domain name or some kind of identifier, otherwise it would end up in disaster if you use a shared server for several portals.<br />
|
|
<br />
|
|
An optional additional caching mechanism you may use is the realpath_cache_size and realpath_cache_ttl php.ini parameters. See <a href="http://php.net/manual/en/ini.core.php">the PHP documentation</a> for more details.
|
|
<br />
|
|
<br />
|
|
If you prefer using <a href="http://php.net/manual/en/book.apc.php">APC</a>, you can use the same kind of trick as above, just changing the code a little:
|
|
<pre>
|
|
$xc = function_exists('apc_exists');
|
|
$number = 0;
|
|
if ((api_get_setting('showonline', 'world') == 'true' AND !$user_id) OR (api_get_setting('showonline', 'users') == 'true' AND $user_id) OR (api_get_setting('showonline', 'course') == 'true' AND $user_id AND $course_id)) {
|
|
if ($xc) {
|
|
$apc = apc_cache_info(null,true);
|
|
$apc_end = $apc['start_time']+$apc['ttl'];
|
|
if (apc_exists('my_campus_whoisonline_count_simple') AND (time() < $apc_end) AND apc_fetch('my_campus_whoisonline_count_simple') > 0 ) {
|
|
$number = apc_fetch('my_campus_whoisonline_count_simple');
|
|
} else {
|
|
$number = who_is_online_count(api_get_setting('time_limit_whosonline'));
|
|
apc_clear_cache();
|
|
apc_store('my_campus_whoisonline_count_simple',$number,15);
|
|
}
|
|
} else {
|
|
$number = who_is_online_count(api_get_setting('time_limit_whosonline'));
|
|
}
|
|
$number_online_in_course = 0;
|
|
if (!empty($_course['id'])) {
|
|
if ($xc) {
|
|
$apc = apc_cache_info(null,true);
|
|
$apc_end = $apc['start_time']+$apc['ttl'];
|
|
if (apc_exists('my_campus_whoisonline_count_simple_'.$_course['id']) AND (time() < $apc_end) AND apc_fetch('my_campus_whoisonline_count_simple_'.$_course['id']) > 0) {
|
|
$number_online_in_course = apc_fetch('my_campus_whoisonline_count_simple_'.$_course['id']);
|
|
} else {
|
|
$number_online_in_course = who_is_online_in_this_course_count($user_id, api_get_setting('time_limit_whosonline'), $_course['id']);
|
|
apc_store('my_campus_whoisonline_count_simple_'.$_course['id'],$number_online_in_course,15);
|
|
}
|
|
} else {
|
|
$number_online_in_course = who_is_online_in_this_course_count($user_id, api_get_setting('time_limit_whosonline'), $_course['id']);
|
|
}
|
|
}
|
|
...
|
|
</pre>
|
|
<hr />
|
|
<h2><a name="2.Slow-queries"></a>2. Slow queries</h2>
|
|
Enable slow_queries in /etc/mysqld/my.cnf, restart MySQL then follow using sudo tail -f /var/log/mysql/mysql-slow.log
|
|
<br /><br />
|
|
In Chamilo 1.9 in particular, due to the merge of all databases into one, you might experience performance issue if you have many learning paths with many items in them.<br />
|
|
To solve this performance issue, you can execute the following queries manually in your database:<br />
|
|
<pre>
|
|
ALTER TABLE lp_item ADD INDEX idx_c_lp_item_cid_lp_id (c_id, lp_id);
|
|
ALTER TABLE lp_item_view ADD INDEX idx_c_lp_item_view_cid_lp_view_id_lp_item_id (c_id, lp_view_id, lp_item_id);
|
|
</pre>
|
|
These will be available in Chamilo 1.10 directly, but we cannot put them into Chamilo 1.9 from now on for organizational reasons.<br />
|
|
<h3>InnoDB Engine and table locking vs row locking</h3>
|
|
<p>
|
|
InnoDB is one of the table engines you can use in MySQL. The main advantage of InnoDB is that you can have table locking per row instead of table locking per table. This means that, if one single insert or update query is very slow and executes on a critical table in Chamilo (user, course, etc), it will lock the whole table and no other query will be able to execute, which might seriously affect the efficiency of your database.</p>
|
|
<p>Luckily, you can change the engine for one table "on-the-fly", which allows you to effectively check whether this makes a considerable difference. Our recommendation: only do that when seeing that a "SHOW FULL PROCESSLIST" in your database client shows many "Waiting for lock on table [...]".
|
|
</p>
|
|
<p>
|
|
To change these engines, just launch the following command:
|
|
<pre>
|
|
ALTER TABLE course ENGINE=INNODB;
|
|
ALTER TABLE user ENGINE=INNODB;
|
|
ALTER TABLE session ENGINE=INNODB;
|
|
ALTER TABLE session_rel_course ENGINE=INNODB;
|
|
ALTER TABLE session_rel_course_rel_user ENGINE=INNODB;
|
|
</pre>
|
|
If used on large tables, this might take a considerable time (can take around 60s for a million rows), so try to execute at night or during lower usage periods.
|
|
</p>
|
|
|
|
<hr />
|
|
<h2><a name="3.Indexes-caching"></a>3. Indexes caching</h2>
|
|
One good reference: <a href="http://dev.mysql.com/doc/refman/5.1/en/multiple-key-caches.html">MySQL documentation on multiple key caches</a><br />
|
|
|
|
<hr />
|
|
|
|
<h2><a name="4.Sessions-directories"></a>4. Sessions directories</h2>
|
|
php_admin_value session.save_path 1;/var/www/test.chamilo.org/sessions/
|
|
<hr />
|
|
<h2><a name="5.Users-upload-directories"></a>5. Users upload directories</h2>
|
|
Create 10 directories inside the main/upload/users directory (from 0 to 9) and update your admin settings. This has to be done at install & configuration time, otherwise you might loose user data (or have to write a script for data distribution).
|
|
<hr />
|
|
<h2><a name="6.Zlib-compression"></a>6. Zlib compressed output</h2>
|
|
Although this will not make your server faster, compressing the pages you are sending to the users will definitely make them feel like your website's responses are a lot faster, and thus increase their well-being when using Chamilo.<br /><br />
|
|
Zlib output compression has to be set at two levels: PHP configuration for PHP pages and Apache for images and CSS.<br /><br />
|
|
To update the PHP configuration (either in php.ini or in your VirtualHost), use the <a href="http://php.net/manual/en/zlib.configuration.php">zlib.output_compression</a>. If you set this inside your Apache's VirtualHost, you should use the following syntax.
|
|
<pre>
|
|
php_value zlib.output_compression 1
|
|
</pre>
|
|
<br />
|
|
Configuring your Apache server to use output compression is a bit trickier. You have to use <a href="http://httpd.apache.org/docs/2.2/mod/mod_deflate.html">the mod_deflate module</a> to do it. Your configuration should look like something like this (please read the corresponding documentation before implementing in production).<br />
|
|
Easy mode:
|
|
<pre>
|
|
AddOutputFilterByType DEFLATE text/html text/plain text/xml
|
|
</pre> or, for every content type (dangerous) you can put the following inside a location or directory block:<pre>SetOutputFilter DEFLATE</pre>
|
|
<br />
|
|
Advanced mode:
|
|
<pre>
|
|
<Location />
|
|
# Insert filter
|
|
SetOutputFilter DEFLATE
|
|
|
|
# Netscape 4.x has some problems...
|
|
BrowserMatch ^Mozilla/4 gzip-only-text/html
|
|
|
|
# Netscape 4.06-4.08 have some more problems
|
|
BrowserMatch ^Mozilla/4\.0[678] no-gzip
|
|
|
|
# MSIE masquerades as Netscape, but it is fine
|
|
# BrowserMatch \bMSIE !no-gzip !gzip-only-text/html
|
|
|
|
# NOTE: Due to a bug in mod_setenvif up to Apache 2.0.48
|
|
# the above regex won't work. You can use the following
|
|
# workaround to get the desired effect:
|
|
BrowserMatch \bMSI[E] !no-gzip !gzip-only-text/html
|
|
|
|
# Don't compress images
|
|
SetEnvIfNoCase Request_URI \
|
|
\.(?:gif|jpe?g|png)$ no-gzip dont-vary
|
|
|
|
# Make sure proxies don't deliver the wrong content
|
|
Header append Vary User-Agent env=!dont-vary
|
|
</Location>
|
|
</pre>
|
|
<hr />
|
|
Don't have time or resources to optimize your Chamilo installation yourself? Hire an <a href="http://www.chamilo.org/en/providers">official Chamilo provider</a> and get it sorted out professionally by specialists.
|
|
<a href="http://validator.w3.org/check?uri=referer"><img src="http://www.w3.org/Icons/valid-xhtml10-blue" alt="Valid XHTML 1.0 Transitional" style="margin: 1em; float: right;" height="31" width="88" /></a>
|
|
<a href="http://jigsaw.w3.org/css-validator/">
|
|
<img src="http://jigsaw.w3.org/css-validator/images/vcss-blue" style="margin: 1em; float: right;" alt="Valid CSS" />
|
|
</a>
|
|
<hr />
|
|
<h2><a name="7.High-numbers-memory"></a>Memory considerations for high numbers of users</h2>
|
|
Some administration scripts *have to* handle lists of all users, and this might have a considerable impact on portals with very high numbers of users. For example, the main/admin/add_users_to_session.php script that handles the registration of users into a specific session, if used with the (non-default) full list of users, will devour about 3KB per user, which, for 100,000 users, translates into the need for around 300MB of RAM just to show this page, and to around 3GB for 1,000,000 users.<br />
|
|
This mode is not loaded by default, but could still be selected, leading to a "Fatal error: Allowed memory size ... exhausted" message.<br />
|
|
The only non-scripted solution here is to allow for the corresponding amount of RAM for your PHP configuration (<em>memory_limit = 300M</em>) or your specific VirtualHost if you use mod-php5 (<em>php_value memory_limit 300M</em>).<br/>
|
|
<hr />
|
|
<h2><a name="8.HTTP-caching-media">HTTP caching for media</a></h2>
|
|
<p>Images are (always) part of the heaviest resources around for a website, together with CSS an JavaScript libraries.
|
|
Obviously, audio files and videos can be much heavier still, but are much less frequent (for now).</p>
|
|
<p>Any web browser will allow you to play a little with HTTP headers.
|
|
Describing what HTTP really is, is not meant to be in this quick guide, but let's just say that, with the right configuration in your web server, you can "tell" the user's browser to re-use content he already downloaded instead of asking it again from the web server.</p>
|
|
<p>It's easy to underestimate the potential gains of doing this. i
|
|
On a typical web page, your browser will have between 20 (highly optimized) and 200 (not optimized at all) different "items" to download.
|
|
In Chamilo LMS 1.9, this number is around 40 per page. The first one is the .php file, which tells the browser which other resources to load, then the browser sends requests for these.
|
|
This includes icons (around 20, depending on the page), JS libraries (around 6), CSS files (around 12) and any other multimedia resource you might have.</p>
|
|
<p>Something that is rarely understood by most webmasters or sysadmins is that each one of these resources, unless otherwise configured, will imply a separate request to the server.
|
|
Even if the server has a mechanism to indicate that a file hasn't changed since the last time, and as such shouldn't be downloaded again, the request is still sent by the browser, received by the server, checked, answered and received again by the browser.
|
|
While you're waiting for your page to load, your browser is likely to have sent 40 requests and received 40 answers potentially thousands of miles away. You could reduce this to 5, if planned properly.</p>
|
|
<p>Even if this last sentence didn't impress you, you'll have to understand that each of these requests comes to your server, uses a server client (or thread, in the best case scenario) which requires memory, reads on disk (unless you've got some nice reverse-proxy mechanism), replies, writes the log for that request and finally goes back to sleep (or to answer the next request).
|
|
This might all seem invisible for a few requests, but when you start having hundreds of users connecting to your Chamilo site every few seconds, you'll start noticing.</p>
|
|
<h4>So, how do we make this better?</h4>
|
|
<p>There is one mechanism that will improve this situation. It's called setting "Expiry" headers, and it is based on the idea that, if we tll the browser how long to keep a specific image in cache, the browser will save it locally, identify it by its URL (so the same image offered on 2 different URLs will be considered as 2 different images) and, when a new page is loaded, if the same image is requested and the expiry date and time have not been reached, it will just load it from cache.<br />
|
|
No call to the server, no loading the image, no web server processing, no I/O on the server's disk.<br />
|
|
This is probably the single best optimization you can setup on your site.</p>
|
|
<p>This measure has to be taken with caution though... some images might be dynamic, or you might want to ensure that the image can only be loaded when the user is connected...<br />
|
|
So only a few images (but that's enough by us) will be configurable this way.<br />
|
|
And that's alright, because we know exactly which images can be configured this way:<br />
|
|
<ul>
|
|
<li>All the interface icons</li>
|
|
<li>The CSS files (unless you change them often</li>
|
|
<li>The homepage images (just make sure you change the name of the files when updating them)</li>
|
|
<li>Even the JS files can be cached</li>
|
|
</ul>
|
|
</p>
|
|
<h3>Setting up expiry headers in Apache</h3>
|
|
<p>
|
|
The following example is made to be inserted in an Apache's <VirtualHost> block, and should be adapted to fit in other web servers configurations. Some of the settings here might require the activation of the ModExpire and the ModHeader modules:
|
|
<pre>
|
|
ExpiresActive On
|
|
<Directory "/var/www/chamilo/main/img">
|
|
AllowOverride All
|
|
Order allow,deny
|
|
Allow from all
|
|
ExpiresByType image/gif "access plus 1 month"
|
|
ExpiresByType image/jpg "access plus 1 month"
|
|
ExpiresByType image/png "access plus 1 month"
|
|
ExpiresByType application/x-shockwave-flash "access plus 1 month"
|
|
</Directory>
|
|
<Directory "/var/www/chamilo/main/inc/lib">
|
|
AllowOverride All
|
|
Order allow,deny
|
|
Allow from all
|
|
ExpiresByType image/gif "access plus 1 month"
|
|
ExpiresByType image/jpg "access plus 1 month"
|
|
ExpiresByType image/png "access plus 1 month"
|
|
ExpiresByType text/css "access plus 1 month"
|
|
ExpiresByType application/javascript "access plus 1 month"
|
|
</Directory>
|
|
<Directory "/var/www/chamilo/main/css">
|
|
AllowOverride All
|
|
Order allow,deny
|
|
Allow from all
|
|
ExpiresByType image/gif "access plus 1 month"
|
|
ExpiresByType image/jpg "access plus 1 month"
|
|
ExpiresByType image/png "access plus 1 month"
|
|
ExpiresByType text/css "access plus 1 month"
|
|
</Directory>
|
|
<Directory "/var/www/chamilo/home">
|
|
AllowOverride All
|
|
Order allow,deny
|
|
Allow from all
|
|
ExpiresByType image/gif "access plus 3 hours"
|
|
ExpiresByType image/jpg "access plus 3 hours"
|
|
ExpiresByType image/png "access plus 3 hours"
|
|
</Directory>
|
|
</pre>
|
|
These settings explicitly mention the file MIME types that will be put in cache, and for how long. For heavily-optimized sites, where all editors are aware of the settings, understand and apply them, it is common to find cache expiry periods of one full year for images.<br />
|
|
If you want to change some content put in cache by the client, though, you will need to change the name of the file (and its reference in the HTML/PHP file that includes it).<br />
|
|
This is an easy way to massively reduce your bandwidth (80% reduction?), the speed of page loading for your users and the use of resources on your web server.
|
|
</p>
|
|
<h2>Authors</h2>
|
|
<ul>
|
|
<li>Yannick Warnier, Zend Certified PHP Engineer, BeezNest Belgium SPRL, <a href="mailto:yannick.warnier@beeznest.com">yannick.warnier@beeznest.com</a></li>
|
|
</ul>
|
|
</div>
|
|
</body>
|
|
</html>
|
|
|