Call us: +1-415-738-4000
Terracotta XML configuration files set the characteristics and behavior of Terracotta server instances and Terracotta clients. The easiest way to create your own Terracotta configuration file is by editing a copy of one of the sample configuration files available with the Terracotta BigMemory Max kit.
Where you locate the Terracotta configuration file, or how your Terracotta server and client configurations are loaded, depends on the stage your project is at and on its architecture. This document covers the following cases:
This document discusses cluster configuration in the Terracotta Server Array. To learn more about the Terracotta server instances, see Terracotta Server Array Architecture.
For a comprehensive and fully annotated configuration file, see
config-samples/tc-config-reference.xml in the Terracotta kit.
To configure the Terracotta server, create a
tc-config.xml configuration file, or update the one that is provided in the config-samples/ directory of the BigMemory Max kit. For example:
<?xml version="1.0" encoding="UTF-8" ?> <tc:tc-config xmlns:tc="http://www.terracotta.org/config" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.terracotta.org/schema/terracotta-9.xsd"> <servers> <server host="localhost" name="My Server Name1"> <!-- Specify the path where the server should store its data. --> <data>/local/disk/path/to/terracotta/server1-data</data> <!-- Specify the port where the server should listen for client traffic. --> <tsa-port>9510</tsa-port> <jmx-port>9520</jmx-port> <tsa-group-port>9530</tsa-group-port> <!-- Enable BigMemory on the server. --> <dataStorage size=”800g”> <offheap size=”200g”/> <!-- Hybrid storage is optional. --> <hybrid/> </dataStorage> </server> <server host="localhost" name="My Server Name2"> <data>/local/disk/path/to/terracotta/server2-data</data> <tsa-port>9510</tsa-port> <jmx-port>9520</jmx-port> <tsa-group-port>9530</tsa-group-port> <dataStorage size=”200g”> <offheap size=”200g”/> </dataStorage> </server> <!-- Add the restartable element for Fast Restartability (optional). --> <restartable enabled="true"/> </servers> <clients> <logs>logs-%i</logs> </clients> </tc:tc-config>
To successfully configure a Terracotta Server Array using the Terracotta configuration file, note the following:
Two or more servers should be defined in the <servers> section of the Terracotta configuration file.
<tsa-group-port> is the port used by the Terracotta server to communicate with other Terracotta servers.
Under <servers>, use either <server> or <mirror-group> configurations, but not a mixture. You may configure multiple servers or multiple mirror groups. <server> instances under <servers> work together as a mirror group. To create more than one stripe, use <mirror-group> instances.
Terracotta server instances must not share data directories. Each server's <data> element should point to a different and preferably local data directory.
For data persistence, configure fast restartability. Enabling <restartable> means that the shared in-memory data is backed up and, in case of failure, it is automatically restored. Setting <restartable> to "false" or omitting the <restartable> element are two ways to configure no persistence.
Each server requires an off-heap store, which allows all data to be stored in-memory, limited only by the amount of memory in your server. The minimum <offheap> size is 4 GB. Additional hybrid storage is optional. Specify the <dataStorage> size and the <offheap> size. The <offheap> size can be set to the amount of memory available in your server for data. If you enable <hybrid>, then the <dataStorage> size can exceed the <offheap> size.
All servers and clients should be running the same version of Terracotta and Java.
At startup, Terracotta servers load their configuration from one of the following sources:
These sources are explored below.
If no configuration file is specified and no
tc-config.xml exists in the directory in which the Terracotta instance is started, then default configuration values are used.
tc-config.xml is used by default if it is located in the directory in which a Terracotta instance is started and no configuration file is explicitly specified.
You can explicitly specify a configuration file by passing the -f option to the script used to start a Terracotta server. For example, to start a Terracotta server on UNIX/Linux using the provided script, enter:
start-tc-server.sh -f <path_to_configuration_file>
where <path_to_configuration_file> can be a URL or a relative directory path. In Microsoft Windows, use
Note: Cygwin (on Windows) is not supported for this feature.
At startup, Terracotta clients load their configuration from one of the following sources:
<terracottaConfig>element) used with BigMemory Max and BigMemory Go.
org.quartz.jobStore.tcConfigUrlproperty) used with Quartz Scheduler.
web.xml) element used with containers and Terracotta Web Sessions.
TerracottaClient()) used when a client is instantiated programmatically using the Terracotta Toolkit.
Terracotta clients can load customized configuration files to specify <client> and <application> configuration. However, the <servers> block of every client in a cluster must match the <servers> block of the servers in the cluster. If there is a mismatch, the client will emit an error and fail to complete its startup. However, there are options you can set for How Server Settings Can Override Client Settings.
|On startup, a Terracotta client may emit a configuration-mismatch error if its <servers> block does not match that of the server it connects to. However, under certain circumstances, this error may occur even if the <servers> blocks appear to match. The following suggestions may help prevent this error: - Use `-Djava.net.preferIPv4Stack` consistently. If it is explicitly set on the client, be sure to explicitly set it on the server. - Ensure `etc/hosts` file does not contain multiple entries for hosts running Terracotta servers. - Ensure that DNS always returns the same address for hosts running Terracotta servers.|
See the discussion for local XML file (default) in How Terracotta Servers Get Configured.
To specify a configuration file for a Terracotta client, see Clients in Development.
|On startup, Terracotta clients must fetch certain configuration properties from a Terracotta server. A client loading its own configuration will attempt to connect to the Terracotta servers named in that configuration. If none of the servers named in that configuration are available, the client cannot complete its startup.|
Terracotta clients can load configuration from an active Terracotta server by specifying its hostname and TSA port (see Clients in Production).
In a development environment, using a different configuration file for each Terracotta client facilitates the testing and tuning of configuration options. This is an efficient and effective way to gain valuable insight on best practices for clustering your application with Terracotta.
For one Terracotta server, the default configuration is adequate.
To use the default configuration settings, start your Terracotta server using the
start-tc-server.bat) script in a directory that does not contain the file
To specify a configuration file, use one of the approaches discussed in How Terracotta Servers Get Configured.
A two-server setup, sometimes referred to as an active-mirror setup, has one active server instance and one "hot standby" (the mirror) that should load the same configuration file.
The configuration file loaded by the Terracotta servers must define each server separately using <server> elements. For example:
<tc:tc-config xsi:schemaLocation="http://www.terracotta.org/schema/terracotta-9.xsd" xmlns:tc="http://www.terracotta.org/config" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> ... <!-- Use an IP address or a resolvable host name for the host attribute. --> <server host="123.456.7.890" name="Server1"> ... <server host="myResolvableHostName" name="Server2"> ... </tc:tc-config>
Assuming Server1 is the active server, using the same configuration allows Server2 to be the mirror and maintain the environment in case of failover. If you are running both Terracotta servers on the same host, the only port that has to be specified in configuration is the <tsa-port>; the values for <jmx-port> and <tsa-group-port> are filled in automatically.
|If you are running the servers on the same machine, some elements in the <server> section, such as <tsa-port> and <server-logs>, must have different values for each server.|
With multiple <server> elements, the name attribute may be required to avoid ambiguity when starting a server:
start-tc-server.sh -n Server1 -f <path_to_configuration_file>
In Microsoft Windows, use
For example, if you are running Terracotta server instances on the same host, you must specify the name attribute to set an unambiguous target for the script.
However, if you are starting Terracotta server instances in an unambiguous setup, specifying the server name is optional. For example, if the Terracotta configuration file specifies different IP addresses for each server, the script assumes that the server with the IP address corresponding to the local IP address is the target.
You can explicitly specify a client's Terracotta configuration file by passing
-Dtc.config=path/to/my-tc-config.xml when you start your application with the Terracotta client.
-Dtc.config=path/to/my-tc-config.xml -cp classes myApp.class.Main
myApp.class.Main is the class used to launch the application you want to cluster with Terracotta.
tc-config.xml exists in the directory in which you run Java, it can be loaded without
For an efficient production environment, it's recommended that you maintain one Terracotta configuration file. That file can be loaded by the Terracotta server (or servers) and pushed out to clients. While this is an optional approach, it's an effective way to centralize and decrease maintenance.
If your Terracotta configuration file uses "%i" for the hostname attribute in its server element, change it to the actual hostname in production. For example, if in development you used the following:
<server host="%i" name="Server1">
and the production host's hostname is myHostName, then change the host attribute to the myHostName:
<server host="myHostName" name="Server1">
For clients in production, you can set up the Terracotta environment before launching your application.
To start your application with the Terracotta client using your own scripts, first set the following environment variables:
<server_host>:<tsa-port> points to the running Terracotta server. The specified Terracotta server will push its configuration to the Terracotta client.
Alternatively, a client can specify that its configuration come from a server by setting the tc.config system propery:
If more than one Terracotta server is available, enter them in a comma-separated list:
If <server_host1> is unavailable, <server_host2> is used.
Terracotta products can set a configuration path using their own configuration files.
For BigMemory Max and BigMemory Go, use the
<terracottaConfig> element in the Ehcache configuration file (
ehcache.xml by default):
<terracottaConfig url="localhost:9510" />
For Quartz, use the
org.quartz.jobStore.tcConfigUrl property in the Quartz properties file (
quartz.properties by default):
org.quartz.jobStore.tcConfigUrl = /myPath/to/tc-config.xml
For Terracotta Web Sessions, use the appropriate elements in
context.xml (see Web Sessions Installation).
Normally, the ports you specify for a server in the Terracotta configuration are bound to the interface associated with the host specified for that server. For example, if the server is configured with the IP address "12.345.678.8" (or a hostname with that address), the server's ports are bound to that same interface:
<server host="12.345.678.8" name="Server1"> ... <tsa-port>9510</tsa-port> <jmx-port>9520</jmx-port> <tsa-group-port>9530</tsa-group-port> </server>
However, in certain situations it may be necessary to specify a different interface for one or more of a server's ports. This is done using the
bind attribute, which allows you bind a port to a different interface. For example, a JMX client may only be able connect to a certain interface on a host. The following configuration shows a JMX port bound to an interface different than the host's:
<server host="12.345.678.8" name="Server1"> ... <tsa-port>9510</tsa-port> <jmx-port bind="12.345.678.9">9520</jmx-port> <tsa-group-port>9530</tsa-group-port> </server>
Each server and client must maintain separate log directories. By default, server logs are written to
%(user.home)/terracotta/server-logs and client logs to
To find out which configuration a server or client is using, search its logs for an INFO message containing the text "Configuration loaded from".