Documentation Center

Multi-server deployment

A multi-server deployment implies that you install the MT Edge application on one Master host or machine, while you install the MT edge Language Pairs on several Worker hosts.

Machine Translation Edge multi-server deployment is designed for moderate to high translation volumes. For example, a multi-server deployment can support multiple users translating approximately 100 million words per day, using multiple MT language pairs.

In this multi-server deployment example, Machine Translation Edge is running on five machines: Bergamot, Thymes, Eucalyptus, Rosemary, and Laurel. The MT Edge application was installed on Bergamot as a Master host so that it can serve the Web GUI service, which provides a user-interface that is accessible via a web browser, and the REST API service, which provides industry standard HTTP methods for application integrations. Since the usage scenario aims to serve a large pool of simultaneous users, Bergamot is dedicated to hosting the Web GUI and the REST API only, and therefore no MT Edge language pairs are installed on Bergamot.

Having six Job Engines across four different hosts provide this Machine Translation Edge instance with redundancy and higher capacity for source language detection if the source language is set to auto-detect, for segmentation of the source input, and for the compilation of the translation into the desired output format. Thymes and Rosemary have more memory, so they can support more Translation Engines, which are more memory intensive services. There are twice as many Translation Engines for each of French to English and Spanish to English language pairs than there are for the others, because those languages are expected to have higher usages.

The following are the high level steps taken during the four parts of the deployment process to achieve this Machine Translation Edge cluster setup:

Part 1: Installing the MT Edge application

The MT Edge application is installed as a Master host on Bergamot, while it is installed as a Worker host on Thymes, Eucalyptus, Rosemary, and Laurel.

Part 2: Installing the MT Edge language pairs

The MT Edge language pairs are installed on the host machines that will run Translation Engines for those specific language pairs. Specifically, Arabic, Russian, Bengali, Italian, and Japanese to English are installed onThymes and Rosemary. French and Spanish to English are installed on Eucalyptus and Laurel.

Part 3: Obtaining the licenses

Starting with Machine Translation Edge 8.2 (formerly known as SDL ETS 8.2), only the Master host requires a license. The Worker hosts get their license from the Master host.

A request to MT Edge licensing is made with the following information provided to obtain the correct license:
  • The myhosts.json file from Machine Translation Edge installation directory on Bergamot.
  • The desired MT Edge language pairs.
  • Processing Units count: 2 (optional as this is usually specified by the purchase order contract).

After the sdl-ets.lic is provided by Machine Translation Edge licensing team, it is saved into Machine Translation Edge installation directory on Bergamot.

Part 4: Starting up the translation engines from the Web GUI
  • Add Thymes, Eucalyptus, Rosemary, and Laurel as hosts.
  • Add Job Engines and Translation Engines to each host as the diagram shows. Thymes and Rosemary have the same Job Engines and Translation Engines setup. Eucalyptus and Laurel have the same Job Engines and Translation Engines setup.