span8
span4
FME can be set up to take advantage of multiple-core processors by carrying out multiple processes in parallel. Parallel processing has the potential to improve performance over single-process translations.
Each parallel process in FME uses its own set of data, and data cannot be passed between processes. Therefore you must divide data into groups using a Group-By parameter, and set each group to be handled by a different process.
在这里,一位用户正在使用FME的统计计算器transformer计算温哥华市公园的游客人数。每个公园都有一个属性来定义它所在的社区。邻域属性用于对数据进行分组,通过设置并行处理级别,每个分组都由单独的进程处理,从而可能提高性能。
Starting Workspace as a Template
Follow these steps as an example of how to use parallel processing on a transformer.
1启动FME Workbench并打开附加的工作区模板:
Notice that the workspace reads a CSV file containing parking meter offences. Each offence is given a monetary value by the AttributeValueMapper transformer.
The task is to calculate the number of offences and the total amount of fines recorded under each bylaw.
2. Add a StatisticsCalculator transformer after the AttributeValueMapper:
Open the parameters dialog for the StatisticsCalculator transformer. Under the Group-By parameter, select the attribute BYLAW. This will ensure that each different bylaw generates its own set of statistics. Select FineAmount as the Attribute to Analyze:
Now set the following:
Empty any other parameter field:
3. Add an Inspector transformer to the StatisticsCalculator:Summary output port (or turn on Feature Caching) and run the workspace. On my computer, with an Inspector transformer, it takes approximately 53 seconds to run to completion.
However, because we are using groups of data we have the capability to turn on Parallel Processing.
4重新打开StatisticsCalculator转换器的“参数”对话框。将并行处理参数设置为中等。在四核计算机上,这将同时运行四个进程。
(可选)打开“任务管理器”窗口,然后重新运行工作区:
fmeworkbench.exe is the process for the FME Workbench user interface.
fme.exe是主FME翻译process, and each fmeworker.exe process is a parallel process calculating statistics.
On my computer the whole translation now takes only 29 seconds to run, demonstrating how parallel processing is capable of slashing translation time.
The data used here originates from open data made available by theCity of Vancouver, British Columbia. It contains information licensed under the Open Government License - Vancouver.
© 2020 Safe Software Inc |Legal