Distributed Analyst Service Configuration and Management
|
Feedback
|
The distributed analyst service uses distributed computing technology to perform distributed spatial analysis and data processing on the super-large spatial data set. iServer Support visual configure distributed analysis service. So how do you configure distributed analysis service, this section will introduce you in detail:
- Start the iServer on the primary machine
- In the iServer service management server, click "Cluster"-"Distributed Analysis" to enter the distributed analysis pack
- "Enable Distributed Analysis Service", enter the enabling configuration process
- Select distributed computing cluster
Distributed analysis services require the support of distributed computing clusters, which can provide distributed analysis related functions by calling on the capabilities of distributed computing clusters. Therefore, when configuring distributed analysis services, it is necessary to configure the computing clusters that support the service. IServer currently supports three types of computing clusters: iServer's built-in Spark cluster, Spark cluster outside iServer and Hadoop Yarn cluster external to iServer.
In "Select Cluster", select the cluster type to be used, and click "Next" after corresponding configuration.
- Select "Local Distributed Computing Cluster" to use the spark cluster built into iServer
- Prepare the environment. For details, see the environment preparation before using iServer built-in Spark .
- Create a native Spark cluster. For details, see Startup Spark cluster service built into the iServer.
- Select "External Distributed Computer Cluster" and "Spark Cluster" in turn, fill in the corresponding Spark cluster address, for example: {ip}:7077, use a Spark cluster external to the iServer.
- If you don't have a spark cluster available, you can build your own on a different computer Spark distributed cluster .
- If you already have a spark cluster available, you need to configure it in the iServer before you can use it. For details, see Using a Spark cluster external to the iServer.
- Select "External Distributed Computer Cluster" and "Hadoop Yarn Cluster" in turn, fill in the corresponding configuration directory of Hadoop Yarn Cluster, and use Hadoop Yarn cluster external to iServer
- Before using the hadoop yarn cluster, the machine needs to be configured. For details, see iServer using Hadoop. The environment configuration before Yarn clustering.
- Use Hadoop without Kerberos authentication enabled Yarn cluster. For detailed configuration, see Using Hadoop. Yarn cluster . If you need to build a Hadoop Yarn cluster without Kerberos enabled, see Building Hadoop without Kerberos Certified Yarn cluster .
- Using Hadoop with Kerberos certification enabled Yarn cluster. For detailed configuration, please refer to Start with Hadoop yarn cluster for Kerberos authentication. If you need to build a Hadoop with Kerberos certification enabled Yarn cluster, see Build it yourself and turn it on Kerberos certified Hadoop Yarn cluster .
Note: iServer also gives you some Spark Cluster Optimized Configuration to improve service performance.
- distributed analyst service Settings
- Associated Server Address: iServer address associated with the distributed analyst service. Defaults to the current iServer, http://localhost:8090/iserver.
- Associated Service Token: User token information with publishing permission in associated server address. You can click the "Generate Token" button to get token.
- JVM Maximum Heap Size: JVM maximum heap memory. The default value is 1024m. If the analysis result data is relatively large, it is recommended to modify the parameter to 4G or larger.
- Process Port: Port of the distributed analyst service process. Default port is 6765.
- Default Analysis Result Output Settings: Support output to local disk, iServer DataStore, and registered database (PostGIS and PGSQL). The default is local disk.
- Publish Analysis Result As Service: Used to set whether to publish analysis result as service. It is checked by default, that is, the analysis results are published as services. When checked, the analysis results can be published as Rest-map service, Rest-data service, and configure associated server address and associated service token. When not checked, the analysis results will not be published as iServer service.
- Click "Save Configuration" to complete the configuration.
You can use the distributed analyst service by clicking the corresponding hyperlink or from the service management page.
After the distributed analyst service is enabled, you can add rich visual rendering effects to the published service by setting the thematic map template .
Configure Distributed Analysis Service Security Settings
- iServer Default: Only users in the ADMIN role can create distributed analysis jobs.
- If users in other roles want to access and use the service, you need to authorize them. The configuration steps are as follows:
-
- After starting the iServer on the primary machine, log in as the system administrator.
- Accessing the distributed analysis administration page (http://supermapiserver:8090/iserver/manager/services/distributedanalyst)
- Set user access authorization for each service instance. Check "distributed analyst/rest", click "Authorize Service", and configure the authorization according to your requirements.