GreenPlum数据库安装

时间:2024-09-05 16:33:50

第一章    文档概述

本文描述适用于Greenplum4.0以上版本的安装操作。所涉及到的操作系统相关参数调整,主要针对Redhat Linux操作系统。

第二章    安装介质

  操作系统:CentOS release 6.5 (Final)。

  Greenplum安装版本:greenplum-db-4.3.8.1-build-2-RHEL5-x86_64.zip

第三章    安装前准备

3.1、网络规划

建议在Greenplum数据库系统安装之前,把网络配置规划好

3.2、存储空间规划

首先,需要评估目标数据库数据所需要的空间容量。建议了解客户搭建Greenplum数据库的具体应用。

举例:估计数据库所需空间为U,数据库需要启用Mirror,磁盘阵列总可用空间为D(Raid之后)。空间规划服务和如下公式:

2 * U + U / 3 = D * 70%

磁盘空间D平均分配到各个Segment服务器上。

Master需要相应的空间。使用服务器内置硬盘的计算方式类似。

3.3、数据库实例规划

规划每个Segment服务器上建立的数据库实例的数量(instance数量),通常建议每2个CPU内核(core)对应一个数据库实例

第四章    操作系统设置

4.1 、设置主机名

  修改各台主机的主机名称。一般建议的命名规则如下:

Master:mdw

Standby Master:smdw

Segment Host:sdw1、sdw2……sdwn

  修改操作:

、hostname mdw
、修改 /etc/sysconfig/network 配置文件中的hostname

4.2 、设置hosts解析(所有节点,Master和Segments)

通常Master和Standby Master主机都配置外部IP和内部IP。Segment主机可只配置内部IP。所有主机的hosts文件内容必须保持一致

127.0.0.1  mdw  localhost localhost.localdomain localhost4 localhost4.localdomain4
192.168.1.201 mdw
192.168.1.202 sdw1
192.168.1.203 sdw2

4.3、安装依赖软件(所有节点,Master和Segments)

yum -y install ed rsync coreutils glib2 lrzsz sysstat e4fsprogs xfsprogs ntp readline-devel zlib zlib-devel openssl openssl-devel pam-devel libxml2-devel libxslt-devel python-devel tcl-devel gcc make smartmontools flex bison OpenIPMI-tools openldap openldap-devel logrotate python-py gcc-c++ apr-devel libcurl-devel bzip2-devel libyaml-devel openssh-clients

  【涉及机器】:所有服务器关闭防火墙

service iptables stop
chkconfig iptables off
service ip6tables stop
chkconfig ip6tables off

4.4、配置NTP时间同步(所有节点)

使用root用户进行操作,涉及所有服务器。

Greenplum推荐使用NTP(Network Time Protocol)同步各台主机的时钟。建议设置一*立的时钟服务器。例如时钟服务器IP为10.6.220.20

4.4.1、Master服务器配置与时钟服务器同步。

  修改配置文件/etc/ntp.conf后,启动ntpd服务。举例:配置文件增加:

server 10.6.220.20

  启动NTP服务:

service ntpd start;chkconfig ntpd on

  #如果没有独立的时钟服务器,则应该以Master服务器做内部的时钟服务器,Master就可以不用修改ntp.conf配置文件,直接启动ntpd服务即可

4.4.2、所有Segment服务器优先与Master服务器同步,其次与Standby Master服务器同步。

  修改配置文件/etc/ntp.conf后,重启ntpd服务。配置文件增加:

server mdw prefer
server smdw

  启动服务:

service ntpd start;chkconfig ntpd on

4.4.3、Standby Master服务器优先与Master服务器,其次与始终服务器同步。

  修改配置文件/etc/ntp.conf后,重启ntpd服务。配置文件增加:

server mdw prefer
server 10.6.220.20

  启动服务:

service ntpd start;chkconfig ntpd on

  #如果没有独立的时钟服务器,第二行不用配置。

4.5 修改系统参数(Redhat)

  【涉及机器】:所有服务器;使用root用户进行修改,重启后生效。

4.5.1、修改系统参数/etc/sysctl.conf

kernel.shmmax =
kernel.shmmni =
kernel.shmall =
kernel.sem =
kernel.sysrq =
kernel.core_uses_pid =
kernel.msgmnb =
kernel.msgmax =
net.ipv4.tcp_syncookies =
net.ipv4.ip_forward =
net.ipv4.conf.default.accept_source_route =
net.ipv4.tcp_tw_recycle =
net.ipv4.tcp_max_syn_backlog =
net.ipv4.conf.all.arp_filter =
net.ipv4.conf.default.arp_filter =
net.core.netdev_max_backlog =
vm.overcommit_memory =
kernel.msgmni =
net.ipv4.ip_local_port_range =

4.5.2、修改系统参数/etc/security/limits.conf

  Linux PAM中 pam_limits.so 的配置文件

* soft nofile
* hard nofile
* soft nproc
* hard nproc

4.5.3、修改磁盘预读参数(所有节点,Master和Segments)

通过修改预读扇区数,可以有效磁盘的读性能,特别是顺序读,GPDB数据库要求最小磁盘扇区数为16384,建议设置为65535

在参数文件/etc/rc.d/rc.local中增加;

blockdev --setra  /dev/sd

4.5.4、修改配置/boot/grub/menu.lst

Linux默认的I/O调度模式是CFQ,通常需要修改I/O调度策略为deadline,可以通过下面的命令查看I/O调度策略。

cat /sys/block/sda/queue/scheduler
#临时修改
echo deadline > /sys/block/sda/queue/scheduler

  如果永久修改I/O调度策略,则需要修改/boot/grub/menu.lst文件,在“kernel*”行后面增加elevator=deadline。

4.5.5、修改配置/etc/sysconfig/i18n

  增加RC_LANG=en_US.UTF-8

4.6、启动IPMI服务

(IPMI(Intelligent Platform Management Interface)即智能平台管理接口是使硬件管理具备“智能化”的新一代通用接口标准。如果没有安装相关服务,建议安装)

service ipmi start;chkconfig ipmi on

第五章    配置用户和数据目录

5.1、创建gpadmin用户(所有节点,Master和Segments)

[root@mdw ~]# groupadd -g  gpadmin
[root@mdw ~]# useradd -u -g gpadmin gpadmin
[root@mdw ~]# passwd gpadmin
Changing password for user gpadmin.
New password:
BAD PASSWORD: is too simple
Retype new password:
passwd: all authentication tokens updated successfully.

5.2、创建软件安装目录(所有节点,Master和Segments)

[root@mdw ~]# mkdir -p /gpdb/app
[root@mdw ~]# chown -R gpadmin:gpadmin /gpdb/

  /gpdb目录为GPDB的BASE目录,/gpdb/app为GPDB的HOME目录。

第六章    安装Greenplum

6.1、上传并解压GPDB安装文件(仅Master节点)

[gpadmin@mdw gpdb]$ unzip greenplum-db-4.3.8.1-build--RHEL5-x86_64.zip
Archive: greenplum-db-4.3.8.1-build--RHEL5-x86_64.zip
inflating: README_INSTALL
inflating: greenplum-db-4.3.8.1-build--RHEL5-x86_64.bin
[gpadmin@mdw gpdb]$ ll
total
drwxr-xr-x. gpadmin gpadmin Mar : app
-rwxr-xr-x. gpadmin gpadmin Apr greenplum-db-4.3.8.1-build--RHEL5-x86_64.bin
-rw-r--r--. gpadmin gpadmin Mar : greenplum-db-4.3.8.1-build--RHEL5-x86_64.zip
-rw-r--r--. gpadmin gpadmin Apr README_INSTALL

6.2、运行安装文件

gpadmin@mdw gpdb]$ ./greenplum-db-4.3.8.1-build--RHEL5-x86_64.bin 

下面是许可信息后面的内容
********************************************************************************
You must read and accept the Pivotal Database license agreement
before installing
******************************************************************************** *** IMPORTANT INFORMATION - PLEASE READ CAREFULLY *** PIVOTAL GREENPLUM DATABASE END USER LICENSE AGREEMENT IMPORTANT - READ CAREFULLY: This Software contains computer programs and
other proprietary material and information, the use of which is subject to
and expressly conditioned upon acceptance of this End User License
Agreement ("EULA"). This EULA is a legally binding document between you (meaning the person or
the entity that obtained the Software under the terms and conditions of
this EULA, is agreeing to be bound by the terms and conditions of this
EULA, and is referred to below as "You" or "Customer") and Pivotal (meaning
(i) Pivotal Software, Inc., if Customer is located in the United States;
and (ii) the local Pivotal sales subsidiary, if Customer is located in a
country outside the United States in which Pivotal has a local sales
subsidiary; and (iii) GoPivotal International Limited, if Customer is
located in a country outside the United States in which Pivotal does not
have a local sales subsidiary (in each case, referred to herein as
"Pivotal"). Unless Customer has entered into a written and separately
signed agreement with Pivotal that is currently in effect with respect to
the license of the Software and provision of Support Services and
Subscription Services, this EULA governs Customer's use of the Software and
the provision of Support Services and Subscription Services. Capitalized
terms have the meaning stated in the EULA.
............
必须输入YES才可继续安装。
********************************************************************************
Do you accept the Pivotal Database license agreement? [yes|no]
******************************************************************************** yes 默认GPDB的安装路径为/usr/local/greenplum-db-**,确认需要输入YES,如果需要安装到其他路径,直接输入要按照的路径即可
********************************************************************************
Provide the installation path for Greenplum Database or press ENTER to
accept the default installation path: /usr/local/greenplum-db-4.3.8.1
******************************************************************************** /gpdb/app ********************************************************************************
Install Greenplum Database into </gpdb/app>? [yes|no]
******************************************************************************** yes Extracting product to /gpdb/app

  安装完成;安装完成会在/gpdb/app目录下生成以下文件。

[gpadmin@mdw gpdb]$ cd app
[gpadmin@mdw app]$ ll
total
drwxr-xr-x. gpadmin gpadmin Apr bin
drwxr-xr-x. gpadmin gpadmin Apr demo
drwxr-xr-x. gpadmin gpadmin Apr docs
drwxr-xr-x. gpadmin gpadmin Apr etc
drwxr-xr-x. gpadmin gpadmin Apr ext
-rw-r--r--. gpadmin gpadmin Apr GPDB-LICENSE.txt
-rw-rw-r--. gpadmin gpadmin Mar : greenplum_path.sh
drwxr-xr-x. gpadmin gpadmin Apr include
drwxr-xr-x. gpadmin gpadmin Apr lib
-rw-r--r--. gpadmin gpadmin Apr LICENSE.thirdparty
drwxr-xr-x. gpadmin gpadmin Apr sbin
drwxr-xr-x. gpadmin gpadmin Apr share

6.3、设置GPDB环境变量(仅Master节点)

安装完成后修改gpadmin用户home的~/.bashrc配置文件,增加

source /gpdb/app/greenplum_path.sh

6.4、配置hostname文件(用于建立多机信任)

  编辑节点信息文件(仅Master节点)。为了管理方便,在app目录下创建config文件夹,将节点信息文件存放在该目录下。需要创建两个文件,其中一个文件(hostlist)存放所有节点信息,seg_host文件只存放segment节点信息

[gpadmin@mdw app]$ mkdir config
[gpadmin@mdw app]$ cd config
[gpadmin@mdw config]$ cat hostlist
mdw
sdw1
sdw2
[gpadmin@mdw config]$ cat seg_host
sdw1
sdw2

6.5、打通所有节点直接的互信(仅Master节点)

GreenPlum数据库提供gpssh-exkeys工具来打开所有节点直接的互信关系,非常方便

[gpadmin@mdw config]$ gpssh-exkeys -f hostlist
[STEP of ] create local ID and authorize on local host
... /home/gpadmin/.ssh/id_rsa file exists ... key generation skipped [STEP of ] keyscan all hosts and update known_hosts file [STEP of ] authorize current user on remote hosts
... send to mdw
... send to sdw1
***
*** Enter password for sdw1:
... send to sdw2 [STEP of ] determine common authentication file content [STEP of ] copy authentication files to all remote hosts
... finished key exchange with mdw
... finished key exchange with sdw1
... finished key exchange with sdw2 [INFO] completed successfully

   互信配置完成后,可以通过gpssh工具来验证互信是否成功配置,-e参数后面的是远程登录节点后执行的命令。通过gpssh工具可以在所有节点运行同一命令,非常方便(后续会用到)。

[gpadmin@mdw config]$  gpssh -f /gpdb/app/config/hostlist -e 'pwd'
[ mdw] pwd
[ mdw] /home/gpadmin
[sdw2] pwd
[sdw2] /home/gpadmin
[sdw1] pwd
[sdw1] /home/gpadmin

6.6、Segment节点安装GreenPlum软件(仅Master节点)

通过gpseginstall命令安装segment软件,使用-u参数指定安装用户,-p参数指定安装用户的密码,这样将不再需要交互式输入密码。

[gpadmin@mdw config]$ gpseginstall -f hostlist -u gpadmin -p li0924
:::: gpseginstall:mdw:gpadmin-[INFO]:-Installation Info:
link_name greenplum-db
binary_path /gpdb/app
binary_dir_location /gpdb
binary_dir_name app
:::: gpseginstall:mdw:gpadmin-[INFO]:-check cluster password access
:::: gpseginstall:mdw:gpadmin-[INFO]:-de-duplicate hostnames
:::: gpseginstall:mdw:gpadmin-[INFO]:-master hostname: mdw
:::: gpseginstall:mdw:gpadmin-[INFO]:-rm -f /gpdb/app.tar; rm -f /gpdb/app.tar.gz
:::: gpseginstall:mdw:gpadmin-[INFO]:-cd /gpdb; tar cf app.tar app
:::: gpseginstall:mdw:gpadmin-[INFO]:-gzip /gpdb/app.tar
:::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: mkdir -p /gpdb
:::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: rm -rf /gpdb/app
:::: gpseginstall:mdw:gpadmin-[INFO]:-scp software to remote location
:::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: gzip -f -d /gpdb/app.tar.gz
:::: gpseginstall:mdw:gpadmin-[INFO]:-md5 check on remote location
:::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: cd /gpdb; tar xf app.tar
:::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: rm -f /gpdb/app.tar
:::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: cd /gpdb; rm -f greenplum-db; ln -fs app greenplum-db
:::: gpseginstall:mdw:gpadmin-[INFO]:-rm -f /gpdb/app.tar.gz
:::: gpseginstall:mdw:gpadmin-[INFO]:-version string on master: gpssh version 4.3.8.1 build
:::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: . /gpdb/greenplum-db/./greenplum_path.sh; /gpdb/greenplum-db/./bin/gpssh --version
:::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: . /gpdb/app/greenplum_path.sh; /gpdb/app/bin/gpssh --version
:::: gpseginstall:mdw:gpadmin-[INFO]:-SUCCESS -- Requested commands completed

  Segment节点会根据Master节点的安装路径安装GreenPlum软件,目录结构和Master一模一样。

6.7、 Segment节点配置环境变量(所有Segment节点)

修改gpadmin用户home的~/.bashrc配置文件,增加

source /gpdb/app/greenplum_path.sh

第七章    数据库的初始化

7.1、创建数据文件存放目录(所有节点)

[root@mdw ~]# mkdir -p /data/gpdata/master
[root@mdw ~]# chown -R gpadmin:gpadmin /data
[root@sdw1 ~]# mkdir -p /data/gpdata/primary
[root@sdw1 ~]# mkdir -p /data/gpdata/mirror
[root@sdw1 ~]# chown -R gpadmin:gpadmin /data

  本案例Master节点的数据文件存放在/data/gpdata/master目录,Segment节点的主数据文件存放在/data/gpdata/primary目录;镜像数据文件放在/data/gpdata/mirror目录

7.2、配置时间同步(所有节点)

本案例Master节点的服务器配置为NTP的服务端,Segment节点为NTP的客户端。Master节点使用root用户通过gpssh工具批量调用date命令对比各服务器的时间是否一致。

[gpadmin@mdw ~]$ gpssh -f /gpdb/app/config/hostlist
Note: command history unsupported on this machine ...
=> date
[sdw1] Wed Mar :: CST
[ mdw] Wed Mar :: CST
[sdw2] Wed Mar :: CST

7.3、系统检查(仅Master节点)

在初始化数据库之前,需要进行先决条件检查,主要检查磁盘I/O能力、网络带宽、内核参数、limit等条件是否满足GreenPlum数据库的要求。

参数配置检查

[gpadmin@mdw ~]$ gpcheck -f /gpdb/app/config/hostlist -m mdw
:::: gpcheck:mdw:gpadmin-[INFO]:-dedupe hostnames
:::: gpcheck:mdw:gpadmin-[INFO]:-Detected platform: Generic Linux Cluster
:::: gpcheck:mdw:gpadmin-[INFO]:-generate data on servers
:::: gpcheck:mdw:gpadmin-[INFO]:-copy data files from servers
:::: gpcheck:mdw:gpadmin-[INFO]:-delete remote tmp files
:::: gpcheck:mdw:gpadmin-[INFO]:-Using gpcheck config file: /gpdb/greenplum-db/./etc/gpcheck.cnf
:::: gpcheck:mdw:gpadmin-[ERROR]:-GPCHECK_ERROR host(None): utility will not check all settings when run as non-root user
:::: gpcheck:mdw:gpadmin-[INFO]:-gpcheck completing...

参数性能检查

    参数配置检查
gpcheck -f /gpdb/app/config/hostlist -m mdw -s smdw
核对并修改下你感应系统参数。
性能检查
2.1 网络性能检查
gpcheckperf -f /gpdb/app/config/hostlist -r N -d /tmp > checknetwork.out
2.2 磁盘性能检查
gpcheckperf -f /gpdb/app/config/hostlist -r ds -D -d /data/gpdata/primary -d /data/gpdata/mirror r > checkio.out
检查磁盘IO的目标目录是数据库的数据文件目录,测试工具会写入系统内存的两倍大小的数据量。

7.4、创建GreenPlum数据库的参数文件(仅Master节点)

在$GPHOME/docs目录下,存在一些参数文件的模版,可以通过这些模版快速配置一些常用的参数文件。比如GreenPlum数据库的参数文件可以参考$GPHOME/docs/cli_help/gpconfigs/gpinitsystem_config文件。

[gpadmin@mdw ~]$ cp $GPHOME/docs/cli_help/gpconfigs/gpinitsystem_config /gpdb/app/config/gpinitsystem_config

  配置参数文件gpinitsystem_config

[gpadmin@mdw config]$ cat gpinitsystem_config
# FILE NAME: gpinitsystem_config # Configuration file needed by the gpinitsystem ################################################
#### REQUIRED PARAMETERS
################################################ #### Name of this Greenplum system enclosed in quotes.
ARRAY_NAME="EMC Greenplum DW" #### Naming convention for utility-generated data directories.
SEG_PREFIX=gpseg #### Base number by which primary segment port numbers
#### are calculated.
PORT_BASE= #### File system location(s) where primary segment data directories
#### will be created. The number of locations in the list dictate
#### the number of primary segments that will get created per
#### physical host (if multiple addresses for a host are listed in
#### the hostfile, the number of segments will be spread evenly across
#### the specified interface addresses).
declare -a DATA_DIRECTORY=(/data/gpdata/primary) #### OS-configured hostname or IP address of the master host.
MASTER_HOSTNAME=mdw #### File system location where the master data directory
#### will be created.
MASTER_DIRECTORY=/data/gpdata/master #### Port number for the master instance.
MASTER_PORT= #### Shell utility used to connect to remote hosts.
TRUSTED_SHELL=ssh #### Maximum log file segments between automatic WAL checkpoints.
CHECK_POINT_SEGMENTS= #### Default server-side character set encoding.
ENCODING=UNICODE ################################################
#### OPTIONAL MIRROR PARAMETERS
################################################ #### Base number by which mirror segment port numbers
#### are calculated.
#MIRROR_PORT_BASE= #### Base number by which primary file replication port
#### numbers are calculated.
#REPLICATION_PORT_BASE= #### Base number by which mirror file replication port
#### numbers are calculated.
#MIRROR_REPLICATION_PORT_BASE= #### File system location(s) where mirror segment data directories
#### will be created. The number of mirror locations must equal the
#### number of primary locations as specified in the
#### DATA_DIRECTORY parameter.
#declare -a MIRROR_DATA_DIRECTORY=(/data/gpdata/mirror) ################################################
#### OTHER OPTIONAL PARAMETERS
################################################ #### Create a database of this name after initialization.
#DATABASE_NAME=name_of_database #### Specify the location of the host address file here instead of
#### with the the -h option of gpinitsystem.
#MACHINE_LIST_FILE=/home/gpadmin/gpconfigs/hostfile_gpinitsystem

7.5、GreenPlum数据库初始化(仅Master节点)

接下来就可以使用gpinitsystem工具初始化数据库了,一些参数文件中没有设置的重要参数,在初始化数据库时会被使用默认值,可以在初始化之后根据需求及主机的配置进行设置。GreenPlum数据库的参数也分为静态参数和动态参数,静态参数需重启数据库才能生效,动态参数不需要重启数据库即可生效。

若需要standby master;可以-s 主机名即可;也可以后续使用gpinitsystem添加。这个后续文章讲解

[gpadmin@mdw config]$ gpinitsystem -c gpinitsystem_config -h seg_host
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Checking configuration parameters, please wait...
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Reading Greenplum configuration file gpinitsystem_config
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Locale has not been set in gpinitsystem_config, will set to default value
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Locale set to en_US.utf8
:::: gpinitsystem:mdw:gpadmin-[INFO]:-No DATABASE_NAME set, will exit following template1 updates
:::: gpinitsystem:mdw:gpadmin-[INFO]:-MASTER_MAX_CONNECT not set, will set to default value
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Checking configuration parameters, Completed
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Commencing multi-home checks, please wait...
..
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Configuring build for standard array
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Commencing multi-home checks, Completed
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Building primary segment instance array, please wait...
..
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Checking Master host
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Checking new segment hosts, please wait...
.:::: gpinitsystem:mdw:gpadmin-[WARN]:-----------------------------------------------------------
:::: gpinitsystem:mdw:gpadmin-[WARN]:-Host sdw1 is assigned as localhost in /etc/hosts
:::: gpinitsystem:mdw:gpadmin-[WARN]:-This will cause segment->master communication failures
:::: gpinitsystem:mdw:gpadmin-[WARN]:-Remove sdw1 from local host line in /etc/hosts
:::: gpinitsystem:mdw:gpadmin-[WARN]:-----------------------------------------------------------
.:::: gpinitsystem:mdw:gpadmin-[WARN]:-----------------------------------------------------------
:::: gpinitsystem:mdw:gpadmin-[WARN]:-Host sdw2 is assigned as localhost in /etc/hosts
:::: gpinitsystem:mdw:gpadmin-[WARN]:-This will cause segment->master communication failures
:::: gpinitsystem:mdw:gpadmin-[WARN]:-Remove sdw2 from local host line in /etc/hosts
:::: gpinitsystem:mdw:gpadmin-[WARN]:----------------------------------------------------------- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Checking new segment hosts, Completed
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum Database Creation Parameters
:::: gpinitsystem:mdw:gpadmin-[INFO]:---------------------------------------
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Master Configuration
:::: gpinitsystem:mdw:gpadmin-[INFO]:---------------------------------------
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Master instance name = EMC Greenplum DW
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Master hostname = mdw
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Master port =
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Master instance dir = /data/gpdata/master/gpseg-
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Master LOCALE = en_US.utf8
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum segment prefix = gpseg
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Master Database =
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Master connections =
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Master buffers = 128000kB
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Segment connections =
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Segment buffers = 128000kB
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Checkpoint segments =
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Encoding = UNICODE
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Postgres param file = Off
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Initdb to be used = /gpdb/greenplum-db/./bin/initdb
:::: gpinitsystem:mdw:gpadmin-[INFO]:-GP_LIBRARY_PATH is = /gpdb/greenplum-db/./lib
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Ulimit check = Passed
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Array host connect type = Single hostname per node
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Master IP address [] = ::
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Master IP address [] = 192.168.1.201
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Master IP address [] = fe80::20c:29ff:fe30:f99e
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Standby Master = Not Configured
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Primary segment # =
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Total Database segments =
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Trusted shell = ssh
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Number segment hosts =
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Mirroring config = OFF
:::: gpinitsystem:mdw:gpadmin-[INFO]:----------------------------------------
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum Primary Segment Configuration
:::: gpinitsystem:mdw:gpadmin-[INFO]:----------------------------------------
:::: gpinitsystem:mdw:gpadmin-[INFO]:-sdw1 /data/gpdata/primary/gpseg0
:::: gpinitsystem:mdw:gpadmin-[INFO]:-sdw2 /data/gpdata/primary/gpseg1
Continue with Greenplum creation Yy/Nn>
y
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Building the Master instance database, please wait...
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Starting the Master in admin mode
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Commencing parallel build of primary segment instances
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Spawning parallel processes batch [], please wait...
..
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Waiting for parallel processes batch [], please wait...
.............................
:::: gpinitsystem:mdw:gpadmin-[INFO]:------------------------------------------------
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Parallel process exit status
:::: gpinitsystem:mdw:gpadmin-[INFO]:------------------------------------------------
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Total processes marked as completed =
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Total processes marked as killed =
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Total processes marked as failed =
:::: gpinitsystem:mdw:gpadmin-[INFO]:------------------------------------------------
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Deleting distributed backout files
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Removing back out file
:::: gpinitsystem:mdw:gpadmin-[INFO]:-No errors generated from parallel processes
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Restarting the Greenplum instance in production mode
:::: gpstop:mdw:gpadmin-[INFO]:-Starting gpstop with args: -a -i -m -d /data/gpdata/master/gpseg-
:::: gpstop:mdw:gpadmin-[INFO]:-Gathering information and validating the environment...
:::: gpstop:mdw:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information
:::: gpstop:mdw:gpadmin-[INFO]:-Obtaining Segment details from master...
:::: gpstop:mdw:gpadmin-[INFO]:-Greenplum Version: 'postgres (Greenplum Database) 4.3.8.1 build 1'
:::: gpstop:mdw:gpadmin-[INFO]:-There are connections to the database
:::: gpstop:mdw:gpadmin-[INFO]:-Commencing Master instance shutdown with mode='immediate'
:::: gpstop:mdw:gpadmin-[INFO]:-Master host=mdw
:::: gpstop:mdw:gpadmin-[INFO]:-Commencing Master instance shutdown with mode=immediate
:::: gpstop:mdw:gpadmin-[INFO]:-Master segment instance directory=/data/gpdata/master/gpseg-
:::: gpstop:mdw:gpadmin-[INFO]:-Attempting forceful termination of any leftover master process
:::: gpstop:mdw:gpadmin-[INFO]:-Terminating processes for segment /data/gpdata/master/gpseg-
:::: gpstart:mdw:gpadmin-[INFO]:-Starting gpstart with args: -a -d /data/gpdata/master/gpseg-
:::: gpstart:mdw:gpadmin-[INFO]:-Gathering information and validating the environment...
:::: gpstart:mdw:gpadmin-[INFO]:-Greenplum Binary Version: 'postgres (Greenplum Database) 4.3.8.1 build 1'
:::: gpstart:mdw:gpadmin-[INFO]:-Greenplum Catalog Version: ''
:::: gpstart:mdw:gpadmin-[INFO]:-Starting Master instance in admin mode
:::: gpstart:mdw:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information
:::: gpstart:mdw:gpadmin-[INFO]:-Obtaining Segment details from master...
:::: gpstart:mdw:gpadmin-[INFO]:-Setting new master era
:::: gpstart:mdw:gpadmin-[INFO]:-Master Started...
:::: gpstart:mdw:gpadmin-[INFO]:-Shutting down master
:::: gpstart:mdw:gpadmin-[INFO]:-Commencing parallel segment instance startup, please wait...
....
:::: gpstart:mdw:gpadmin-[INFO]:-Process results...
:::: gpstart:mdw:gpadmin-[INFO]:-----------------------------------------------------
:::: gpstart:mdw:gpadmin-[INFO]:- Successful segment starts =
:::: gpstart:mdw:gpadmin-[INFO]:- Failed segment starts =
:::: gpstart:mdw:gpadmin-[INFO]:- Skipped segment starts (segments are marked down in configuration) =
:::: gpstart:mdw:gpadmin-[INFO]:-----------------------------------------------------
:::: gpstart:mdw:gpadmin-[INFO]:-
:::: gpstart:mdw:gpadmin-[INFO]:-Successfully started of segment instances
:::: gpstart:mdw:gpadmin-[INFO]:-----------------------------------------------------
:::: gpstart:mdw:gpadmin-[INFO]:-Starting Master instance mdw directory /data/gpdata/master/gpseg-
:::: gpstart:mdw:gpadmin-[INFO]:-Command pg_ctl reports Master mdw instance active
:::: gpstart:mdw:gpadmin-[INFO]:-No standby master configured. skipping...
:::: gpstart:mdw:gpadmin-[INFO]:-Database successfully started
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Completed restart of Greenplum instance in production mode
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Loading gp_toolkit...
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Scanning utility log file for any warning messages
:::: gpinitsystem:mdw:gpadmin-[WARN]:-*******************************************************
:::: gpinitsystem:mdw:gpadmin-[WARN]:-Scan of log file indicates that some warnings or errors
:::: gpinitsystem:mdw:gpadmin-[WARN]:-were generated during the array creation
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Please review contents of log file
:::: gpinitsystem:mdw:gpadmin-[INFO]:-/home/gpadmin/gpAdminLogs/gpinitsystem_20180329.log
:::: gpinitsystem:mdw:gpadmin-[INFO]:-To determine level of criticality
:::: gpinitsystem:mdw:gpadmin-[INFO]:-These messages could be from a previous run of the utility
:::: gpinitsystem:mdw:gpadmin-[INFO]:-that was called today!
:::: gpinitsystem:mdw:gpadmin-[WARN]:-*******************************************************
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum Database instance successfully created
:::: gpinitsystem:mdw:gpadmin-[INFO]:-------------------------------------------------------
:::: gpinitsystem:mdw:gpadmin-[INFO]:-To complete the environment configuration, please
:::: gpinitsystem:mdw:gpadmin-[INFO]:-update gpadmin .bashrc file with the following
:::: gpinitsystem:mdw:gpadmin-[INFO]:-. Ensure that the greenplum_path.sh file is sourced
:::: gpinitsystem:mdw:gpadmin-[INFO]:-. Add "export MASTER_DATA_DIRECTORY=/data/gpdata/master/gpseg-1"
:::: gpinitsystem:mdw:gpadmin-[INFO]:- to access the Greenplum scripts for this instance:
:::: gpinitsystem:mdw:gpadmin-[INFO]:- or, use -d /data/gpdata/master/gpseg- option for the Greenplum scripts
:::: gpinitsystem:mdw:gpadmin-[INFO]:- Example gpstate -d /data/gpdata/master/gpseg-
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Script log file = /home/gpadmin/gpAdminLogs/gpinitsystem_20180329.log
:::: gpinitsystem:mdw:gpadmin-[INFO]:-To remove instance, run gpdeletesystem utility
:::: gpinitsystem:mdw:gpadmin-[INFO]:-To initialize a Standby Master Segment for this Greenplum instance
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Review options for gpinitstandby
:::: gpinitsystem:mdw:gpadmin-[INFO]:-------------------------------------------------------
:::: gpinitsystem:mdw:gpadmin-[INFO]:-The Master /data/gpdata/master/gpseg-/pg_hba.conf post gpinitsystem
:::: gpinitsystem:mdw:gpadmin-[INFO]:-has been configured to allow all hosts within this new
:::: gpinitsystem:mdw:gpadmin-[INFO]:-array to intercommunicate. Any hosts external to this
:::: gpinitsystem:mdw:gpadmin-[INFO]:-new array must be explicitly added to this file
:::: gpinitsystem:mdw:gpadmin-[INFO]:-Refer to the Greenplum Admin support guide which is
:::: gpinitsystem:mdw:gpadmin-[INFO]:-located in the /gpdb/greenplum-db/./docs directory
:::: gpinitsystem:mdw:gpadmin-[INFO]:-------------------------------------------------------