pgbouncer+pg(fdw)+pg(datanode)分表方案
(环境RHEL6.5,PG9.4.5,pgbouncer1.5.4,libevent2.0.22)
方案架构图如下：
pgbouncer+pg(fdw)+pg(datanode)分表方案架构图
(pgbouncer,PG(FDW)所在的机器为192.168.0.106，PG1所在的机器为192.168.0.108，PG2所在的机器为192.168.0.109)
在192.168.0.106，192.168.0.108，192.168.0.109三台机器上安装并配置PG9.4.5
1 从http://www.postgresql.org/ftp/source/v9.4.5/下载PG9.4.5到Linux的/opt/soft_bak/目录
1.1安装PG所需要的依赖软件包
yum -y install readline-devel zlib zlib-devel openssl openssl-devel gcc make flex bison
1.2解压并安装PG9.4.5
tar zxvf postgresql-9.4.5.tar.gz
cd postgresql-9.4.5
./configure
gmake world
gmake install-world
1.3 更改pgsql文件夹的所属主
chown –R postgres /usr/local/pgsql/
su - postgres
1.4 在/usr/local/pgsql/目录下创建data目录
mkdir data
1.5 初始化PG数据库集群
cd /usr/local/pgsql/bin
./initdb –D ../data
1.6 修改PG的配置文件
修改postgresql.conf
listen_addresses = '*'
port = 5432
在pg_hba.conf文件中添加如下语句
host all all 192.168.0.0/24 trust
1.7启动PG数据库
cd /usr/local/pgsql/bin
./pg_ctl –D ../data start
2在192.168.0.106上安装及配置libevent
2.1从http://libevent.org/下载稳定版本的libevent（libevent-2.0.22-stable.tar.gz）到Linux的/opt/soft_bak/目录下
2.2 解压并安装libevent
tar zxvf libevent-2.0.22-stable.tar.gz
cd /opt/soft_bak/libevent-2.0.22-stable
./configure –prefix=/home/postgres/libevent
make
make install
2.3 在/etc/profile文件中加入如下命令并保存
export LD_LIBRARY_PATH=/home/postgres/libevent/lib:$LD_LIBRARY_PATH
2.4使更改的profile生效
source /etc/profile
3 在192.168.0.106上安装并配置pgbouncer
3.1 从http://pgfoundry.org/projects/pgbouncer下载 pgbouncer(pgbouncer-1.5.4.tar.gz) 到Linux的/opt/soft_bak/目录下
3.2 解压并安装pgbouncer
tar zxvf pgbouncer-1.5.4.tar.gz
cd /opt/soft_bak/pgbouncer-1.5.4
./configure --prefix= /home/postgres/pgbouncer --with- libevent= /home/postgres/libevent
make
make install
3.3配置pgbouncer
在/home/postgres/pgbouncer/目录下创建pgbouncer目录config（postgres用户）
mkdir config
3.4复制pgbouncer配置文件及用户列表文件到/home/postgres/pgbouncer/config
cp /home/postgres/pgbouncer/share/doc/pgbouncer/pgbouncer.ini userlist.txt /home/postgres/pgbouncer/config
3.5配置pgbouncer.ini文件
[databases]
bouncerdb = host=127.0.0.1 port=5432 dbname=bouncerdb user=postgres password=postgres
[pgbouncer]
logfile = /home/postgres/pgbouncer/pgbouncer.log
pidfile = /home/postgres/pgbouncer/pgbouncer.pid
listen_addr = *
listen_port = 1999
auth_type = trust
auth_file = /home/postgres/pgbouncer/config/userlist.txt
admin_users = postgres
stats_users = postgres
pool_mode = transaction
server_reset_query = DISCARD ALL
max_client_conn = 100
default_pool_size = 20
3.6配置用户密码文件userlist.txt
"postgres" "postgres"
4 使用pgbouncer
在pgbouncer pg（fdw）创建bouncerdb，用于连接
create database bouncerdb;
在pgbouncer.ini中配置连接 数据库为bouncerdb
4.1启动pgbouncer
[postgres@rhel65 bin]$ ./pgbouncer -d /home/postgres/pgbouncer/config/pgbouncer.ini
2015-11-18 15:35:13.609 2014 LOG File descriptor limit: 1024 (H:4096), max_client_conn: 100, max fds possible: 130
2015-11-18 15:35:13.610 2014 LOG Stale pidfile, removing
[root@rhel65 config]# ps -ef|grep pgbouncer
postgres 2016 1 0 15:35 ? 00:00:00 ./pgbouncer -d /home/postgres/pgbouncer/config/pgbouncer.ini
root 2020 1221 0 15:37 pts/1 00:00:00 grep pgbouncer
[root@rhel65 config]#
4.2使用pgbouncer连接
[postgres@rhel65 bin]$ ./psql -h 127.0.0.1 -p 1999 pgbouncer
psql (9.4.5, server 1.5.4/bouncer)
Type "help" for help.
pgbouncer=# show help;
NOTICE: Console usage
DETAIL:
SHOW HELP|CONFIG|DATABASES|POOLS|CLIENTS|SERVERS|VERSION
SHOW STATS|FDS|SOCKETS|ACTIVE_SOCKETS|LISTS|MEM
SHOW DNS_HOSTS|DNS_ZONES
SET key = arg
RELOAD
PAUSE [<db>]
RESUME [<db>]
KILL <db>
SUSPEND
SHUTDOWN
SHOW
[postgres@rhel65 bin]$ ./psql -h 127.0.0.1 -p 1999 -U postgres -d bouncerdb
psql (9.4.5)
Type "help" for help.
bouncerdb=#
4.3在数据库192.168.0.108的PG数据库上创建数据库db108并创建测试表schema_db108.user_info108
postgres=# create database db108;
CREATE DATABASE
postgres=# \c db108
You are now connected to database "db108" as user "postgres".
db108=# create schema schema_db108;
CREATE SCHEMA
db108=# create table schema_db108.user_info108(userid int,name text,crt_time timestamp without time zone);
CREATE TABLE
4.4在数据库192.168.0.109的PG数据库上创建数据库db109并创建测试表schema_db109.user_info109
-bash-4.2$ ./psql
psql (9.4.5)
Type "help" for help.
postgres=# create database db109;
CREATE DATABASE
postgres=# \c db109
You are now connected to database "db109" as user "postgres".
db109=# create schema schema_db109;
CREATE SCHEMA
db109=# create table schema_db109.user_info109(userid int,name text,crt_time timestamp without time zone);
CREATE TABLE
db109=#
4.5在192.168.0.106的数据库bouncerdb上创建postgres_fdw
[postgres@rhel65 bin]$ ./psql -h 127.0.0.1 -p 1999 -U postgres -d bouncerdb
psql (9.4.5)
Type "help" for help.
bouncerdb=# create extension postgres_fdw;
CREATE EXTENSION
4.6在192.168.0.106上为192.168.0.108的db108数据库创建外部服务器s108
bouncerdb=# CREATE SERVER s108 FOREIGN DATA WRAPPER postgres_fdw;
CREATE SERVER
bouncerdb=# select * from pg_foreign_server;
srvname | srvowner | srvfdw | srvtype | srvversion | srvacl | srvoptions
---------+----------+--------+---------+------------+--------+------------
s108 | 10 | 16388 | | | |
(1 row)
bouncerdb=# alter server s108 options ( add hostaddr '192.168.0.108', add port '5432', add dbname 'db108');
ALTER SERVER
4.7为用户授权
bouncerdb=# grant usage on foreign server s108 to postgres;
GRANT
bouncerdb=# select * from pg_foreign_server ;
srvname | srvowner | srvfdw | srvtype | srvversion | srvacl | srvoptions
---------+----------+--------+---------+------------+-----------------------+-------------------------------------------------
s108 | 10 | 16388 | | | {postgres=U/postgres} | {hostaddr=192.168.0.108,port=5432,dbname=db108}
(1 row)
4.8为外部服务器s108创建用户映射
bouncerdb=# create user mapping for postgres server s108 options(user 'postgres',password 'postgres');
CREATE USER MAPPING
4.9为108的数据库db108中的表schema_db108.user_info108(userid int,name text,crt_time timestamp without time zone)创建外部表
bouncerdb=# create foreign table ft_user_info108(userid int,name text,crt_time timestamp without time zone)
server s108 options(schema_name 'schema_db108',table_name 'user_info108');
CREATE FOREIGN TABLE
4.10通过外部表向表中插入数据；
bouncerdb=# insert into ft_user_info108 (userid,name,crt_time)
bouncerdb-# select generate_series(1,100000),'abcdef',clock_timestamp();
INSERT 0 100000
bouncerdb=# select * from ft_user_info108 limit 5;
userid | name | crt_time
--------+--------+----------------------------
1 | abcdef | 2015-11-18 17:08:52.489583
2 | abcdef | 2015-11-18 17:08:52.491158
3 | abcdef | 2015-11-18 17:08:52.491548
4 | abcdef | 2015-11-18 17:08:52.491899
5 | abcdef | 2015-11-18 17:08:52.492339
(5 rows)
4.11在108的db108数据库中查看数据：
db108=# select * from schema_db108.user_info108 limit 5 ;
userid | name | crt_time
--------+--------+----------------------------
1 | abcdef | 2015-11-18 17:08:52.489583
2 | abcdef | 2015-11-18 17:08:52.491158
3 | abcdef | 2015-11-18 17:08:52.491548
4 | abcdef | 2015-11-18 17:08:52.491899
5 | abcdef | 2015-11-18 17:08:52.492339
(5 rows)
5.1在192.168.0.106上为192.168.0.109的数据库db109创建外部服务器s109
bouncerdb=# CREATE SERVER s109 FOREIGN DATA WRAPPER postgres_fdw;
CREATE SERVER
bouncerdb=# select * from pg_foreign_server;
srvname | srvowner | srvfdw | srvtype | srvversion | srvacl | srvoptions
---------+----------+--------+---------+------------+-----------------------+-------------------------------------------------
s108 | 10 | 16388 | | | {postgres=U/postgres} | {hostaddr=192.168.0.108,port=5432,dbname=db108}
s109 | 10 | 16388 | | | |
(2 rows)
bouncerdb=# alter server s109 options ( add hostaddr '192.168.0.109', add port '5432', add dbname 'db109');
ALTER SERVER
5.2为用户授权
bouncerdb=# grant usage on foreign server s109 to postgres;
GRANT
bouncerdb=# select * from pg_foreign_server ;
srvname | srvowner | srvfdw | srvtype | srvversion | srvacl | srvoptions
---------+----------+--------+---------+------------+-----------------------+-------------------------------------------------
s108 | 10 | 16388 | | | {postgres=U/postgres} | {hostaddr=192.168.0.108,port=5432,dbname=db108}
s109 | 10 | 16388 | | | {postgres=U/postgres} | {hostaddr=192.168.0.109,port=5432,dbname=db109}
(2 rows)
5.3创建用户映射
bouncerdb=# create user mapping for postgres server s109 options(user 'postgres',password 'postgres');
CREATE USER MAPPING
5.4为109的数据库db109中的表schema_db109.user_info109(userid int,name text,crt_time timestamp without time zone)创建外部表
bouncerdb=# create foreign table ft_user_info109(userid int,name text,crt_time timestamp without time zone)
server s109 options(schema_name 'schema_db109',table_name 'user_info109');
CREATE FOREIGN TABLE
5.5通过外部表向表中插入数据；
bouncerdb=# insert into ft_user_info109 (userid,name,crt_time)
select generate_series(1,100000),'abcdef',clock_timestamp();
INSERT 0 100000
bouncerdb=# select * from ft_user_info109 limit 5;
userid | name | crt_time
--------+--------+----------------------------
1 | abcdef | 2015-11-18 17:18:06.431162
2 | abcdef | 2015-11-18 17:18:06.43275
3 | abcdef | 2015-11-18 17:18:06.43334
4 | abcdef | 2015-11-18 17:18:06.433895
5 | abcdef | 2015-11-18 17:18:06.434497
(5 rows)
5.6在192.168.0.109的db109中查看数据：
db109=# select * from schema_db109.user_info109 limit 5;
userid | name | crt_time
--------+--------+----------------------------
1 | abcdef | 2015-11-18 17:18:06.431162
2 | abcdef | 2015-11-18 17:18:06.43275
3 | abcdef | 2015-11-18 17:18:06.43334
4 | abcdef | 2015-11-18 17:18:06.433895
5 | abcdef | 2015-11-18 17:18:06.434497
(5 rows)