Discussion:
Massive insert created 975 WAL segments.. what?
(too old to reply)
Wells Oliver
2012-09-12 00:10:28 UTC
Permalink
We were doing a test and inserted 1.5 million rows. In doing so, postgres
created 974 WAL segments of 16MB apiece. The relevant configuration from my
master's postgresql.conf:

wal_level = hot_standby
archive_mode = on
archive_command = 'test ! -f /mnt/postgresql-logs/%f && cp %p
/mnt/postgresql-logs/%f'
max_wal_senders = 3
wal_keep_segments = 16

So, now I have 16GB of WAL segments, 974 of them. Will postgresql clean
this up? Will it remove these files? Will it create more with big inserts?

What is the best way to manage this?
--
Wells Oliver
***@gmail.com
Ray Stell
2012-09-12 01:45:41 UTC
Permalink
So, now I have 16GB of WAL segments, 974 of them. Will postgresql clean this up? Will it remove these files? Will it create more with big inserts?
What is the best way to manage this?
http://www.postgresql.org/docs/9.2/static/pgarchivecleanup.html

you can use this in conjunction with your backup facility/scipts. Don't want to clean them up until you have a backup, right?
--
Sent via pgsql-admin mailing list (pgsql-***@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
Simon Riggs
2012-09-12 06:14:04 UTC
Permalink
Post by Wells Oliver
We were doing a test and inserted 1.5 million rows. In doing so, postgres
created 974 WAL segments of 16MB apiece. The relevant configuration from my
wal_level = hot_standby
archive_mode = on
archive_command = 'test ! -f /mnt/postgresql-logs/%f && cp %p
/mnt/postgresql-logs/%f'
max_wal_senders = 3
wal_keep_segments = 16
So, now I have 16GB of WAL segments, 974 of them. Will postgresql clean this
up? Will it remove these files? Will it create more with big inserts?
What is the best way to manage this?
These are transaction log files, created by database writes. They
protect you if you crash and also allow replication/backup.

These will be rotated every checkpoint, which by default is 5 minutes.
So they'll be long gone by now.
--
Simon Riggs http://www.2ndQuadrant.com/
PostgreSQL Development, 24x7 Support, Training & Services
--
Sent via pgsql-admin mailing list (pgsql-***@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
Loading...