You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Masahiko Sawada cb988b04d0 Reduce memory block size for decoded tuple storage to 8kB. ... Commit a4ccc1cef introduced the Generation Context and modified the logical decoding process to use a Generation Context with a fixed block size of 8MB for storing tuple data decoded during logical decoding (i.e., rb->tup_context). Several reports have indicated that the logical decoding process can be terminated due to out-of-memory (OOM) situations caused by excessive memory usage in rb->tup_context. This issue can occur when decoding a workload involving several concurrent transactions, including a long-running transaction that modifies tuples. By design, the Generation Context does not free a memory block until all chunks within that block are released. Consequently, if tuples modified by the long-running transaction are stored across multiple memory blocks, these blocks remain allocated until the long-running transaction completes, leading to substantial memory fragmentation. The memory usage during logical decoding, tracked by rb->size, does not account for memory fragmentation, resulting in potentially much higher memory consumption than the value of the logical_decoding_work_mem parameter. Various improvement strategies were discussed in the relevant thread. This change reduces the block size of the Generation Context used in rb->tup_context from 8MB to 8kB. This modification significantly decreases the likelihood of substantial memory fragmentation occurring and is relatively straightforward to backport. Performance testing across multiple platforms has confirmed that this change will not introduce any performance degradation that would impact actual operation. Backport to all supported branches. Reported-by: Alex Richman, Michael Guissine, Avi Weinberg Reviewed-by: Amit Kapila, Fujii Masao, David Rowley Tested-by: Hayato Kuroda, Shlok Kyal Discussion: https://postgr.es/m/CAD21AoBTY1LATZUmvSXEssvq07qDZufV4AF-OHh9VD2pC0VY2A%40mail.gmail.com Backpatch-through: 12		2 years ago
..
backend	Reduce memory block size for decoded tuple storage to 8kB.	2 years ago
bin	vacuumdb: Schema-qualify operator in catalog query's WHERE clause.	2 years ago
common	Fix overread in JSON parsing errors for incomplete byte sequences	2 years ago
fe_utils	Clean up assorted failures under clang's -fsanitize=undefined checks.	4 years ago
include	For inplace update durability, make heap_update() callers wait.	2 years ago
interfaces	Parse libpq's "keepalives" option more like other integer options.	2 years ago
makefiles	…
pl	Translation updates	2 years ago
port	Clean up Windows-specific mutex code in libpq and ecpglib.	2 years ago
template	On NetBSD, force dynamic symbol resolution at postmaster start.	4 years ago
test	Correctly identify which EC members are computable at a plan node.	2 years ago
timezone	Update time zone data files to tzdata release 2024a.	2 years ago
tools	Remove incorrect function import from pgindent	2 years ago
tutorial	Doc: sync src/tutorial/basics.source with SGML documentation.	4 years ago
.gitignore	…
DEVELOPERS	…
Makefile	…
Makefile.global.in	Suppress macOS warnings about duplicate libraries in link commands.	3 years ago
Makefile.shlib	Stop using "-multiply_defined suppress" on macOS.	3 years ago
nls-global.mk	…