Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.databases.postgresql > #837

Re: How to support more than 1200 client connections

Show all headers | View raw

On Thu, 2 Aug 2018 01:46:26 -0700 (PDT), Sachin Singh
<notsachin@gmail.com> wrote:

>In order to benchmark the API execution per second for
>our cloud product we want to test performance for 1200+ 
>client connections and doing some operations. We are
>using postgres db in system of 32GB RAM. During the 
>test execution after sometime we are seeing db crash 
>because of out of memory issue.
>
>We tried to use pgbouncer to resolve the issue but no luck. 
>
>Do we have any solution to support the above requirement
>for 1 DB node. Or any configuration setting in pgbouncer
>which will help us.

It probably would be better to ask on one of mailing lists:
pgsql-general@postgresql.org
pgsql-performance@postgresql.org


You definitely are making too many simultaneous connections - you need
to limit the number to something reasonable: say a few hundred,
maximum.  How many connections you can support depends heavily on your
server's configuration [and whether pgbouncer is co-resident. I'm not
a real expert at this, which is why you should ask on the lists.]

Remember that Postgresql creates a new process for every connection:
although the program code and DBMS cache (shared_buffers) are shared,
each connection has its own private state, and extra allocations like
work_buffers and temp_buffers, etc. are query dependent.  

Unfortunately, server configuration is a black art: it's easy to make
configuration choices that run well under certain loads and fail
miserably under others.

George

Back to comp.databases.postgresql | Previous | Next — Previous in thread | Next in thread | Find similar

Thread

How to support more than 1200 client connections Sachin Singh <notsachin@gmail.com> - 2018-08-02 01:46 -0700
  Re: How to support more than 1200 client connections Dimitri Fontaine <dim@tapoueh.org> - 2018-08-02 12:25 +0200
    Re: How to support more than 1200 client connections Sachin Singh <notsachin@gmail.com> - 2018-08-02 07:42 -0700
      Re: How to support more than 1200 client connections Dimitri Fontaine <dim@tapoueh.org> - 2018-08-02 17:32 +0200
  Re: How to support more than 1200 client connections George Neuner <gneuner2@comcast.net> - 2018-08-02 06:41 -0400
    Re: How to support more than 1200 client connections Sachin Singh <notsachin@gmail.com> - 2018-08-02 07:51 -0700

csiph-web