Re: I have a quick question about exporting or dumping a database.

Path	csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!news.glorb.com!border3.nntp.dca.giganews.com!Xl.tags.giganews.com!border1.nntp.dca.giganews.com!nntp.giganews.com!local2.nntp.dca.giganews.com!news.giganews.com.POSTED!not-for-mail
NNTP-Posting-Date	Fri, 10 Aug 2012 15:24:04 -0500
Date	Fri, 10 Aug 2012 13:20:53 -0700
From	jeff <thexder1@gmail.com>
User-Agent	Mozilla/5.0 (X11; Linux x86_64; rv:10.0.6esrpre) Gecko/20120717 Thunderbird/10.0.6
MIME-Version	1.0
Newsgroups	comp.databases.berkeley-db
Subject	Re: I have a quick question about exporting or dumping a database.
References	<nIGdnZep5Ibg7rnNnZ2dnUVZ5uadnZ2d@giganews.com> <87mx22sijl.fsf@mid.deneb.enyo.de>
In-Reply-To	<87mx22sijl.fsf@mid.deneb.enyo.de>
Content-Type	text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding	7bit
Message-ID	<5ZKdnSB-04t58LjNnZ2dnUVZ5sCdnZ2d@giganews.com> (permalink)
Lines	43
X-Usenet-Provider	http://www.giganews.com
X-Trace	sv3-AqD4SvCIP6vnbirLXDmj8GOXA8pvPllL5a96XIIhY+ameGvX2CCPlLgJa31vcNCfYGntwZutCO3nuRL!VhKAHLePHrGdg+XnIGmQwXmU1tiHofQlSyG2KDy2Zsz1zYai34NMqZf0OkYHCf2CeY2jylP66AfD
X-Complaints-To	abuse@giganews.com
X-DMCA-Notifications	http://www.giganews.com/info/dmca.html
X-Abuse-and-DMCA-Info	Please be sure to forward a copy of ALL headers
X-Abuse-and-DMCA-Info	Otherwise we will be unable to process your complaint properly
X-Postfilter	1.3.40
X-Original-Bytes	3258
Xref	csiph.com comp.databases.berkeley-db:14

Show key headers only | View raw

On 08/10/2012 11:34 AM, Florian Weimer wrote:
> * jeff:
>
>> I have a server running Citadel which uses Berkeley DB on the back end
>> and I am trying to transfer the VM that is running it to a different
>> server and when I just copy the virtual hard drive and load it the
>> database is corrupt and cannot be fixed.
>
> This is odd.  Are you copying a volume which is being written to?  If
> you copy a read-only snapshot, it should work.
>

Yes it is being written to right now because it is production. I will 
see about scheduling some downtime for this.

>> 1. How long should it take to dump a database? Mine is about 7.4 GB
>> with about 200 MB of log files right now.
>
> That mostly depends on fragmentation.  About an hour would not be
> entirely unheard of.

Only an hour, that is not a problem but the dumps that I have attempted 
have taken 8-10 hours and either never finished or came up with an error.

>
>> 2. What is the best way to transfer the database to a different
>> system? I would prefer a method that does not involve downtime as this
>> is a production email system.
>
> You need to make the database read-only at one point, otherwise some
> writes will be lost.  And if you change versions of Berkeley DB, you
> have to perform environment recovery, which also requires downtime.

I have reason to believe that I am pushing the limits of the hard drive 
IO even though the drives I am using are not exactly slow, but the 
results of trying to copy does not seem to be effected by other virtual 
machines running on that system. From other tests that I have done I 
have verified that memory, and CPU are not being used much at all, but 
the IO on the hard drive, mostly waiting for random seeks might be 
causing problems. I have also noticed what appears to be some possible 
corruption with other VMs which from what I can tell is affected by the 
drive IO since moving to the new system with a larger RAID array seems 
to have fixed the problems.

Back to comp.databases.berkeley-db | Previous | Next — Previous in thread | Next in thread | Find similar

Thread

I have a quick question about exporting or dumping a database. jeff <thexder1@gmail.com> - 2012-08-09 19:32 -0700
  Re: I have a quick question about exporting or dumping a database. Florian Weimer <fw@deneb.enyo.de> - 2012-08-10 20:34 +0200
    Re: I have a quick question about exporting or dumping a database. jeff <thexder1@gmail.com> - 2012-08-10 13:20 -0700
      Re: I have a quick question about exporting or dumping a database. Florian Weimer <fw@deneb.enyo.de> - 2012-08-10 22:42 +0200

csiph-web