Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.clipper.visual-objects > #798 > unrolled thread

Re: DBF file grows very huge -Gigabits...

Started by"Jamal" <vodotnet_nospam@yahoo.com>
First post2011-04-11 09:59 -0400
Last post2011-04-11 22:12 -0400
Articles 9 — 5 participants

Back to article view | Back to comp.lang.clipper.visual-objects

This discussion starts older than the indexed window; earlier articles aren't shown. The article labeled Started by below is the oldest one visible, not the original post.


Contents

  Re: DBF file grows very huge -Gigabits... "Jamal" <vodotnet_nospam@yahoo.com> - 2011-04-11 09:59 -0400
    Re: DBF file grows very huge -Gigabits... dlzc <dlzc1@cox.net> - 2011-04-11 09:20 -0700
      Re: DBF file grows very huge -Gigabits... "Jamal" <vodotnet_nospam@yahoo.com> - 2011-04-11 14:18 -0400
        Re: DBF file grows very huge -Gigabits... dlzc <dlzc1@cox.net> - 2011-04-12 07:50 -0700
          Re: DBF file grows very huge -Gigabits... "Jamal" <vodotnet_nospam@yahoo.com> - 2011-04-12 16:52 -0400
            Re: DBF file grows very huge -Gigabits... pete.warshter@gmail.com - 2013-09-08 06:57 -0700
              Re: DBF file grows very huge -Gigabits... Martin <spam@spam.spam> - 2013-09-12 09:06 +0100
    Re: DBF file grows very huge -Gigabits... "Geoff Schaller" <geoffx@softwarexobjectives.com.au> - 2011-04-11 22:29 +0000
      Re: DBF file grows very huge -Gigabits... "Jamal" <vodotnet_nospam@yahoo.com> - 2011-04-11 22:12 -0400

#798 — Re: DBF file grows very huge -Gigabits...

From"Jamal" <vodotnet_nospam@yahoo.com>
Date2011-04-11 09:59 -0400
SubjectRe: DBF file grows very huge -Gigabits...
Message-ID<inv1gk$h33$1@dont-email.me>
Disaster struck again!

This happened again to another user who did not backup his data for at least 
1 month!
The file grew to 4 GIG, the DBF structure was OK, data totally corrupted 
with a lot of blank spaces. It was zipped to to only 14 MB.

It's high time to move away from DBF to SQL but this a big application.

Jamal


"Jamal"  wrote in message news:ikoh77$lpc$1@news.eternal-september.org...

Hi,

It happened to a few locations that a DBF file grew to over 4 GB. Trying to
see if it has any records was a futile attempt as I could not open the file.

What could cause a sudden increase in the file size to that large size when
it should have been 50 MB or so?

I am using the DBFCDX driver and VO 2.8 SP3. It never happened before SP3;
not sure if this has anything to do with it or if it something else.

Jamal 

[toc] | [next] | [standalone]


#801

Fromdlzc <dlzc1@cox.net>
Date2011-04-11 09:20 -0700
Message-ID<d4fec3e2-ce82-408e-a2a7-7bfd38da0bd8@dn9g2000vbb.googlegroups.com>
In reply to#798
Dear Jamal:

On Apr 11, 6:59 am, "Jamal" <vodotnet_nos...@yahoo.com> wrote:
> Disaster struck again!

It will continue to do so, and attacks other languages and
applications as well.

> This happened again to another user who did not
> backup his data for at least 1 month!

If it happened to him three times so far, then you need to up your
rates so that he can afford to make the necessary repairs.  "Fool me
once, shame on you.  Fool me twice, shame on me..."

> The file grew to 4 GIG, the DBF structure was
> OK, data totally corrupted with a lot of blank
> spaces. It was zipped to to only 14 MB.

As long as you patch this for him, he will not be forced to address
the systemic problems he has.

> It's high time to move away from DBF to SQL
> but this a big application.

We've left you with things to check and try, and no answers from you
in almost a month.  If you cannot help us help you...

We are all sorry this is happening, but it is, and will continue to do
so.  It will hurt your reputation with this customer of you continue
only to react.  The problem is not in your choice of language.

His MIS guy is going to have to help pin down the problem, if it is an
IP conflict.  I've known even copy machines attached to the network
(scan to disk) to cause issues (fixed IP assigned in DHCP permissible
range) with similar results.  I had a ghost problem because I had a
network printer decide to start serving DHCP assignments, rather than
the router.

David A. Smith

[toc] | [prev] | [next] | [standalone]


#802

From"Jamal" <vodotnet_nospam@yahoo.com>
Date2011-04-11 14:18 -0400
Message-ID<invgl5$rf$1@dont-email.me>
In reply to#801
Hello David,

Thanks for the reply. This is a different user and runs on a peer-to-peer 
network with "server" running XP Pro.
IPs are assigned automatically by the router.  Nothing in the logs to 
indicate a malfunction or conflicts.
The question is why only one DBF gets affected not other open DBFs at the 
same time which are are equally being updated.
The language may not be the problem; it could be the DBFCDX RDD or some 
other hard disk, spike, etc. I do not know at this point.

Anyway, I'll keep digging to see what might be causing it.

Jamal

"dlzc"  wrote in message 
news:d4fec3e2-ce82-408e-a2a7-7bfd38da0bd8@dn9g2000vbb.googlegroups.com...

Dear Jamal:

On Apr 11, 6:59 am, "Jamal" <vodotnet_nos...@yahoo.com> wrote:
> Disaster struck again!

It will continue to do so, and attacks other languages and
applications as well.

> This happened again to another user who did not
> backup his data for at least 1 month!

If it happened to him three times so far, then you need to up your
rates so that he can afford to make the necessary repairs.  "Fool me
once, shame on you.  Fool me twice, shame on me..."

> The file grew to 4 GIG, the DBF structure was
> OK, data totally corrupted with a lot of blank
> spaces. It was zipped to to only 14 MB.

As long as you patch this for him, he will not be forced to address
the systemic problems he has.

> It's high time to move away from DBF to SQL
> but this a big application.

We've left you with things to check and try, and no answers from you
in almost a month.  If you cannot help us help you...

We are all sorry this is happening, but it is, and will continue to do
so.  It will hurt your reputation with this customer of you continue
only to react.  The problem is not in your choice of language.

His MIS guy is going to have to help pin down the problem, if it is an
IP conflict.  I've known even copy machines attached to the network
(scan to disk) to cause issues (fixed IP assigned in DHCP permissible
range) with similar results.  I had a ghost problem because I had a
network printer decide to start serving DHCP assignments, rather than
the router.

David A. Smith 

[toc] | [prev] | [next] | [standalone]


#826

Fromdlzc <dlzc1@cox.net>
Date2011-04-12 07:50 -0700
Message-ID<91ecb2f8-70e6-4f3f-a54b-bc86ac6e28dc@x3g2000yqj.googlegroups.com>
In reply to#802
Dear Jamal:

On Apr 11, 11:18 am, "Jamal" <vodotnet_nos...@yahoo.com> wrote:
> Hello David,
>
> Thanks for the reply. This is a different user
> and runs on a peer-to-peer network with "server"
> running XP Pro.  IPs are assigned automatically
> by the router.

IP addresses are *accepted* by a number of devices, including ones
that can be set with fixed IP addreses.  These may not be present at
this customer's site.

> Nothing in the logs to indicate a malfunction or
> conflicts.  The question is why only one DBF gets
> affected not other open DBFs at the same time
> which are are equally being updated.

Then it is something in your code (big help).

> The language may not be the problem; it could be
> the DBFCDX RDD or some other hard disk, spike,
> etc. I do not know at this point.
>
> Anyway, I'll keep digging to see what might be
> causing it.

Add a diagnostic database (DD), and alter your record locking
routine.  Push a new record into the DD, and store the alias name, the
record number, the size of the database, datetime, and user name.
That'd tell you just after it had changed.

Maybe wrap the "add a blank record, and lock it for editing" function
with your own function, and push an entry into DD there as well, to
see what is going on.

I'll shut up, as I clearly am not helping.  If the solution is not
embarrassing, let us know when you find it.  Might help posterity...

David A. Smith

[toc] | [prev] | [next] | [standalone]


#832

From"Jamal" <vodotnet_nospam@yahoo.com>
Date2011-04-12 16:52 -0400
Message-ID<io2e3a$u64$1@dont-email.me>
In reply to#826
David,

Thanks for the advice and the comic relief.

The code is straight forward. If it was the code, the other 1000 customers 
would be screaming like hell.

Jamal

"dlzc"  wrote in message 
news:91ecb2f8-70e6-4f3f-a54b-bc86ac6e28dc@x3g2000yqj.googlegroups.com...

Dear Jamal:

On Apr 11, 11:18 am, "Jamal" <vodotnet_nos...@yahoo.com> wrote:
> Hello David,
>
> Thanks for the reply. This is a different user
> and runs on a peer-to-peer network with "server"
> running XP Pro.  IPs are assigned automatically
> by the router.

IP addresses are *accepted* by a number of devices, including ones
that can be set with fixed IP addreses.  These may not be present at
this customer's site.

> Nothing in the logs to indicate a malfunction or
> conflicts.  The question is why only one DBF gets
> affected not other open DBFs at the same time
> which are are equally being updated.

Then it is something in your code (big help).

> The language may not be the problem; it could be
> the DBFCDX RDD or some other hard disk, spike,
> etc. I do not know at this point.
>
> Anyway, I'll keep digging to see what might be
> causing it.

Add a diagnostic database (DD), and alter your record locking
routine.  Push a new record into the DD, and store the alias name, the
record number, the size of the database, datetime, and user name.
That'd tell you just after it had changed.

Maybe wrap the "add a blank record, and lock it for editing" function
with your own function, and push an entry into DD there as well, to
see what is going on.

I'll shut up, as I clearly am not helping.  If the solution is not
embarrassing, let us know when you find it.  Might help posterity...

David A. Smith 

[toc] | [prev] | [next] | [standalone]


#5817

Frompete.warshter@gmail.com
Date2013-09-08 06:57 -0700
Message-ID<8b0c5026-b672-40f5-a935-f85fba8fbd1c@googlegroups.com>
In reply to#832
Work with dbf files with the help of dbf fix

http://www.fixdbffile.com/

[toc] | [prev] | [next] | [standalone]


#5827

FromMartin <spam@spam.spam>
Date2013-09-12 09:06 +0100
Message-ID<OBeYt.260604$tO5.169488@fx05.fr7>
In reply to#5817
Sounds like a peer to peer network isssue

Try using a dedicated server with Advantage Database Server

On 08/09/2013 14:57, pete.warshter@gmail.com wrote:
> Work with dbf files with the help of dbf fix
>
>
>

[toc] | [prev] | [next] | [standalone]


#806

From"Geoff Schaller" <geoffx@softwarexobjectives.com.au>
Date2011-04-11 22:29 +0000
Message-ID<4da380c8$0$33413$c30e37c6@exi-reader.telstra.net>
In reply to#798
Jamal,

Define "big" app. And don't you draw revenue from the application? Isn't 
it important to the user? We all had big apps and we all have made the 
jump to SQL and we are all rather glad we did. (We = about 30 VO users I 
know).

I also remain unconvinced DBF itself is the cause. If it is one table I 
still suspect some errant process in your code. Network and AV oriented 
issues cannot be table specific... I hope you get my point.

But I think you should go SQL.

Geoff

PS - just for info. We have almost finished converting a very old DBF 
app (full of DBxxxx stuff in parallel with DBServer). Here is some scale 
for you:

40+ tables (not including the archive ones)
60+ indexes
90 menu entries to processes and windows
38 browser windows (that also had databrowser replaced with bbrowser)
82 data entry windows (some with 60+ controls - 26 also with sub 
browsers)
Untold dialogs, popups, processes and functions.

I don't know if you classify this as big or not but it is not 
insignificant. Took about 140 hrs to convert fully to SQL (not including 
reports) and we were able to axe around 80,000 lines of redundant code. 
The hrs include the code to uplift and manage the DBF data to SQL and 
various support mechanisms. Jamal, it can be done.


"Jamal" <vodotnet_nospam@yahoo.com> wrote in message 
news:inv1gk$h33$1@dont-email.me:

> Disaster struck again!
>
> This happened again to another user who did not backup his data for at least
> 1 month!
> The file grew to 4 GIG, the DBF structure was OK, data totally corrupted
> with a lot of blank spaces. It was zipped to to only 14 MB.
>
> It's high time to move away from DBF to SQL but this a big application.
>
> Jamal
>
>
> "Jamal"  wrote in message news:ikoh77$lpc$1@news.eternal-september.org...
>
> Hi,
>
> It happened to a few locations that a DBF file grew to over 4 GB. Trying to
> see if it has any records was a futile attempt as I could not open the file.
>
> What could cause a sudden increase in the file size to that large size when
> it should have been 50 MB or so?
>
> I am using the DBFCDX driver and VO 2.8 SP3. It never happened before SP3;
> not sure if this has anything to do with it or if it something else.
>
> Jamal

[toc] | [prev] | [next] | [standalone]


#812

From"Jamal" <vodotnet_nospam@yahoo.com>
Date2011-04-11 22:12 -0400
Message-ID<io0cf4$l1b$1@dont-email.me>
In reply to#806
Geoff,

I sent you an email regarding the SQL conversion.

Jamal

"Geoff Schaller"  wrote in message 
news:4da380c8$0$33413$c30e37c6@exi-reader.telstra.net...

Jamal,

Define "big" app. And don't you draw revenue from the application? Isn't
it important to the user? We all had big apps and we all have made the
jump to SQL and we are all rather glad we did. (We = about 30 VO users I
know).

I also remain unconvinced DBF itself is the cause. If it is one table I
still suspect some errant process in your code. Network and AV oriented
issues cannot be table specific... I hope you get my point.

But I think you should go SQL.

Geoff

PS - just for info. We have almost finished converting a very old DBF
app (full of DBxxxx stuff in parallel with DBServer). Here is some scale
for you:

40+ tables (not including the archive ones)
60+ indexes
90 menu entries to processes and windows
38 browser windows (that also had databrowser replaced with bbrowser)
82 data entry windows (some with 60+ controls - 26 also with sub
browsers)
Untold dialogs, popups, processes and functions.

I don't know if you classify this as big or not but it is not
insignificant. Took about 140 hrs to convert fully to SQL (not including
reports) and we were able to axe around 80,000 lines of redundant code.
The hrs include the code to uplift and manage the DBF data to SQL and
various support mechanisms. Jamal, it can be done.


"Jamal" <vodotnet_nospam@yahoo.com> wrote in message
news:inv1gk$h33$1@dont-email.me:

> Disaster struck again!
>
> This happened again to another user who did not backup his data for at 
> least
> 1 month!
> The file grew to 4 GIG, the DBF structure was OK, data totally corrupted
> with a lot of blank spaces. It was zipped to to only 14 MB.
>
> It's high time to move away from DBF to SQL but this a big application.
>
> Jamal
>
>
> "Jamal"  wrote in message news:ikoh77$lpc$1@news.eternal-september.org...
>
> Hi,
>
> It happened to a few locations that a DBF file grew to over 4 GB. Trying 
> to
> see if it has any records was a futile attempt as I could not open the 
> file.
>
> What could cause a sudden increase in the file size to that large size 
> when
> it should have been 50 MB or so?
>
> I am using the DBFCDX driver and VO 2.8 SP3. It never happened before SP3;
> not sure if this has anything to do with it or if it something else.
>
> Jamal 

[toc] | [prev] | [standalone]


Back to top | Article view | comp.lang.clipper.visual-objects


csiph-web