Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.user > #189072 > unrolled thread

Cumulative internet data transfer {up AND down}

Back to article view | Back to linux.debian.user

Contents

  Cumulative internet data transfer {up AND down} Richard Owlett <rowlett@cloud85.net> - 2017-11-17 16:00 +0100
    Re: Cumulative internet data transfer {up AND down} Roberto C. Sánchez <roberto@debian.org> - 2017-11-17 16:00 +0100
      Re: Cumulative internet data transfer {up AND down} Richard Owlett <rowlett@cloud85.net> - 2017-11-17 17:30 +0100
    Re: Cumulative internet data transfer {up AND down} Michael Milliman <michael.e.milliman@gmail.com> - 2017-11-17 16:10 +0100
      Re: Cumulative internet data transfer {up AND down} <tomas@tuxteam.de> - 2017-11-17 16:20 +0100
        Re: Cumulative internet data transfer {up AND down} Richard Owlett <rowlett@cloud85.net> - 2017-11-17 18:10 +0100
          Re: Cumulative internet data transfer {up AND down} Michael Milliman <michael.e.milliman@gmail.com> - 2017-11-18 03:20 +0100
    Re: Cumulative internet data transfer {up AND down} Stefan Monnier <monnier@iro.umontreal.ca> - 2017-11-17 17:20 +0100
    Re: Cumulative internet data transfer {up AND down} Eric S Fraga <e.fraga@ucl.ac.uk> - 2017-11-17 17:30 +0100
      Re: Cumulative internet data transfer {up AND down} Miles Fidelman <mfidelman@meetinghouse.net> - 2017-11-17 20:20 +0100
    Re: Cumulative internet data transfer {up AND down} David Wright <deblis@lionunicorn.co.uk> - 2017-11-17 17:50 +0100
      Re: Cumulative internet data transfer {up AND down} Richard Owlett <rowlett@cloud85.net> - 2017-11-17 22:20 +0100
        Re: Cumulative internet data transfer {up AND down} David Wright <deblis@lionunicorn.co.uk> - 2017-11-18 16:20 +0100
          Re: Cumulative internet data transfer {up AND down} Richard Owlett <rowlett@cloud85.net> - 2017-11-18 22:10 +0100
    Re: Cumulative internet data transfer {up AND down} Felipe Salvador <felipe.salvador@gmail.com> - 2017-11-17 19:00 +0100
      Re: Cumulative internet data transfer {up AND down} Richard Owlett <rowlett@cloud85.net> - 2017-11-17 22:20 +0100
    Re: Cumulative internet data transfer {up AND down} Igor Cicimov <icicimov@gmail.com> - 2017-11-18 09:10 +0100
      Re: Cumulative internet data transfer {up AND down} Michael Milliman <michael.e.milliman@gmail.com> - 2017-11-18 14:10 +0100
        Re: Cumulative internet data transfer {up AND down} David Wright <deblis@lionunicorn.co.uk> - 2017-11-18 16:20 +0100

#189072 — Cumulative internet data transfer {up AND down}

I'm interested in investigating cumulative data to/from the internet for 
selected interval ranging from an hour to a week.
My only connection is a device connected thru a USB port.
My web search turned up only discussion of measuring throughput RATE.
Suggestion of keyword(s) for search?
Suggested software?
TIA

[toc] | [next] | [standalone]

#189073

On Fri, Nov 17, 2017 at 08:52:00AM -0600, Richard Owlett wrote:
> I'm interested in investigating cumulative data to/from the internet for
> selected interval ranging from an hour to a week.
> My only connection is a device connected thru a USB port.
> My web search turned up only discussion of measuring throughput RATE.
> Suggestion of keyword(s) for search?
> Suggested software?

I am not sure if this fits your needs, but I usually fire up iftop
inside a screen session and leave it running all the time.  It gives me
a nice general cumulative total of up/down traffic and also gives me a
current snapshot (e.g., I run it on my network's router so I can see
which device might be monopolizing the connection).

Regards,

-Roberto

-- 
Roberto C. Sánchez

[toc] | [prev] | [next] | [standalone]

#189079

On 11/17/2017 08:54 AM, Roberto C. Sánchez wrote:
> On Fri, Nov 17, 2017 at 08:52:00AM -0600, Richard Owlett wrote:
>> I'm interested in investigating cumulative data to/from the internet for
>> selected interval ranging from an hour to a week.
>> My only connection is a device connected thru a USB port.
>> My web search turned up only discussion of measuring throughput RATE.
>> Suggestion of keyword(s) for search?
>> Suggested software?
>
> I am not sure if this fits your needs, but I usually fire up iftop
> inside a screen session and leave it running all the time.  It gives me
> a nice general cumulative total of up/down traffic and also gives me a
> current snapshot (e.g., I run it on my network's router so I can see
> which device might be monopolizing the connection).
>

Not sure if it is relevant. Looking at man-page at 
https://manpages.debian.org/stretch/iftop/iftop.8.en.html , it's purpose 
is to monitor instantaneous speed not cumulative data transferred.

*HOWEVER* The "See Also" section has potentially valuable links.

tcpdump(8) may supply raw data for a script which would meet requirements.

driftnet(1) may literally display answer to and one underlying question 
that prompted this thread.

Thank you.

[toc] | [prev] | [next] | [standalone]

#189074

[Multipart message — attachments visible in raw view] — view raw

AIR, iptables will do that. It has been a long time since I have looked at
iptables, but I seem to remember that it will keep those kinds of
statistics and it will do it on a per-interface level, all you have to do
is set it up to monitor the interface connected to the internet.

73s de WB5VQX

On Nov 17, 2017 08:52, "Richard Owlett" <rowlett@cloud85.net> wrote:

> I'm interested in investigating cumulative data to/from the internet for
> selected interval ranging from an hour to a week.
> My only connection is a device connected thru a USB port.
> My web search turned up only discussion of measuring throughput RATE.
> Suggestion of keyword(s) for search?
> Suggested software?
> TIA
>
>
>

[toc] | [prev] | [next] | [standalone]

#189075

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Fri, Nov 17, 2017 at 09:00:05AM -0600, Michael Milliman wrote:
> AIR, iptables will do that. It has been a long time since I have looked at
> iptables, but I seem to remember that it will keep those kinds of
> statistics and it will do it on a per-interface level, all you have to do
> is set it up to monitor the interface connected to the internet.
> 
> 73s de WB5VQX
> 
> On Nov 17, 2017 08:52, "Richard Owlett" <rowlett@cloud85.net> wrote:
> 
> > I'm interested in investigating cumulative data to/from the internet for
> > selected interval ranging from an hour to a week.

Does something like this work for you?

  tomas@trotzki:~$ ip -stats -h link show wlan0
  3: wlan0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DORMANT group default qlen 1000
      link/ether 84:3a:4b:20:44:40 brd ff:ff:ff:ff:ff:ff
      RX: bytes  packets  errors  dropped overrun mcast   
      4.52M      6.73k    0       0       0       0       
      TX: bytes  packets  errors  dropped carrier collsns 
      617k       5.32k    0       0       0       0       

NOTE: the option -h is the one responsible for the suffixes (k, M).
     Like in "human".

HTH
- -- tomás
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.12 (GNU/Linux)

iEYEARECAAYFAloO/P4ACgkQBcgs9XrR2kYDUgCfZMGhfBQFWgKMEO6jNOQFCokG
ojAAn32n70iROdvVg9h0SWAeYzvZNuYy
=FZK3
-----END PGP SIGNATURE-----

[toc] | [prev] | [next] | [standalone]

#189083

On 11/17/2017 09:15 AM, tomas@tuxteam.de wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> On Fri, Nov 17, 2017 at 09:00:05AM -0600, Michael Milliman wrote:
>> AIR, iptables will do that. It has been a long time since I have looked at
>> iptables, but I seem to remember that it will keep those kinds of
>> statistics and it will do it on a per-interface level, all you have to do
>> is set it up to monitor the interface connected to the internet.
>>
>> 73s de WB5VQX
>>
>> On Nov 17, 2017 08:52, "Richard Owlett" <rowlett@cloud85.net> wrote:
>>
>>> I'm interested in investigating cumulative data to/from the internet for
>>> selected interval ranging from an hour to a week.
>
> Does something like this work for you?

I don't know.
Using <https://manpages.debian.org/stretch/iproute2/ip.8.en.html> I was 
not able to parse the given example.
The output shown for the example hints at "Yes".
I'll have to investigate the references under "See Also".

A reference WITHOUT a link referred to "IP Command reference ip-cref.ps".
A search lead to <http://linux-ip.net/gl/ip-cref/> which EXPLICITLY 
stated "It is not a tutorial or user's guide."
But that's what I need. Where should I look?

TIA

>
>   tomas@trotzki:~$ ip -stats -h link show wlan0
>   3: wlan0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DORMANT group default qlen 1000
>       link/ether 84:3a:4b:20:44:40 brd ff:ff:ff:ff:ff:ff
>       RX: bytes  packets  errors  dropped overrun mcast
>       4.52M      6.73k    0       0       0       0
>       TX: bytes  packets  errors  dropped carrier collsns
>       617k       5.32k    0       0       0       0
>
> NOTE: the option -h is the one responsible for the suffixes (k, M).
>      Like in "human".
>

[toc] | [prev] | [next] | [standalone]

#189100

[Multipart message — attachments visible in raw view] — view raw

On 11/17/2017 11:05 AM, Richard Owlett wrote:
> On 11/17/2017 09:15 AM, tomas@tuxteam.de wrote:
>> -----BEGIN PGP SIGNED MESSAGE-----
>> Hash: SHA1
>>
>> On Fri, Nov 17, 2017 at 09:00:05AM -0600, Michael Milliman wrote:
>>> AIR, iptables will do that. It has been a long time since I have 
>>> looked at
>>> iptables, but I seem to remember that it will keep those kinds of
>>> statistics and it will do it on a per-interface level, all you have 
>>> to do
>>> is set it up to monitor the interface connected to the internet.
>>>
>>> 73s de WB5VQX
>>>
>>> On Nov 17, 2017 08:52, "Richard Owlett" <rowlett@cloud85.net> wrote:
>>>
>>>> I'm interested in investigating cumulative data to/from the 
>>>> internet for
>>>> selected interval ranging from an hour to a week.
>>
>> Does something like this work for you?
>
> I don't know.
> Using <https://manpages.debian.org/stretch/iproute2/ip.8.en.html> I 
> was not able to parse the given example.
> The output shown for the example hints at "Yes".
> I'll have to investigate the references under "See Also".
>
> A reference WITHOUT a link referred to "IP Command reference ip-cref.ps".
> A search lead to <http://linux-ip.net/gl/ip-cref/> which EXPLICITLY 
> stated "It is not a tutorial or user's guide."
> But that's what I need. Where should I look?
>
After a little looking around, I found this tutorial that on the surface 
of it seems to be pretty comprehensive.

    http://homes.di.unimi.it/sisop/qemu/iptables-tutorial.pdf

AIR, iptables will keep statistics on each rule, and that you can design 
a rule to handle all traffic going out and another one to handle 
incomming traffic, by looking at the statistics associated with each 
rule, you will have the information you need.
> TIA
>
>>
>>   tomas@trotzki:~$ ip -stats -h link show wlan0
>>   3: wlan0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state 
>> UP mode DORMANT group default qlen 1000
>>       link/ether 84:3a:4b:20:44:40 brd ff:ff:ff:ff:ff:ff
>>       RX: bytes  packets  errors  dropped overrun mcast
>>       4.52M      6.73k    0       0       0       0
>>       TX: bytes  packets  errors  dropped carrier collsns
>>       617k       5.32k    0       0       0       0
>>
>> NOTE: the option -h is the one responsible for the suffixes (k, M).
>>      Like in "human".
>>
>

[toc] | [prev] | [next] | [standalone]

#189077

> I'm interested in investigating cumulative data to/from the internet for
> selected interval ranging from an hour to a week.
> My only connection is a device connected thru a USB port.
> My web search turned up only discussion of measuring throughput RATE.
> Suggestion of keyword(s) for search?
> Suggested software?

I'd suggest you try `darkstat`.

It's a fairly lightweight package that's easy to install/setup and which
can give you that kind of information (tho it might not be as flexible
as you like in terms of choices of time interval, and it might be more
detailed than you're requesting in terms of origin/destination).


        Stefan

[toc] | [prev] | [next] | [standalone]

#189078

[Multipart message — attachments visible in raw view] — view raw

On Friday, 17 Nov 2017 at 08:52, Richard Owlett wrote:
> I'm interested in investigating cumulative data to/from the internet
> for selected interval ranging from an hour to a week.
> My only connection is a device connected thru a USB port.
> My web search turned up only discussion of measuring throughput RATE.
> Suggestion of keyword(s) for search?

I use vnstat for daily/weekly/monthly stats.  Can also give you typical
use by hour of day.

-- 
Eric S Fraga via Emacs 27.0.50

[toc] | [prev] | [next] | [standalone]

#189090

On 11/17/17 9:20 AM, Eric S Fraga wrote:

> On Friday, 17 Nov 2017 at 08:52, Richard Owlett wrote:
>> I'm interested in investigating cumulative data to/from the internet
>> for selected interval ranging from an hour to a week.
>> My only connection is a device connected thru a USB port.
>> My web search turned up only discussion of measuring throughput RATE.
>> Suggestion of keyword(s) for search?
> I use vnstat for daily/weekly/monthly stats.  Can also give you typical
> use by hour of day.
>
Ditto to vnstat

Miles Fidelman

-- 
In theory, there is no difference between theory and practice.
In practice, there is.  .... Yogi Berra

[toc] | [prev] | [next] | [standalone]

#189081

On Fri 17 Nov 2017 at 08:52:00 (-0600), Richard Owlett wrote:
> I'm interested in investigating cumulative data to/from the internet
> for selected interval ranging from an hour to a week.
> My only connection is a device connected thru a USB port.
> My web search turned up only discussion of measuring throughput RATE.
> Suggestion of keyword(s) for search?
> Suggested software?
> TIA

Some routers collect traffic statistics which can be reset and
read at any time, typically through their web interfaces.
(You don't say what's hanging off the USB port.)

Cheers,
David.

[toc] | [prev] | [next] | [standalone]

#189093

On 11/17/2017 10:39 AM, David Wright wrote:
> On Fri 17 Nov 2017 at 08:52:00 (-0600), Richard Owlett wrote:
>> I'm interested in investigating cumulative data to/from the internet
>> for selected interval ranging from an hour to a week.
>> My only connection is a device connected thru a USB port.
>> My web search turned up only discussion of measuring throughput RATE.
>> Suggestion of keyword(s) for search?
>> Suggested software?
>> TIA
>
> Some routers collect traffic statistics which can be reset and
> read at any time, typically through their web interfaces.
> (You don't say what's hanging off the USB port.)
>

  current "month". ISP *EXPLICITLY* states the numbers 'approximate' 
<lol> ;/

[toc] | [prev] | [next] | [standalone]

#189107

On Fri 17 Nov 2017 at 15:11:23 (-0600), Richard Owlett wrote:
> On 11/17/2017 10:39 AM, David Wright wrote:
> >On Fri 17 Nov 2017 at 08:52:00 (-0600), Richard Owlett wrote:
> >>I'm interested in investigating cumulative data to/from the internet
> >>for selected interval ranging from an hour to a week.
> >>My only connection is a device connected thru a USB port.
> >>My web search turned up only discussion of measuring throughput RATE.
> >>Suggestion of keyword(s) for search?
> >>Suggested software?
> >>TIA
> >
> >Some routers collect traffic statistics which can be reset and
> >read at any time, typically through their web interfaces.
> >(You don't say what's hanging off the USB port.)
> >
> 
>  current "month". ISP *EXPLICITLY* states the numbers 'approximate'
> <lol> ;/

Presumably there's something between your USB port and your ISP?

Yes, I wouldn't expect anything better than daily stats from the
ISP itself. Just monthly is poor.

Cheers,
David.

[toc] | [prev] | [next] | [standalone]

#189109

On 11/18/2017 09:15 AM, David Wright wrote:
> On Fri 17 Nov 2017 at 15:11:23 (-0600), Richard Owlett wrote:
>> On 11/17/2017 10:39 AM, David Wright wrote:
>>> On Fri 17 Nov 2017 at 08:52:00 (-0600), Richard Owlett wrote:
>>>> I'm interested in investigating cumulative data to/from the internet
>>>> for selected interval ranging from an hour to a week.
>>>> My only connection is a device connected thru a USB port.
>>>> My web search turned up only discussion of measuring throughput RATE.
>>>> Suggestion of keyword(s) for search?
>>>> Suggested software?
>>>> TIA
>>>
>>> Some routers collect traffic statistics which can be reset and
>>> read at any time, typically through their web interfaces.
>>> (You don't say what's hanging off the USB port.)
>>>
>>
>>  current "month". ISP *EXPLICITLY* states the numbers 'approximate'
>> <lol> ;/
>
> Presumably there's something between your USB port and your ISP?

A T-Mobile WiFi Hotspot with wifi capability turned off. I.E. just being 
used as a modem. It's identified on Mate's top panel as an "Ethernet 
wired connection". I routinely use ~1.2 GB of a 2 GB data cap - was 
formerly a happy user of a 56k modem.


>
> Yes, I wouldn't expect anything better than daily stats from the
> ISP itself. Just monthly is poor.
>
> Cheers,
> David.
>
>

[toc] | [prev] | [next] | [standalone]

#189087

On Fri, Nov 17, 2017 at 08:52:00AM -0600, Richard Owlett wrote:
> I'm interested in investigating cumulative data to/from the internet
> for selected interval ranging from an hour to a week.
> My only connection is a device connected thru a USB port.
> My web search turned up only discussion of measuring throughput RATE.
> Suggestion of keyword(s) for search?
> Suggested software?
> TIA

I'm using pmacct in order to produce periodic (say every if-up/if-down) report
about cumulative data in each session.


http://www.pmacct.net/

Regards

-- 
Felipe Salvador

[toc] | [prev] | [next] | [standalone]

#189094

On 11/17/2017 11:57 AM, Felipe Salvador wrote:
> On Fri, Nov 17, 2017 at 08:52:00AM -0600, Richard Owlett wrote:
>> I'm interested in investigating cumulative data to/from the internet
>> for selected interval ranging from an hour to a week.
>> My only connection is a device connected thru a USB port.
>> My web search turned up only discussion of measuring throughput RATE.
>> Suggestion of keyword(s) for search?
>> Suggested software?
>> TIA
>
> I'm using pmacct in order to produce periodic (say every if-up/if-down) report
> about cumulative data in each session.
>
>
> http://www.pmacct.net/
>

A possibility. Will have to browse latter this weekend :>

[toc] | [prev] | [next] | [standalone]

#189104

[Multipart message — attachments visible in raw view] — view raw

ntop

On 18/11/2017 1:52 am, "Richard Owlett" <rowlett@cloud85.net> wrote:

> I'm interested in investigating cumulative data to/from the internet for
> selected interval ranging from an hour to a week.
> My only connection is a device connected thru a USB port.
> My web search turned up only discussion of measuring throughput RATE.
> Suggestion of keyword(s) for search?
> Suggested software?
> TIA
>
>
>

[toc] | [prev] | [next] | [standalone]

#189105

[Multipart message — attachments visible in raw view] — view raw

That's true. I didn't think about that...I almost never reboot the system I
use as a firewall, but you are right, reboot will kill any stats
accumulated by iptables.

73s de WB5VQX

On Nov 18, 2017 02:07, "Igor Cicimov" <icicimov@gmail.com> wrote:

> ntop
>
> On 18/11/2017 1:52 am, "Richard Owlett" <rowlett@cloud85.net> wrote:
>
>> I'm interested in investigating cumulative data to/from the internet for
>> selected interval ranging from an hour to a week.
>> My only connection is a device connected thru a USB port.
>> My web search turned up only discussion of measuring throughput RATE.
>> Suggestion of keyword(s) for search?
>> Suggested software?
>> TIA
>>
>>
>>

[toc] | [prev] | [next] | [standalone]

#189106

On Sat 18 Nov 2017 at 07:02:51 (-0600), Michael Milliman wrote:
> That's true. I didn't think about that...I almost never reboot the system I
> use as a firewall, but you are right, reboot will kill any stats
> accumulated by iptables.

Just log them every minute from a cron job.

Cheers,
David.

[toc] | [prev] | [standalone]

Back to top | Article view | linux.debian.user

csiph-web