Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.java.programmer > #11830

Re: How do I scp extremely large files

From Robert Klemme <shortcutter@googlemail.com>
Newsgroups comp.lang.java.programmer
Subject Re: How do I scp extremely large files
Date 2012-02-07 22:50 +0100
Message-ID <9pdklmF1pmU2@mid.individual.net> (permalink)
References <a7abf79b-a373-4f52-9c1c-6c24d509fbcb@o13g2000vbf.googlegroups.com> <7f3940d0-cc97-466d-87bf-7a420e53df5c@gi10g2000vbb.googlegroups.com> <c3594e5c-4f7d-4964-ba02-f59ed0145765@n12g2000yqb.googlegroups.com>

Show all headers | View raw


On 02/06/2012 09:54 PM, Mike wrote:
> On Feb 6, 2:54 am, Robert Klemme<shortcut...@googlemail.com>  wrote:
>> I am not sure I understand your question properly.  Any Java library
>> which implements sftp or scp's protocols will have a means to copy
>> remote files or at least open remote files and obtain an InputStream
>> or Channel, from which you can read in chunks and store data locally.
>>
>> If you need to do the transfer on a regularly basis maybe rsync is
>> better than cooking your own version of it.

> Thanks for the response Robert. rsync is not an option.

Why?

>  I cannot use
> any outside software, open-source or otherwise.

Why aren't you able to use "outside software"?  Or did you mean you are 
not allowed to?

> I believe you stated
> just what I need to do... obtain a channel to read chunks from and
> store locally.  I'm just a little fuzzy on the details.  Haven't done
> much with channels or inputStreams for that matter.

IO is pretty basic - in any language.  I am surprised you haven't been 
exposed to it yet.  For the details please follow Lew's advice / links.

Kind regards

	robert

Back to comp.lang.java.programmer | Previous | NextPrevious in thread | Next in thread | Find similar | Unroll thread


Thread

How do I scp extremely large files Mike <mikesmith813@gmail.com> - 2012-02-04 18:03 -0800
  Re: How do I scp extremely large files Robert Klemme <shortcutter@googlemail.com> - 2012-02-05 23:54 -0800
    Re: How do I scp extremely large files Mike <mikesmith813@gmail.com> - 2012-02-06 12:54 -0800
      Re: How do I scp extremely large files Lew <lewbloch@gmail.com> - 2012-02-06 17:21 -0800
        Re: How do I scp extremely large files Mike <mikesmith813@gmail.com> - 2012-02-08 16:29 -0800
          Re: How do I scp extremely large files Daniel Pitts <newsgroup.nospam@virtualinfinity.net> - 2012-02-08 21:19 -0800
      Re: How do I scp extremely large files Eric Sosman <esosman@ieee-dot-org.invalid> - 2012-02-07 08:12 -0500
        Re: How do I scp extremely large files Arne Vajhøj <arne@vajhoej.dk> - 2012-02-07 17:02 -0500
          Re: How do I scp extremely large files Eric Sosman <esosman@ieee-dot-org.invalid> - 2012-02-07 20:47 -0500
            Re: How do I scp extremely large files Arne Vajhøj <arne@vajhoej.dk> - 2012-02-07 20:56 -0500
      Re: How do I scp extremely large files Robert Klemme <shortcutter@googlemail.com> - 2012-02-07 22:50 +0100
      Re: How do I scp extremely large files Arne Vajhøj <arne@vajhoej.dk> - 2012-02-07 17:12 -0500
  Re: How do I scp extremely large files Arne Vajhøj <arne@vajhoej.dk> - 2012-02-07 17:09 -0500
  Re: How do I scp extremely large files Arne Vajhøj <arne@vajhoej.dk> - 2012-02-07 17:10 -0500
  Re: How do I scp extremely large files Roedy Green <see_website@mindprod.com.invalid> - 2012-02-08 22:33 -0800
  Re: How do I scp extremely large files Roedy Green <see_website@mindprod.com.invalid> - 2012-02-08 22:37 -0800

csiph-web