very large data files

[Ingo Klöcker]

On Friday 11 July 2008, Thiago Macieira wrote:
> Jason Harris wrote:
> >Hi,
> >
> >On Fri, Jul 11, 2008 at 7:52 AM, Thiago Macieira <thiago at kde.org> 
wrote:
> >> But you shouldn't be asking how big a file is for serving from our
> >> servers. You should be asking how big a download can be before
> >> it's not acceptable for users.
> >>
> >> I'd say 75 MB is at the limit already. Bigger than that and people
> >> will not download it. You'd have to provide it in smaller chunks,
> >> to be downloaded as needed.
> >
> >This wouldn't be a required download, but an extra add-on.  So only
> >the people who wanted more than 100,000 stars would download it.
> >Hence GHNS.
> >
> >Anyway, it sounds like there won't be a huge problem if I put up
> > 32MB and 3GB files for download at kde.org.
>
> Ah, ok, now I understand it. I had thought it was meant to be used by
> all KStars users.
>
> Anyways, I'd still recommend that you break it up on smaller files,
> even if each chunk by itself is unusable. Some people are still in
> slow connections.
>
> BTW, kio_ftp supports resuming a download and I think our FTP server
> supports that too. But we can't be sure for all mirrors.

Maybe that's a stupid question, but what about distributing the files 
via a torrent. This way we would have little load on our servers and 
resuming and mirroring comes for free. Moreover, fetching 3 GB via a 
torrent is no big deal even if it takes days to receive all of it.

After fetching the file via torrent its checksum would be checked 
against the checksum provided by GHNS to prevent forged data.


Regards,
Ingo
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 194 bytes
Desc: This is a digitally signed message part.
URL: <http://mail.kde.org/pipermail/kde-core-devel/attachments/20080711/6d573972/attachment.sig>