MIRROR

[Linc]

We *NEED* some mirrors. Please help us out if ya can. Let me know here or email us at techshow at thelinuxlink dot net

[mrben]

Can you a give an idea of size / bandwidth requirements, and how you set up a mirror? I may be able to host some stuff, but probably not a full archive?

[Linc]

Can you a give an idea of size / bandwidth requirements, and how you set up a mirror? I may be able to host some stuff, but probably not a full archive?

Sure, you bet. The entirety of the archives right now is 472 megs. The bandwidth is anyones best guess. I know until the monday after each show I get the crap hammered outa my dsl line. That's the problem.
As far as setting something up, you just let me know and we'll work something out.

[Guest]

Hi guys.

Just had the chance to register for the forum, and had a thought about the mirrors...

How about having a load balancer? So rather than people bookmarking a particular mirror, you go to one main one, and it works out which mirror to grab the file from. In theory it wouldn't be all that hard, it'd just take a little bit of thinking as to how to judge the load.

Perhaps it could go by MB served, or possibly from some bigbrother type script which looks at the load of each server's connection every-so-often and uses the one with the least load... that way when we're downloading things for ourselves (like the newest version of openoffice/kde/debian's 9 CD ISOs, lol) it should in theory see that the connection's already under stress so it wouldn't pick it. If all of them are under significant load, it would just give a message saying "sorry, please try again in a few minutes, we're hammered".

Alternatively there's always bittorrent, lol

God, there I go, getting carried away again and rambling on, lol

[dsample]

Hey... dunno what happened there, but that last message was me, lol

[mrben]

Linc - I would like to try and run a mirror off Jedimoose.org - maybe not a full mirror, but certainly some of the stuff. Drop me a mail at mrben at jedimoose dot org

BTW - the latest mirror doesn't seem to update - the last 2 episodes aren't on it yet.

[dsample]

Sorry about that, I've just been to Florida for 2 weeks, forgot to mention that I wouldn't be able to update for that time.

Will get them on there ASAP (just this moment got back)

PS: You can really see how much we're getting ripped off over here in the UK once you've been to the states!

[dsample]

Eeeek, just had a look at the mirrors, and I assume they're using the script I made... The problem is, the files that are there are in a different date format.

The date format I use for all the files on my mirror are ISO date format, ie YYYY-MM-DD, this allows the script to find all the files properly and label them automatically as my site does.

I know this isn't the way you've been doing things until now, I just always get confused when I'm sorting the files by name and get them all out of order... using ISO date they go in order nicely

If you want me to edit the script to use the US date format I will have a go

EDIT: OK, they're just plain HTML, not a script, I was just being dumb not noticing the episode number at the beginning

[mrben]

/me is using a homebrew Perl script (pretty ugly, because my main language is Python.....) which basically just lists the all the .chatlog and .mp3 files in the directory.

If anyone wants a copy they're welcome to it

[dsample]

I found a link from archive.org to Coral, a service like archive.org's freecache (which isn't active anymore). files are limited to 50mb, but that shouldn't be a problem for the shows.

To get a file from them as a mirror, you just put the domain you want to go to with ".nyud.net:8090" at the end, which means you can go to any part of the site because relative links still work.

eg. http://www.thelinuxlink.net.nyud.net:8090/