Page 1 of 3

BitTorrenting!

Posted: October 18th, 2010, 1:19 am
by Glitch
I am heading up a project to handle the distribution of our AudioBooks via the BitTorrent technology.

The goal? To provide the entire LibriVox catalog, in whole and in part, to the world via the BitTorrent protocol.

BitTorrenting is a rather strange, yet amazing beast.

If you think of a file as a deck of cards, broken up into 52 very specific and known pieces, then the technology becomes a little easier to imagine.

I start off by sharing my deck of cards to anyone who wants it(I'm the original seeder). I can copy any and all of the cards in my deck, so I never lose anything, of course. Once you've downloaded all the pieces from me, you now have a full deck that you can use.

Now, when a third person comes in and wants a copy, they can ask me for some cards and ask you for some cards. Doesn't matter where they get the individual cards (from you or from me), as long as they end up with a full deck, in the end.

As more people ask for a copy of the deck, there are more people available to make copies of the individual cards, which makes the download much faster than between two people. (You're downloading from a dozen or more people at the same time)

Another interesting aspect is that I don't have to have a complete deck to start sharing copies of the cards I have. If I only have the black cards, and you've only got the red cards...neither of us have a full deck. As we share copies of our cards with each other...we both end up with a complete deck.

All of the files available for torrenting are split into thousands of small pieces which are shared between all the people who elect to be seeds. It's all organized by the client program that you run on your computer, all you have to do is install a program on your computer. It can be setup to automatically download the new audio-books and automatically share them!

If you're willing to provide assistance of any kind, please send me a PM!

I will keep this topic up to date with the current efforts with implementing BitTorrenting on LibriVox.

Active Torrents (Edited 21Jan12)

Posted: October 18th, 2010, 1:23 am
by Glitch

Cleaning up the Catalog

Posted: October 18th, 2010, 1:32 am
by Glitch
Our second task is to identify any broken torrent links in the LibriVox Catalog.

There have been a number of efforts in the past to implement a BitTorrent implementation for LibriVox. I hope to be more successful, but since we've taken up the torch once again, we have the obligation to clean up the loose ends from previous projects.

If you find any broken torrent links in the catalog, send me a PM and I'll remove it. (If it works, we'll add it to the list above)

As the catalog is a very large collection, it would be difficult to divide it up to any assigned personnel. Short of having specific individuals claim a specific letter of the alphabet to sift through, I have no creative ideas for how to methodically clean up the catalog links. If you do, please let me know. If you do happen to clean up an entire section of the catalog, let me know so I can post it here. That way, we can help people avoid working the same areas over.

Posted: October 18th, 2010, 6:45 am
by TriciaG
As the catalog is a very large collection, it would be difficult to divide it up to any assigned personnel. Short of having specific individuals claim a specific letter of the alphabet to sift through, I have no creative ideas for how to methodically clean up the catalog links. If you do, please let me know. If you do happen to clean up an entire section of the catalog, let me know so I can post it here. That way, we can help people avoid working the same areas over.
I think only MC's can clean up catalog pages. If you like, you can filter the broken torrent links through me, and I'll do it.

Can't you do a Google search on a specific site - something like, "site:librivox.org torrent book"? It will bring up some wiki and forum pages, but I would guess that most of the results would be catalog pages with torrents on them.

Google search.

Posted: October 18th, 2010, 9:27 am
by Glitch
I've just heard that twice now, I will certainly have to look into the google site search.

I appreciate the offer to scrub the broken links. I have a few admins willing to clean up the broken links as we find them. Your help is very appreciated.

Thanks for the pointer to Google!

-Matt

Re: BitTorrenting!

Posted: December 16th, 2010, 4:43 pm
by Glitch
All the catalog pages have been scrubbed!

I currently have a Fedora/Apache webserver setup, and I'm learning the logistics of getting a torrent tracker installed. (If anyone can help me with THAT, would make this go quicker)

I hope to have our own dedicated torrent tracker and host setup soon!

-Matt

Re: BitTorrenting!

Posted: December 16th, 2010, 8:49 pm
by kayray
Fantastic! Thanks, Matt! How funny, I was JUST thinking about this project earlier today, because a new user said he found us via a torrented audiobook (from monova, I think)...

Re: BitTorrenting!

Posted: December 17th, 2010, 4:24 am
by Starlite
I'm glad you are pluggin away at this Matt. We have listeners in China that can not access internet archive (censorship) but can use torrents!

I'm afraid I am not much help though. Just encouraging you onwards. :clap:

Esther :D

Re: BitTorrenting!

Posted: December 17th, 2010, 5:06 am
by annise
Jonathan Awesome was putting all the M4B books out as bit torrents - I see that they still show up in a Google search, I'm hoping he will return once he has a settled home and internet again. As is obvious I understand the theory but know nothing about the actual doing :D

Anne

Re: BitTorrenting!

Posted: December 22nd, 2010, 7:34 am
by Glitch
I appreciate the support, both technical and moral!

It's a fun project, and I've had some tough times, so far, trying to learn the technology. I went through the process of setting up a Linux-Apache-MySql-PhP server, even though I had no idea how any of those worked. (Still don't, for the most part. :-) )

I re-dedicated the machine to Windows Vista (pending better ideas and experience). Right now, I am looking for a windows based Torrent tracker software while I wait for Comcast to come and setup my new internet connection.

Pretty soon all the technical side of things will be finished, and I'll be looking to put some books online. I certainly don't have the time and space to put the entire catalog up, yet. If anyone has ideas on how to determine WHICH books should be put up first (and as more space becomes available), please let me know!

-Matt

Re: BitTorrenting!

Posted: December 22nd, 2010, 10:13 am
by kayray
"Which books" is a good question!

You could hit the monthly stats page: http://librivox.org/newcatalog/monthly.php , pick a month, and then take every 5th book. Heh :)

You could go for what YOU would most like to find on a torrent site.

You could go to our advanced catalog page http://librivox.org/newcatalog/visitor_advanced.php , hit the "genres" link, and put up all the "art" books (random example).

You could put up all the solos by your favorite reader.

This is your project! You can choose whichever books you want; we're not going to argue :) Having some books available via torrent is far better than having none available, so just choose what you want and have fun with it.

Re: BitTorrenting!

Posted: November 11th, 2011, 3:31 pm
by philchenevert
Hey, are we still working on this? I have a Linux computer that I would like to dedicate to 24/7 torrents of LV books.

please let me know how to continue.

Re: BitTorrenting!

Posted: January 21st, 2012, 8:44 am
by Glitch
We are most certainly still working on this, though it is a very slow process since I'm not technically inclined.

Are you familiar enough with Linux, perhaps, to help me setup a LAMP stack out of my home that would serve as a tracker? If so, PLEASE drop me a line!

Re: BitTorrenting!

Posted: January 21st, 2012, 9:27 am
by philchenevert
MatthewMol wrote:We are most certainly still working on this, though it is a very slow process since I'm not technically inclined.

Are you familiar enough with Linux, perhaps, to help me setup a LAMP stack out of my home that would serve as a tracker? If so, PLEASE drop me a line!
i do not know much about setting up a LAMP stack or anything like that, but I do have access to a man in our computer club who can help. Where is the technical information located on our wiki so I can show him what we want to do. ?

:thumbs:

Re: BitTorrenting!

Posted: January 21st, 2012, 10:27 am
by Glitch
At the moment, since this is a bit of a side project, we don't have any part in the Wiki.

The technical details are thus:

I have a blank computer capable of handling any distro of linux desired by the expert. I have chosen Erdgeist's 'opentracker' to host the torrents. However, I am unable to get PhP, MySQL, Linux, and Apache all working together in concert due to my own lack of experience with Linux. I have tried working with Windows as well, but I only have Vista with limited IIS functionality.

I am more than open to other ideas for hosting a tracker, though I think sticking with opentracker is the best answer long-term. If that means buying a better version of windows, or letting someone access my computer remotely, I'm all for it...just need help with the technicals.