[RESOLVED]the way we live

Post by **hugh** » August 18th, 2008, 6:20 am

Chapters 32 - 37 are missing from the Zip file for this book

PaulW · Post by **PaulW** » August 18th, 2008, 8:12 am

Assuming this is The Way We Live Now by Anthony Trollope, it's one of those huge zip files...975.2 mb. Downloading now.

PaulW · Post by **PaulW** » August 18th, 2008, 9:53 am

The zip of The Way We Live Now that I downloaded has chapters 001 through 100 in it, inluding 32-37. This is the only book in our search engine with the words "way we live" in the title field.

kmerline · Post by **kmerline** » August 18th, 2008, 1:52 pm

Paul, thank you for checking - I'm very relieved.

PaulW · Post by **PaulW** » August 18th, 2008, 2:00 pm

Yeah, I guess it must have been a bad download. That's one of the projects we might want to consider splitting the zip into two or three smaller ones. I'm just not sure how Archive tracks the
Whole Item" files, and how it would recognize multiple zip files.

kmerline · Post by **kmerline** » August 19th, 2008, 2:08 pm

You are right - I should have asked her to make at least 2 "volumes".

Could we do that - by downloading the files and then re-uploading as 2 or 3 separate books, The "Way We Live Now vol 1", etc. and after we knew they working, delete the original single vol book?

Post by **knotyouraveragejo** » August 19th, 2008, 2:22 pm

Karen,

Before you go through all of that, would you like me to try to split this into two zip files, upload them to the existing folder and see if they will link properly? I wouldn't delete the original zip file since some people are able to download it and might prefer it that way. Keep in mind that a lot of these problems are simply due to traffic on the archive servers at any given time. This book has been downloaded >16300 times since it was cataloged six months ago. If this is the first problem reported, it can't be all that bad.

Jo

PaulW · Post by **PaulW** » August 19th, 2008, 5:12 pm

I'd like to see how the multiple zip files for one project works out. We may need to do this to some of the other huge projects (City of God, for instance...1.2 gigabytes for the zip!

)

kmerline · Post by **kmerline** » August 20th, 2008, 3:28 pm

knotyouraveragejo wrote:Karen,

Before you go through all of that, would you like me to try to split this into two zip files, upload them to the existing folder and see if they will link properly? I wouldn't delete the original zip file since some people are able to download it and might prefer it that way. Keep in mind that a lot of these problems are simply due to traffic on the archive servers at any given time. This book has been downloaded >16300 times since it was cataloged six months ago. If this is the first problem reported, it can't be all that bad.

Jo

I would really appreciate it, having no idea how to go about it myself. I don't think anyone knew the large projects would cause Internet Archive problems - I certainly didn't! I'd like to see a general solution everyone could use to avoid these problems, because even if LV if "for the readers", I think readers who understand have a stake in it, too.

kmerline · Post by **kmerline** » August 20th, 2008, 3:33 pm

PaulW wrote:I'd like to see how the multiple zip files for one project works out. We may need to do this to some of the other huge projects (City of God, for instance...1.2 gigabytes for the zip! )

I M.C.'ed that one, too, although Caet cataloged it during my back episode. We need to watch out for the same reader's King James Bible (both testaments in one project) now underway.

If we find a good solution to recommend, we should transfer this discussion to a different forum . . .

Post by **knotyouraveragejo** » August 20th, 2008, 9:39 pm

I've uploaded two additional zip files for chapters 1-50 (491MB) and chapters 50-100(477MB) respectively. These appear on the archive details page in the list of files immediately below the original zip file of the entire book (975MB). See what you think of how this looks.

http://www.archive.org/details/waywelivenow_dl_librivox

If the consensus is that this is not self-explanatory, then we could rename the original zip to indicate that it is the entire book, or put a note in the description on the archive page.

In adding the links to the two extra zip files to the catalog page, however, the links for the RSS, iTunes and Chapter a Day were duplicated under each of the zip file lines. I'll have to PM tis to see about fixing this since I don't know exactly how these get generated.

http://librivox.org/the-way-we-live-now-by-anthony-trollope/

PaulW · Post by **PaulW** » August 20th, 2008, 9:49 pm

That's how I hoped they'd show up on Archive. Assuming we can get the catalog page fixed, we may want to do this to other zips. Maybe anything over 650 MB (or even a smaller top limit), as we run across them? We'll also have to edit the MC-101 to remind ourselves to be on the lookout for multiple zip files, and to download and break up the bigger ones if we have to re-derive a project. Just one more step, but a worthwhile one, I think.

Starlite · Post by **Starlite** » August 21st, 2008, 4:00 am

Would it be worth putting a note on both the catalog and archive page mentioning the option of the smaller zips?

Esther

Post by **knotyouraveragejo** » August 21st, 2008, 7:23 am

Esther: That is what I was suggesting for the archive page if folks thought it would be helpful. For our catalog pages, I think mentioning this option could be incorporated into the note at the top of every page about possible/occasional download issues at archive. What do you think?

Paul: Yes this is where I was hoping the files would show up on the archive page as well.

Multiple zip files will be an added pain when replacing files since at least one of the extra ones will need to be redone by hand, but otherwise I think this is the least complicated way to deal with this. On the other hand it will take someone with a fast and reliable internet connection with enough bandwidth to download the original large zip and then upload the smaller ones by ftp. These two ~480MB zip files took at least hour to reupload simultaneously using Firezilla. Also you obviously need the HD space to store several gigs of files temporarily. If at least a few of us are able and willing to do this on an as needed basis, I think this is a good solution/option for these long books.

Jo

I've PM'd tis about the catalog page.

Starlite · Post by **Starlite** » August 21st, 2008, 7:56 am

knotyouraveragejo wrote: For our catalog pages, I think mentioning this option could be incorporated into the note at the top of every page about possible/occasional download issues at archive. What do you think?

Yes that's a perfect place to add the option of multiple, smaller zips.

Something like

If the files are not available please try back later, as archive.org is having issues. The files are safe but may be temporarily unavailable. Some longer books now have the option of downloading smaller (Multiple) zip files since archive seems to have difficulty handling the larger zip files.

Or some such wording.

Esther