[olug] Download Linux Journal digital assets

[Dan Linder]

Just to close the loop on this, I setup a simple "wget" command using
"--mirror" (as well as adding --wait=30 and --random-wait to be nice to the
server), and all the files appear to have been downloaded.  In the end it
was 6.0GB so be kind if you mirror the same.  (I'll bring along a copy of
the raw files to the Jan OLUG meeting if anyone wants one.)

Sad to see them go, glad to see that they are not letting the digital
magazine files to go "poof"...

Dan

On Wed, Dec 6, 2017 at 6:07 PM, Rob Townley <rob.townley at gmail.com> wrote:

> On Wed, Dec 6, 2017 at 7:35 AM Dan Linder <dan at linder.org> wrote:
>
> > I've been a subscriber to LJ for years, and at one time I bought all the
> > back copies (I lost #16 years ago) for posterity.
> >
> > On Friday, Linux Journal announced they are going out of business with
> last
> > months publication, but at the same time they permitted all of us
> > subscribers to download the zip with the HTML version of the digital
> > magazines but not the PDF version.  (Which is my reading preference.)
> >
> > By any chance had anyone seen a script that I can run against the site to
> > download these?  If I had time I'd play with writing my own web scraping
> > too, but I'm concerned that their site will go offline for good before I
> > get around to that.  (I guess I'd take a link to someone who had done
> this
> > already...)
> >
> > Anyone tackled this and willing to share code? Even if it's from a
> > different site it might jumpstart me in the right direction
> >
> > Dan
> > _______________________________________________
> > OLUG mailing list
> > OLUG at olug.org
> > https://www.olug.org/mailman/listinfo/olug
> >
>
> My first thought is bummer - had i pulled the trigger and subscribed
> earlier this year, maybe they would still be in business.  They had some
> awesome articles.
>
> For the download, recursive wget call or python request module (which has
> been superseded by something but still works) would be good.  On my phone,
> so hard to get at the source.
> _______________________________________________
> OLUG mailing list
> OLUG at olug.org
> https://www.olug.org/mailman/listinfo/olug
>



-- 
***************** ************* *********** ******* ***** *** **
"If you wish to make an apple pie from scratch,
  you must first invent the universe."
  -- Carl Sagan

"Quis custodiet ipsos custodes?"
    (Who can watch the watchmen?)
    -- from the Satires of Juvenal

"I do not fear computers, I fear the lack of them."
    -- Isaac Asimov (Author)
** *** ***** ******* *********** ************* *****************