Message-ID:

<chesty> xemacs fixed my flatulence -- From the "XEmacs: Not just an editor" department

devel / comp.infosystems.gemini / Is there a program for downloading gemini sites?

Is there a program for downloading gemini sites?

<t7us6a$eof$1@dont-email.me>

https://www.rocksolidbbs.com/devel/article-flat.php?id=269&group=comp.infosystems.gemini#269

copy link Newsgroups: comp.infosystems.gemini

Path: i2pn2.org!i2pn.org!eternal-september.org!reader02.eternal-september.org!.POSTED!not-for-mail
From: name@example.com (noscript)
Newsgroups: comp.infosystems.gemini
Subject: Is there a program for downloading gemini sites?
Date: Fri, 10 Jun 2022 07:34:34 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 7
Message-ID: <t7us6a$eof$1@dont-email.me>
Injection-Date: Fri, 10 Jun 2022 07:34:34 -0000 (UTC)
Injection-Info: reader02.eternal-september.org; posting-host="025f68213fe3142539967d20468babb9";
logging-data="15119"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX181e1IWAnx9I6iefFelo6FLou0XBhiXrCk="
User-Agent: slrn/1.0.3 (Linux)
Cancel-Lock: sha1:YIswTOURKAy5sPEDMkvmjBd02cM=

by: noscript - Fri, 10 Jun 2022 07:34 UTC

Hi,

I'm looking for a program taking a URL and downloading the gemini pages
like `wget --mirror`.

99.99% of the accesses to my gemini site are spider bots from multiple
data centers around the world, what are these spider bots?

Re: Is there a program for downloading gemini sites?

<20220610104827.22e56758@ryz>

copy mid

https://www.rocksolidbbs.com/devel/article-flat.php?id=270&group=comp.infosystems.gemini#270

copy link Newsgroups: comp.infosystems.gemini

Path: i2pn2.org!i2pn.org!eternal-september.org!reader02.eternal-september.org!.POSTED!not-for-mail
From: mo01@posteo.de (Marco Moock)
Newsgroups: comp.infosystems.gemini
Subject: Re: Is there a program for downloading gemini sites?
Date: Fri, 10 Jun 2022 10:48:27 +0200
Organization: A noiseless patient Spider
Lines: 8
Message-ID: <20220610104827.22e56758@ryz>
References: <t7us6a$eof$1@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Injection-Info: reader02.eternal-september.org; posting-host="6cb81d0a607e96be6df4ad537dd84466";
logging-data="29882"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/Q/3YLGB+5BFT165od5ERJ"
Cancel-Lock: sha1:A9u+lY6vR2lK1N07xCE2gXaAejo=

by: Marco Moock - Fri, 10 Jun 2022 08:48 UTC

Am Freitag, 10. Juni 2022, um 07:34:34 Uhr schrieb noscript:

> 99.99% of the accesses to my gemini site are spider bots from multiple
> data centers around the world, what are these spider bots?

Maybe they scan you site to index it/mirror it or they provide a
gateway to the web etc.

Re: Is there a program for downloading gemini sites?

<t8fpr8$maa$1@dont-email.me>

copy mid

https://www.rocksolidbbs.com/devel/article-flat.php?id=280&group=comp.infosystems.gemini#280

copy link Newsgroups: comp.infosystems.gemini

Path: i2pn2.org!i2pn.org!eternal-september.org!reader02.eternal-september.org!.POSTED!not-for-mail
From: name@example.com (noscript)
Newsgroups: comp.infosystems.gemini
Subject: Re: Is there a program for downloading gemini sites?
Date: Thu, 16 Jun 2022 17:38:48 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 5
Message-ID: <t8fpr8$maa$1@dont-email.me>
References: <t7us6a$eof$1@dont-email.me> <20220610104827.22e56758@ryz>
Injection-Date: Thu, 16 Jun 2022 17:38:48 -0000 (UTC)
Injection-Info: reader02.eternal-september.org; posting-host="b5a2499b27d5fafdc86768b73b47f5f6";
logging-data="22858"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX19IytUHK/krRZP4io1uGv9BKRNplb23xfU="
User-Agent: slrn/1.0.3 (Linux)
Cancel-Lock: sha1:Wh46S3pfqyalDFHnM/XtsNXDtAA=

by: noscript - Thu, 16 Jun 2022 17:38 UTC

Subject	Author
Is there a program for downloading gemini sites?	noscript
Re: Is there a program for downloading gemini sites?	Marco Moock
Re: Is there a program for downloading gemini sites?	noscript