of the many thousands of unmoderated newsgroups (e.g., last check 2 Nov 2023
news.mixmin.net http://mixmin.net/active list [2.03 MB] shows 39,385 "y" and
5,936 "m"), is there any, preferably easy way for news admins to post totals
for all articles in all unmoderated newsgroups containing "googlegroups.com"
in message-id headers, and separately for reference headers of replies which
also contain "googlegroups.com", e.g., since 1 January 2023 to current date?

On 2023-11-09 13:35, D wrote:
> of the many thousands of unmoderated newsgroups (e.g., last check 2 Nov 2023
> news.mixmin.net http://mixmin.net/active list [2.03 MB] shows 39,385 "y" and
> 5,936 "m"), is there any, preferably easy way for news admins to post totals
> for all articles in all unmoderated newsgroups containing "googlegroups.com"
> in message-id headers, and separately for reference headers of replies which
> also contain "googlegroups.com", e.g., since 1 January 2023 to current date?
>

Any news admin with at least 320 days of message retention would be able
to run scripts against the message files on their servers.

For speed, this should be done in a fast language that can parse RFC822
headers on the fly, do regex matches and remember a hashed table of
msgIds. Perl or Python might do with enough RAM for the table.

One check could be run backwards (newest post first) and special case
messages whose own msgId was not seen as a reference/inreplyto in a
newer message. Such messages would be at a higher chance of being of
little interest to other participants, though there will be many
misdetections both ways with that crude metric.

For detection of GG traffic, look at the Path header, not the msgId .

Enjoy

Jakob
--
Jakob Bohm, CIO, Partner, WiseMo A/S. https://www.wisemo.com
Transformervej 29, 2860 Søborg, Denmark. Direct +45 31 13 16 10
This public discussion message is non-binding and may contain errors.
WiseMo - Remote Service Management for PCs, Phones and Embedded

On Fri, 10 Nov 2023 17:50:56 +0100, Jakob Bohm <jb-usenet@wisemo.com.invalid> wrote:
>On 2023-11-09 13:35, D wrote:
>> of the many thousands of unmoderated newsgroups (e.g., last check 2 Nov 2023
>> news.mixmin.net http://mixmin.net/active list [2.03 MB] shows 39,385 "y" and
>> 5,936 "m"), is there any, preferably easy way for news admins to post totals
>> for all articles in all unmoderated newsgroups containing "googlegroups.com"
>> in message-id headers, and separately for reference headers of replies which
>> also contain "googlegroups.com", e.g., since 1 January 2023 to current date?
>
>Any news admin with at least 320 days of message retention would be able
>to run scripts against the message files on their servers.
>For speed, this should be done in a fast language that can parse RFC822
>headers on the fly, do regex matches and remember a hashed table of
>msgIds. Perl or Python might do with enough RAM for the table.
>One check could be run backwards (newest post first) and special case
>messages whose own msgId was not seen as a reference/inreplyto in a
>newer message. Such messages would be at a higher chance of being of
>little interest to other participants, though there will be many
>misdetections both ways with that crude metric.
>For detection of GG traffic, look at the Path header, not the msgId .
>Enjoy
>Jakob

a million thanks for sharing your expertise! this is more technical
than anything i am able to understand . . . maybe nntp server admins
could use this type of information to find out just how many "google"
articles have graced the usenet world with their burgeoning presence