On 6 May 2023 at 09:28:56 CEST, "Julien ÉLIE"
<iulius@nom-de-mon-site.com.invalid> wrote:

> Hi Eli,
> The 2 batch files have to be merged in one, ordered by posting date, and
> not fed separately to INN.

Oh yes, that makes sense of course :D

Thank you!

On 6 May 2023 at 09:28:56 CEST, "Julien ÉLIE"
<iulius@nom-de-mon-site.com.invalid> wrote:

> Hi Eli,
> The 2 batch files have to be merged in one, ordered by posting date, and
> not fed separately to INN.

So far the rnews solution works fine, except that INN (v2.7.0) crashed with
the following error:

innd: timecaf: could not OpenArtWriteFd
/datadisk/spool/articles/timecaf-00/5b/64be.CF/262145: CAF_ERR_ARTWONTFIT
innd: timecaf: could not OpenArtWrite
/datadisk/spool/articles/timecaf-00/5b/64be.CF/262145: CAF_ERR_ARTWONTFIT

There is enough disk space available, so it's not that.

The timecaf file is not extremely large either (I've seen much bigger ones)
"609M - 64be.CF"

It crashed on article:
<4wrQa.18824$R92.14129@news2.central.cox.net> 436 Can't store article

The article itself is not big of anything special.

Do you have any idea what caused this?

Hi Eli,

> innd: timecaf: could not OpenArtWriteFd
> /datadisk/spool/articles/timecaf-00/5b/64be.CF/262145: CAF_ERR_ARTWONTFIT
> innd: timecaf: could not OpenArtWrite
> /datadisk/spool/articles/timecaf-00/5b/64be.CF/262145: CAF_ERR_ARTWONTFIT
>
> Do you have any idea what caused this?

I see in the source code that there is a hard-coded number for the
maximum number of articles a single CAF file has room for:

[storage/timecaf/caf.h]
/*
** Number of slots to put in TOC by default. Can be raised if we ever get
** more than 256*1024=262144 articles in a file (frightening thought).
*/

The "262145: CAF_ERR_ARTWONTFIT" error corresponds to it.

A single CAF file contains all the articles received during 256 seconds
(timecaf-nn/bb/aacc.CF has articles received during the interval from
0xaabbcc00 to 0xaabbccFF).

It really seems that the storage method was not designed for quick
injection like via pullnews!

I would just suggest to pace up the integration rate of new articles...
Or if you really need larger CAF files, rebuild INN with a higher value
for that constant.

I'm sorry you came into this :(
Probably worthwhile mentioning (in the storage.conf manual page for
instance).

--
Julien ÉLIE

« Pourvu que ça dure ! » (Letizia Bonaparte)

On 10 May 2023 at 22:40:09 CEST, "Julien ÉLIE"
<iulius@nom-de-mon-site.com.invalid> wrote:

> Hi Eli,
>
> I see in the source code that there is a hard-coded number for the
> maximum number of articles a single CAF file has room for:
>
> [storage/timecaf/caf.h]
> /*
> ** Number of slots to put in TOC by default. Can be raised if we ever get
> ** more than 256*1024=262144 articles in a file (frightening thought).
> */
>
> The "262145: CAF_ERR_ARTWONTFIT" error corresponds to it.

Hi Julien,

Is it possible to rebuild the history and overview data with just the timecaf
files?

This in case the system is crashed and I only backed up the timecaf files.

Hi Eli,

>> I see in the source code that there is a hard-coded number for the
>> maximum number of articles a single CAF file has room for:
>>
>> [storage/timecaf/caf.h]
>> /*
>> ** Number of slots to put in TOC by default. Can be raised if we ever get
>> ** more than 256*1024=262144 articles in a file (frightening thought).
>> */
>
> Is it possible to rebuild the history and overview data with just the timecaf
> files?

Yes, with "makehistory -O -F".

> This in case the system is crashed and I only backed up the timecaf files.

I of course hope it won't crash.

--
Julien ÉLIE

« Quand j'étais petit, je séchais la natation. » (Philippe Geluck)

Hi Eli,

Incidentally, in case you start any other thread about INN or any other
news server, please do that in the news.software.nntp newsgroup. This
one, news.admin.peering, is not the appropriate one for that kind of
questions. Besides, you may find useful information in other
discussions taking place in news.software.nntp.

Nobody still has popped up to say that we weren't in charter :-)

--
Julien ÉLIE

« We always hold hands. If I let go, she shops. »

On 17 May 2023 at 18:22:05 CEST, "Julien ÉLIE"
<iulius@nom-de-mon-site.com.invalid> wrote:

> Hi Eli,
>
> Incidentally, in case you start any other thread about INN or any other
> news server, please do that in the news.software.nntp newsgroup.

You are absolutely correct.

Will do.