I get a lot of duplicate items downloaded from BBC RSS feeds using
Thunderbird. They are shown as unread, and have identical titles and
identical time settings. A quick look at one or two with CTRL-u didn't
show any obvious differences either. Any idea if the problem lies with
the BBC or Thunderbird? Even if it's the BBC, surely Thunderbird should
be set to reject copies - does it have any form of duplicate rejection
built in? If not, can anyone suggest a way top stop it - I can't find an
extension that will find dupes on the fly as they are downloaded.

--
Tetbury, Gloucestershire , UK

Bob Henson <bob.henson@outlook.com> Wrote in message:

> I get a lot of duplicate items downloaded from BBC RSS feeds using
> Thunderbird. They are shown as unread, and have identical titles and
> identical time settings. A quick look at one or two with CTRL-u didn't
> show any obvious differences either. Any idea if the problem lies with
> the BBC or Thunderbird? Even if it's the BBC, surely Thunderbird should
> be set to reject copies - does it have any form of duplicate rejection
> built in? If not, can anyone suggest a way top stop it - I can't find an
> extension that will find dupes on the fly as they are downloaded.

I don't use TB for RSS feeds but I find some publishers do this.
When I've investigated it's often because an article has been
updated, and there is a difference in the metadata - PubDate for
example.
--
Remove numerics from my email address.

On 21.3.24 6:27 pm, Dave Royal wrote:
> Bob Henson <bob.henson@outlook.com> Wrote in message:
>
>> I get a lot of duplicate items downloaded from BBC RSS feeds using
>> Thunderbird. They are shown as unread, and have identical titles and
>> identical time settings. A quick look at one or two with CTRL-u didn't
>> show any obvious differences either. Any idea if the problem lies with
>> the BBC or Thunderbird? Even if it's the BBC, surely Thunderbird should
>> be set to reject copies - does it have any form of duplicate rejection
>> built in? If not, can anyone suggest a way top stop it - I can't find an
>> extension that will find dupes on the fly as they are downloaded.
>
> I don't use TB for RSS feeds but I find some publishers do this.
> When I've investigated it's often because an article has been
> updated, and there is a difference in the metadata - PubDate for
> example.

I'm not surprised. I imagine there's little I can do about that, but the
reader I used to use didn't seem to let so many though. Perhaps I could
use a filter after mail arrives to look for dupes - I'll have a look
around.

Tetbury, Gloucestershire , UK

Bob Henson wrote:

> I get a lot of duplicate items downloaded from BBC RSS feeds using
> Thunderbird.

The only RSS feed I have is from legislation.gov.uk, I don't see any
duplicates there, what BBC URL are you using?

On 22.3.24 11:37 am, Andy Burns wrote:
> Bob Henson wrote:
>
>> I get a lot of duplicate items downloaded from BBC RSS feeds using
>> Thunderbird.
>
> The only RSS feed I have is from legislation.gov.uk, I don't see any
> duplicates there, what BBC URL are you using?
>
>

https://feeds.bbci.co.uk/news/uk/rss.xml

and various others changing the "uk" in the above to "world", etc. etc.

--
Tetbury, Gloucestershire , UK

Bob Henson wrote:

> https://feeds.bbci.co.uk/news/uk/rss.xml
> and various others changing the "uk" in the above to "world", etc. etc.

No duplicates after first reading of the feed, I wonder if it's related
to them altering articles, I used to use Revisionista/NewsSniffer which
tracks changes to various news source articles.

Andy Burns wrote:

> No duplicates after first reading of the feed, I wonder if it's related
> to them altering articles

I do now see two versions of the Hester/Abbot story, one with message id
containing

uk-politics-68636193#0

the other with id

uk-politics-68636193#1

Dave Royal <dave@dave123royal.com> Wrote in message:

> Bob Henson <bob.henson@outlook.com> Wrote in message:
>
>> I get a lot of duplicate items downloaded from BBC RSS feeds using
>> Thunderbird. They are shown as unread, and have identical titles and
>> identical time settings. A quick look at one or two with CTRL-u didn't
>> show any obvious differences either. Any idea if the problem lies with
>> the BBC or Thunderbird? Even if it's the BBC, surely Thunderbird should
>> be set to reject copies - does it have any form of duplicate rejection
>> built in? If not, can anyone suggest a way top stop it - I can't find an
>> extension that will find dupes on the fly as they are downloaded.
>
> I don't use TB for RSS feeds but I find some publishers do this.
> When I've investigated it's often because an article has been
> updated, and there is a difference in the metadata - PubDate for
> example.

I just had a duplicate - it's a feed of posts to a mailing
list/forum (groups.io). The second one had been edited - a
quotation mark added. If I follow the links to the posts on the
forum the first one no longer exists:

<https://groups.io/g/abcusers/message/21301>
<https://groups.io/g/abcusers/message/21302>

I assume that's the way edits processed. Members may be able to
see the edit history.
--
Remove numerics from my email address.

On 26.3.24 3:43 pm, Dave Royal wrote:
> Dave Royal <dave@dave123royal.com> Wrote in message:
>
>> Bob Henson <bob.henson@outlook.com> Wrote in message:
>>
>>> I get a lot of duplicate items downloaded from BBC RSS feeds using
>>> Thunderbird. They are shown as unread, and have identical titles and
>>> identical time settings. A quick look at one or two with CTRL-u didn't
>>> show any obvious differences either. Any idea if the problem lies with
>>> the BBC or Thunderbird? Even if it's the BBC, surely Thunderbird should
>>> be set to reject copies - does it have any form of duplicate rejection
>>> built in? If not, can anyone suggest a way top stop it - I can't find an
>>> extension that will find dupes on the fly as they are downloaded.
>>
>> I don't use TB for RSS feeds but I find some publishers do this.
>> When I've investigated it's often because an article has been
>> updated, and there is a difference in the metadata - PubDate for
>> example.
>
> I just had a duplicate - it's a feed of posts to a mailing
> list/forum (groups.io). The second one had been edited - a
> quotation mark added. If I follow the links to the posts on the
> forum the first one no longer exists:
>
> <https://groups.io/g/abcusers/message/21301>
> <https://groups.io/g/abcusers/message/21302>
>
> I assume that's the way edits processed. Members may be able to
> see the edit history.

Noting I can do about that then. Pity, it's a pain sorting through a lot
of them, particularly as the BBC Sport feed has many times more than the
others.

--
Tetbury, Gloucestershire , UK

Bob Henson wrote:

> it's a pain sorting through a lot of them, particularly as the BBC Sport
> feed has many times more than the others.

I presume you saw my previous comment about the duplicates incorporating
#0 then #1, #2 etc into their message IDs?

Does the BBC update the sports story each time e.g. a goal is scored?
That would make for an annoying number of updates on the feed, I expect
I'll drop the News feed soon, it's more verbose than I need ...

Bob Henson <bob.henson@outlook.com> Wrote in message:

> On 26.3.24 3:43 pm, Dave Royal wrote:
>> Dave Royal <dave@dave123royal.com> Wrote in message:
>>
>>> Bob Henson <bob.henson@outlook.com> Wrote in message:
>>>
>>>> I get a lot of duplicate items downloaded from BBC RSS feeds using
>>>> Thunderbird. They are shown as unread, and have identical titles and
>>>> identical time settings. A quick look at one or two with CTRL-u didn't
>>>> show any obvious differences either. Any idea if the problem lies with
>>>> the BBC or Thunderbird? Even if it's the BBC, surely Thunderbird should
>>>> be set to reject copies - does it have any form of duplicate rejection
>>>> built in? If not, can anyone suggest a way top stop it - I can't find an
>>>> extension that will find dupes on the fly as they are downloaded.
>>>
>>> I don't use TB for RSS feeds but I find some publishers do this.
>>> When I've investigated it's often because an article has been
>>> updated, and there is a difference in the metadata - PubDate for
>>> example.
>>
>> I just had a duplicate - it's a feed of posts to a mailing
>> list/forum (groups.io). The second one had been edited - a
>> quotation mark added. If I follow the links to the posts on the
>> forum the first one no longer exists:
>>
>> <https://groups.io/g/abcusers/message/21301>
>> <https://groups.io/g/abcusers/message/21302>
>>
>> I assume that's the way edits processed. Members may be able to
>> see the edit history.
>
> Noting I can do about that then. Pity, it's a pain sorting through a lot
> of them, particularly as the BBC Sport feed has many times more than the
> others.
>
Also I noticed this afternoon that an article in I'd seen in this feed
<https://www.theatlantic.com/feed/all/>
about the Baltimore bridge had gone back to 'unread'.

The rss xml includes:
....<title type="html">Baltimore Lost More Than a Bridge</title><pu
blished>2024-03-26T13:01:52-04:00</published><updated>2024-03-26T1
4:49:39-04:00</updated>...

(I can read Atlantic articles in the feed that are behind the paywall.)

--
Remove numerics from my email address.