I have set a few filters for my inbox to clear some specific emails out
of the Inbox and into specific folders (e.g. Notifications, Ads, Mailing
lists, etc.).
This has worked well for a few days. Come today it just doesn't. For
some reason nearly all emails land in my inbox. A few were moved to the
intended folders, but still more than those just don't get filtered. I
am using Pop3 to get the mails from Google.

Kyonshi <gmkeros@gmail.com> wrote:

> I have set a few filters for my inbox to clear some specific emails out
> of the Inbox and into specific folders (e.g. Notifications, Ads, Mailing
> lists, etc.).
> This has worked well for a few days. Come today it just doesn't. For
> some reason nearly all emails land in my inbox. A few were moved to the
> intended folders, but still more than those just don't get filtered. I
> am using Pop3 to get the mails from Google.

Are you suffering the same fate as Saucer Man in getting e-mails that
are base 64 encoded instead of HTML (which is text) or plain text?
"Filters" is way to vague to address.

On 4/5/2024 6:25 PM, VanguardLH wrote:
> Kyonshi <gmkeros@gmail.com> wrote:
>
>> I have set a few filters for my inbox to clear some specific emails out
>> of the Inbox and into specific folders (e.g. Notifications, Ads, Mailing
>> lists, etc.).
>> This has worked well for a few days. Come today it just doesn't. For
>> some reason nearly all emails land in my inbox. A few were moved to the
>> intended folders, but still more than those just don't get filtered. I
>> am using Pop3 to get the mails from Google.
>
> Are you suffering the same fate as Saucer Man in getting e-mails that
> are base 64 encoded instead of HTML (which is text) or plain text?
> "Filters" is way to vague to address.
>

I constructed a filter and it didn't work.

The neat part, was when I edited the definition of
the filter, and ran the same filter again ("test2"), not only
did the new filter definition work, the *old* filter
attempt also ran and dumped its messages into
the filter log window.

So somehow, the filter operation sits in "limbo" after
you click the button. The box this is searching, has message
bodies present.

version="9"
logging="yes"
name="test2"
enabled="yes"
type="16"
action="Copy to folder"
actionValue="mailbox://nobody@Local%20Folders/Archives/2023"
condition="AND (\"Body\",contains,ว็บตรงไม่ผ่านเอเย่นต์)" <=== filter CAN look inside base64 and find that string, eventually

version="9"
logging="yes"
name="test2"
enabled="yes"
type="16"
action="Copy to folder"
actionValue="mailbox://nobody@Local%20Folders/Archives/2023"
condition="AND (subject,contains,logic)" <=== running this one, caused the previous one to finish

Thunderbird 115.9.0

Paul

On 05.04.2024 21:48, Kyonshi wrote:
> I
> am using Pop3 to get the mails from Google.

Use a proper mail-provider! This a Google-issue with an extremely high
degree of probability.

--
"Ave Caesar! Morituri te salutant!"

On 06 Apr 2024 09:37, Jörg Lorenz wrote:
> On 05.04.2024 21:48, Kyonshi wrote:
>> I
>> am using Pop3 to get the mails from Google.
> Use a proper mail-provider! This a Google-issue with an extremely high
> degree of probability.

Hmm, after the messages were POP3-downloaded they are local and then local search
works, as was confirmed here:

condition="AND (\"Body\",contains,ว็บตรงไม่ผ่านเอเย่นต์)" <=== filter CAN look
inside base64 and find that string, eventually

I don't understand what happened here, the correct syntax is:
AND (body,contains, ...

--
Viele Grüße, Jörg
Sent with Betterbird. Simply better.
www.betterbird.eu - www.betterbird.eu/#featuretable
Es ist immer wieder erstaunlich: Kaum macht man's richtig, schon funktioniert's!

On 06.04.2024 10:32, Jörg Knobloch wrote:
> On 06 Apr 2024 09:37, Jörg Lorenz wrote:
>> On 05.04.2024 21:48, Kyonshi wrote:
>>> I
>>> am using Pop3 to get the mails from Google.
>> Use a proper mail-provider! This a Google-issue with an extremely high
>> degree of probability.
>
> Hmm, after the messages were POP3-downloaded they are local and then local search
> works, as was confirmed here:
>
> condition="AND (\"Body\",contains,ว็บตรงไม่ผ่านเอเย่นต์)" <=== filter CAN look
> inside base64 and find that string, eventually
>
> I don't understand what happened here, the correct syntax is:
> AND (body,contains, ...

That would be the second possible cause.

--
"Ave Caesar! Morituri te salutant!"

On 4/6/2024 4:32 AM, Jörg Knobloch wrote:
> On 06 Apr 2024 09:37, Jörg Lorenz wrote:
>> On 05.04.2024 21:48, Kyonshi wrote:
>>> I
>>> am using Pop3 to get the mails from Google.
>> Use a proper mail-provider! This a Google-issue with an extremely high
>> degree of probability.
>
> Hmm, after the messages were POP3-downloaded they are local and then local search works, as was confirmed here:
>
> condition="AND (\"Body\",contains,ว็บตรงไม่ผ่านเอเย่นต์)"  <=== filter CAN look inside base64 and find that string, eventually
>
> I don't understand what happened here, the correct syntax is:
> AND (body,contains, ...
>

For some reason, it may put double quotes and escape
them, but only for the Body choice. Body must receive
special treatment in the Filter dialog.

Maybe it matches on "Body" double quotes included, when
actually processing the filter ?

I haven't seen it done like this:

body,contains,logic

rather like this

\"body\",contains,logic

Paul

On 06-04-2024 18:37, Paul wrote:
> On 4/6/2024 4:32 AM, Jörg Knobloch wrote:
>> On 06 Apr 2024 09:37, Jörg Lorenz wrote:
>>> On 05.04.2024 21:48, Kyonshi wrote:
>>>> I
>>>> am using Pop3 to get the mails from Google.
>>> Use a proper mail-provider! This a Google-issue with an extremely high
>>> degree of probability.
>>
>> Hmm, after the messages were POP3-downloaded they are local and then local search works, as was confirmed here:
>>
>> condition="AND (\"Body\",contains,ว็บตรงไม่ผ่านเอเย่นต์)"  <=== filter CAN look inside base64 and find that string, eventually
>>
>> I don't understand what happened here, the correct syntax is:
>> AND (body,contains, ...
>>
>
> For some reason, it may put double quotes and escape
> them, but only for the Body choice. Body must receive
> special treatment in the Filter dialog.
>
> Maybe it matches on "Body" double quotes included, when
> actually processing the filter ?
>
> I haven't seen it done like this:
>
> body,contains,logic
>
> rather like this
>
> \"body\",contains,logic
>
> Paul
>
The escaped double quotes are always added on custom filters.
There is no "Body" filter for newsgroups, so if you add it, it's a
custom filter.
Unfortunately it doesn't work, (\"body\",contains,logic) does not work.
If you manually add (body,contains,logic) to the filterfile, it works.
It's a bug, "Body" should be a normal filter for newsgroups.

On 4/6/2024 12:25 AM, VanguardLH wrote:
> Kyonshi <gmkeros@gmail.com> wrote:
>
>> I have set a few filters for my inbox to clear some specific emails out
>> of the Inbox and into specific folders (e.g. Notifications, Ads, Mailing
>> lists, etc.).
>> This has worked well for a few days. Come today it just doesn't. For
>> some reason nearly all emails land in my inbox. A few were moved to the
>> intended folders, but still more than those just don't get filtered. I
>> am using Pop3 to get the mails from Google.
>
> Are you suffering the same fate as Saucer Man in getting e-mails that
> are base 64 encoded instead of HTML (which is text) or plain text?
> "Filters" is way to vague to address.

I didn't think that was the case because all the filters are either on
the From: field or on the subject line. I thought the other thread was
about filtering in the body?

Kyonshi <gmkeros@gmail.com> wrote:

> VanguardLH wrote:
>
>> Kyonshi <gmkeros@gmail.com> wrote:
>>
>>> I have set a few filters for my inbox to clear some specific emails out
>>> of the Inbox and into specific folders (e.g. Notifications, Ads, Mailing
>>> lists, etc.).
>>> This has worked well for a few days. Come today it just doesn't. For
>>> some reason nearly all emails land in my inbox. A few were moved to the
>>> intended folders, but still more than those just don't get filtered. I
>>> am using Pop3 to get the mails from Google.
>>
>> Are you suffering the same fate as Saucer Man in getting e-mails that
>> are base 64 encoded instead of HTML (which is text) or plain text?
>> "Filters" is way to vague to address.
>
> I didn't think that was the case because all the filters are either on
> the From: field or on the subject line. I thought the other thread was
> about filtering in the body?

Thanks for some additional clarification. Your starter post didn't say
on what the filter tested.

As for the Subject header, you still have to look at the raw source to
see if Subject is plain text or encoded (likely UTF-8). The encoding is
meant to allow non-ASCII characters in the header value, but some
senders (spammers, scammers, trolls) will encode the Subject header to
avoid filters, or they use a non-ASCII character set despite all their
characters could be represented in ASCII, like being cutsy by stuffing a
superfluous emoji into the Subject. In the raw source, you could see
some garbage string in Subject, for example, like:

=?utf-8?b?VGhpcyBwcm9kdWN0IMKuIGlzIGF3ZXNvbWU=?=

In the raw source, check if Subject looks like the following syntax:

=?<charset>?<encoding>?<encodedtext>?=

<charset> specifies the character set used for <encodedtext>. Quite
often it is UTF-8. <encoding> is either B (for base64) or Q (for
quoted-printable). The <encodedtext> looks like gibberish to you, and
to the filters. A search on a string in Subject won't be found, except
by accident, in <encodedtext>.

RFC 1432
Representation of Non-ASCII Text in Internet Message Headers
https://datatracker.ietf.org/doc/html/rfc1342

I don't see a restriction on which headers can get encoded, so it looks
like the From header's value could also be encoded. You could try to
test on the encoded string, but on all of it, not a part of it, like you
could do with a text string where you could test on a substring. You
wouldn't know where within the encoded string would be the substring
portion on which you wanted to test.

Another case of what the client shows you is not what is actually inside
the message. Look at the raw source of a message to see what is
actually inside the message.

On 4/5/2024 9:48 PM, Kyonshi wrote:
> I have set a few filters for my inbox to clear some specific emails out
> of the Inbox and into specific folders (e.g. Notifications, Ads, Mailing
> lists, etc.).
> This has worked well for a few days. Come today it just doesn't. For
> some reason nearly all emails land in my inbox. A few were moved to the
> intended folders, but still more than those just don't get filtered. I
> am using Pop3 to get the mails from Google.

Hmm. This seems to have been an intermittent problem. Today all the
emails that arrived were sorted correctly.

Not sure what caused that issue.

Am 07.04.24 um 00:16 schrieb Kyonshi:
> On 4/5/2024 9:48 PM, Kyonshi wrote:
>> I have set a few filters for my inbox to clear some specific emails out
>> of the Inbox and into specific folders (e.g. Notifications, Ads, Mailing
>> lists, etc.).
>> This has worked well for a few days. Come today it just doesn't. For
>> some reason nearly all emails land in my inbox. A few were moved to the
>> intended folders, but still more than those just don't get filtered. I
>> am using Pop3 to get the mails from Google.
>
> Hmm. This seems to have been an intermittent problem. Today all the
> emails that arrived were sorted correctly.
>
> Not sure what caused that issue.

PEBKAC?

--
"Gutta cavat lapidem." (Ovid)

On 4/7/2024 1:33 AM, Jörg Lorenz wrote:
> Am 07.04.24 um 00:16 schrieb Kyonshi:
>> On 4/5/2024 9:48 PM, Kyonshi wrote:
>>> I have set a few filters for my inbox to clear some specific emails out
>>> of the Inbox and into specific folders (e.g. Notifications, Ads, Mailing
>>> lists, etc.).
>>> This has worked well for a few days. Come today it just doesn't. For
>>> some reason nearly all emails land in my inbox. A few were moved to the
>>> intended folders, but still more than those just don't get filtered. I
>>> am using Pop3 to get the mails from Google.
>>
>> Hmm. This seems to have been an intermittent problem. Today all the
>> emails that arrived were sorted correctly.
>>
>> Not sure what caused that issue.
>
> PEBKAC?
>
See dillinger comment. <oah8ek-fnf.ln1@spock.lan>

Paul

On Sun, 7 Apr 2024 07:33:02 +0200, Jörg Lorenz wrote:

> Am 07.04.24 um 00:16 schrieb Kyonshi:
>> On 4/5/2024 9:48 PM, Kyonshi wrote:
>>> I have set a few filters for my inbox to clear some specific emails
>>> out of the Inbox and into specific folders (e.g. Notifications, Ads,
>>> Mailing lists, etc.).
>>> This has worked well for a few days. Come today it just doesn't. For
>>> some reason nearly all emails land in my inbox. A few were moved to
>>> the intended folders, but still more than those just don't get
>>> filtered. I am using Pop3 to get the mails from Google.
>>
>> Hmm. This seems to have been an intermittent problem. Today all the
>> emails that arrived were sorted correctly.
>>
>> Not sure what caused that issue.
>
> PEBKAC?

considering I didn't change anything with the filters from day to day I
doubt it. on the 4th it worked fine, on the 5th it didn't work at all,
on the 6th it worked.
so unless there is a particular setting that switches off the filters
for a day I think there might have been a TB problem.