dupplicated messages in inbox folder

[osin]

when new message has arrived then it's showed twice on the list, when you refresh list it disapear

[osin]

before-refresh

[osin]

after

[alec]

What IMAP server version?

[osin]

I've just got info that we have newest version called: courier

[nagus69]

This is still happening even with the latest nightly build (from yesterday). Only fix is as written above, F5 or re-click the inbox icon.

Error doesn't appear under Outlook 2003 or Squirremail (Webmail).

[nagus69]

Attached 2 consecutive IMAP requests producing the duplicate error (notice message 8 is repolled again every time - which is the one causing duplicates in this error - it's unread)

[25-Feb-2010 11:56:13 +0100]: S: )
[25-Feb-2010 11:56:13 +0100]: S: FH12 OK Fetch complete
[25-Feb-2010 11:56:13 +0100]: C: I LOGOUT
[25-Feb-2010 11:57:12 +0100]: S: * OK IMAP server ready [413]
[25-Feb-2010 11:57:12 +0100]: C: a000 AUTHENTICATE CRAM-MD5
[25-Feb-2010 11:57:12 +0100]: S: + PDM5ODYzLjI2NzUuNzIwMEBwb3N0LndlYm1haWxlci5kZT4=
[25-Feb-2010 11:57:12 +0100]: C: ZmFsa29AYmVyZ21hZW5uZXIubmV0IDM3MjRiNTZkYmFjZDA5OTFkMmZmNGNjN2Y4NWE2OWMx
[25-Feb-2010 11:57:12 +0100]: S: a000 OK LOGIN completed [549]
[25-Feb-2010 11:57:12 +0100]: C: sel1 SELECT "INBOX"
[25-Feb-2010 11:57:13 +0100]: S: * 8 EXISTS
[25-Feb-2010 11:57:13 +0100]: S: * OK [UNSEEN 8]
[25-Feb-2010 11:57:13 +0100]: S: * 1 RECENT
[25-Feb-2010 11:57:13 +0100]: S: * FLAGS ($Forwarded \Answered \Flagged \Deleted \Seen \Draft \Forwarded)
[25-Feb-2010 11:57:13 +0100]: S: * OK [PERMANENTFLAGS ($Forwarded \* \Answered \Flagged \Deleted \Seen \Draft \Forwarded)] Permanent flags
[25-Feb-2010 11:57:13 +0100]: S: * OK [UIDVALIDITY 1207211647] UIDVALIDITY value
[25-Feb-2010 11:57:13 +0100]: S: * OK [UIDNEXT 471] may be the next UID value
[25-Feb-2010 11:57:13 +0100]: S: sel1 OK [READ-WRITE] SELECT completed
[25-Feb-2010 11:57:13 +0100]: C: srch1 SEARCH ALL UNDELETED
[25-Feb-2010 11:57:13 +0100]: S: * SEARCH 1 2 3 4 5 6 7 8
[25-Feb-2010 11:57:13 +0100]: S: srch1 OK SEARCH completed
[25-Feb-2010 11:57:13 +0100]: C: srch1 SEARCH ALL UNDELETED UNSEEN
[25-Feb-2010 11:57:13 +0100]: S: * SEARCH 8
[25-Feb-2010 11:57:13 +0100]: S: srch1 OK SEARCH completed
[25-Feb-2010 11:57:13 +0100]: C: cp01 CAPABILITY
[25-Feb-2010 11:57:13 +0100]: S: * CAPABILITY IMAP4rev1 IDLE AUTH=CRAM-MD5 SORT QUOTA NAMESPACE UNSELECT UIDPLUS LITERAL+ MULTIAPPEND CHILDREN WITHIN
[25-Feb-2010 11:57:13 +0100]: S: cp01 OK CAPABILITY completed
[25-Feb-2010 11:57:13 +0100]: C: QUOT1 GETQUOTAROOT "INBOX"
[25-Feb-2010 11:57:13 +0100]: S: * QUOTAROOT "INBOX" "Inbox"
[25-Feb-2010 11:57:13 +0100]: S: * QUOTA "Inbox" (STORAGE 102 1048576)
[25-Feb-2010 11:57:13 +0100]: S: QUOT1 OK GETQUOTAROOT completed
[25-Feb-2010 11:57:13 +0100]: C: s SORT (DATE) ISO-8859-1 ALL UNDELETED RECENT
[25-Feb-2010 11:57:13 +0100]: S: * SORT 8
[25-Feb-2010 11:57:13 +0100]: S: s OK SORT completed
[25-Feb-2010 11:57:13 +0100]: C: FH12 FETCH 8 (UID RFC822.SIZE FLAGS INTERNALDATE BODY.PEEK[HEADER.FIELDS (DATE FROM TO SUBJECT REPLY-TO IN-REPLY-TO CC BCC CONTENT-TRANSFER-ENCODING CONTENT-TYPE MESSAGE-ID REFERENCES DISPOSITION-NOTIFICATION-TO X-PRIORITY)])
[25-Feb-2010 11:57:13 +0100]: S: * 8 FETCH (UID 470 RFC822.SIZE 4683 FLAGS (\Recent) INTERNALDATE "25-Feb-2010 11:51:36 +0100" BODY[HEADER.FIELDS (DATE FROM TO SUBJECT REPLY-TO IN-REPLY-TO CC BCC CONTENT-TRANSFER-ENCODING CONTENT-TYPE MESSAGE-ID REFERENCES DISPOSITION-NOTIFICATION-TO X-PRIORITY)] {364}
[25-Feb-2010 11:57:13 +0100]: S: Content-Transfer-Encoding: 7bit
Content-Type: multipart/alternative;
        boundary="----_=_NextPart_001_01CAB608.6EA576DD"
Subject: super test
Date: Thu, 25 Feb 2010 11:51:05 +0100
Message-ID: <2BED9DCEA0087F4D85628A9BBD8CEBE40BA6FB15@ms-fra-e3mb02.emea.dsmain.com>
From: "Blanked_Out, Blanked_Out" <Blanked_Out.Blanked_Out@de.Blanked_Out.com>
To: <Blanked_Out@Blanked_Out.net>


[25-Feb-2010 11:57:13 +0100]: S: )
[25-Feb-2010 11:57:13 +0100]: S: FH12 OK Fetch complete
[25-Feb-2010 11:57:13 +0100]: C: I LOGOUT
[25-Feb-2010 11:58:12 +0100]: S: * OK IMAP server ready [0]
[25-Feb-2010 11:58:12 +0100]: C: a000 AUTHENTICATE CRAM-MD5
[25-Feb-2010 11:58:12 +0100]: S: + PDQwMTM1LjM0MzYuNzIwMEBwb3N0LndlYm1haWxlci5kZT4=
[25-Feb-2010 11:58:12 +0100]: C: ZmFsa29AYmVyZ21hZW5uZXIubmV0IDQ4OWNkOGY1MmY5N2JlOWNlMmFkMjU3OTBhMTJjMDlj
[25-Feb-2010 11:58:12 +0100]: S: a000 OK LOGIN completed [525]
[25-Feb-2010 11:58:12 +0100]: C: sel1 SELECT "INBOX"
[25-Feb-2010 11:58:12 +0100]: S: * 8 EXISTS
[25-Feb-2010 11:58:12 +0100]: S: * OK [UNSEEN 8]
[25-Feb-2010 11:58:12 +0100]: S: * 1 RECENT
[25-Feb-2010 11:58:12 +0100]: S: * FLAGS ($Forwarded \Answered \Flagged \Deleted \Seen \Draft \Forwarded)
[25-Feb-2010 11:58:12 +0100]: S: * OK [PERMANENTFLAGS ($Forwarded \* \Answered \Flagged \Deleted \Seen \Draft \Forwarded)] Permanent flags
[25-Feb-2010 11:58:12 +0100]: S: * OK [UIDVALIDITY 1207211647] UIDVALIDITY value
[25-Feb-2010 11:58:12 +0100]: S: * OK [UIDNEXT 471] may be the next UID value
[25-Feb-2010 11:58:12 +0100]: S: sel1 OK [READ-WRITE] SELECT completed
[25-Feb-2010 11:58:12 +0100]: C: srch1 SEARCH ALL UNDELETED
[25-Feb-2010 11:58:12 +0100]: S: * SEARCH 1 2 3 4 5 6 7 8
[25-Feb-2010 11:58:12 +0100]: S: srch1 OK SEARCH completed
[25-Feb-2010 11:58:12 +0100]: C: srch1 SEARCH ALL UNDELETED UNSEEN
[25-Feb-2010 11:58:13 +0100]: S: * SEARCH 8
[25-Feb-2010 11:58:13 +0100]: S: srch1 OK SEARCH completed
[25-Feb-2010 11:58:13 +0100]: C: cp01 CAPABILITY
[25-Feb-2010 11:58:13 +0100]: S: * CAPABILITY IMAP4rev1 IDLE AUTH=CRAM-MD5 SORT QUOTA NAMESPACE UNSELECT UIDPLUS LITERAL+ MULTIAPPEND CHILDREN WITHIN
[25-Feb-2010 11:58:13 +0100]: S: cp01 OK CAPABILITY completed
[25-Feb-2010 11:58:13 +0100]: C: QUOT1 GETQUOTAROOT "INBOX"
[25-Feb-2010 11:58:13 +0100]: S: * QUOTAROOT "INBOX" "Inbox"
[25-Feb-2010 11:58:13 +0100]: S: * QUOTA "Inbox" (STORAGE 102 1048576)
[25-Feb-2010 11:58:13 +0100]: S: QUOT1 OK GETQUOTAROOT completed
[25-Feb-2010 11:58:13 +0100]: C: s SORT (DATE) ISO-8859-1 ALL UNDELETED RECENT
[25-Feb-2010 11:58:13 +0100]: S: * SORT 8
[25-Feb-2010 11:58:13 +0100]: S: s OK SORT completed
[25-Feb-2010 11:58:13 +0100]: C: FH12 FETCH 8 (UID RFC822.SIZE FLAGS INTERNALDATE BODY.PEEK[HEADER.FIELDS (DATE FROM TO SUBJECT REPLY-TO IN-REPLY-TO CC BCC CONTENT-TRANSFER-ENCODING CONTENT-TYPE MESSAGE-ID REFERENCES DISPOSITION-NOTIFICATION-TO X-PRIORITY)])
[25-Feb-2010 11:58:13 +0100]: S: * 8 FETCH (UID 470 RFC822.SIZE 4683 FLAGS (\Recent) INTERNALDATE "25-Feb-2010 11:51:36 +0100" BODY[HEADER.FIELDS (DATE FROM TO SUBJECT REPLY-TO IN-REPLY-TO CC BCC CONTENT-TRANSFER-ENCODING CONTENT-TYPE MESSAGE-ID REFERENCES DISPOSITION-NOTIFICATION-TO X-PRIORITY)] {364}
[25-Feb-2010 11:58:13 +0100]: S: Content-Transfer-Encoding: 7bit
Content-Type: multipart/alternative;
        boundary="----_=_NextPart_001_01CAB608.6EA576DD"
Subject: super test
Date: Thu, 25 Feb 2010 11:51:05 +0100
Message-ID: <2BED9DCEA0087F4D85628A9BBD8CEBE40BA6FB15@ms-fra-e3mb02.emea.dsmain.com>
From: "Blanked_Out, Blanked_Out" <Blanked_Out.Blanked_Out@de.Blanked_Out.com>
To: <Blanked_Out@Blanked_Out.net>


[25-Feb-2010 11:58:13 +0100]: S: )
[25-Feb-2010 11:58:13 +0100]: S: FH12 OK Fetch complete
[25-Feb-2010 11:58:13 +0100]: C: I LOGOUT}}}

[alec]

What IMAP server? It returns "1 RECENT" every time, which is wrong. We'll need a workaround for such situation.

[nagus69]

Just noticed that this also is happening for mails that are already read sometimes (in subfolders). I'll gather a new log file for this on Monday. I will also try to find out what kind of imap server software that provider is using. Is there an IMAP command to list this?

[nagus69]

It appears the provider is using a self build imap server. They use the "idle command" to signal the arrival of new mails.

Original press comment here:

Der STRATO IMAP Server meldet dem E-Mail-Programm per „idle command“, wenn neue E-Mails vorliegen)

[alec]

Roundcube doesn't support IDLE, but we're working on mail-check feature that will not use RECENT flag. See #1485794

[nagus69]

Fix checking for new mail: now checks unseen count of inbox (#1485794)

Since i saw this , i updated to the very lastest 3300 build from ​https://svn.roundcube.net/trunk/roundcubemail/, but the same error still appears. But i guess the changes you mention aren't in yet.

Thanks for looking into this anyways!

[alec]

Fixed in [7c9d922b].

[nagus69]

I can confirm, duplicate emails stop, however -

after recieving an email it says :

Inbox (1) on the left side (which is correct)

But the right side will not show the new mail until i hit refresh or click on the "Check for new messages button". So they are not in sync. Should i open a new ticket for that or stick with this one?

p.s. thx for the quick fix

[nagus69]

Add - this is happening with 3316, not 3306.

I expect that "check for new mail" will do what it was doing before [5e9a5661]. I.e. update message counters for all folders (according to check_all_folders setting) and display new messages arrived in CURRENTLY SELECTED FOLDER.

The behaviour that you describe here is what i'd expect, but is not happening with 3316.

[alec]

Describe problem more preciselly (steps to reproduce), also imap_debug would be helpful.

[nagus69]

If i recieve a new mail, only the counter is updated (to 1 in this case) but the actual new email is not displayed until i hit the "Check for new mail button). See roundcube.jpg that i just attached.

[nagus69]

10 exists - if thats the amount of emails that exists in the inbox thats half true ;) Currently displayed are only 9 but 1 pending indicated by the INBOX(1) on the left.

[04-Mar-2010 16:25:22 +0100]: S: * OK IMAP server ready [725]
[04-Mar-2010 16:25:22 +0100]: C: cp01 CAPABILITY
[04-Mar-2010 16:25:22 +0100]: S: * CAPABILITY IMAP4rev1 IDLE AUTH=CRAM-MD5 SORT QUOTA NAMESPACE UNSELECT UIDPLUS LITERAL+ MULTIAPPEND CHILDREN WITHIN
[04-Mar-2010 16:25:22 +0100]: S: cp01 OK CAPABILITY completed
[04-Mar-2010 16:25:22 +0100]: C: a000 AUTHENTICATE CRAM-MD5
[04-Mar-2010 16:25:22 +0100]: S: + PDY4MjUuMTg0NjIuNzIwMEBwb3N0LndlYm1haWxlci5kZT4=
[04-Mar-2010 16:25:22 +0100]: C: ZmFsa29AYmVyZ21hZW5uZXIubmV0IDdlMDViY2U3ZTgzZDlhZjRhYmUzMDRhYjc1MWZjMDg1
[04-Mar-2010 16:25:22 +0100]: S: a000 OK LOGIN completed [19]

[04-Mar-2010 16:25:22 +0100]: C: sel1 SELECT "INBOX"
[04-Mar-2010 16:25:23 +0100]: S: * 10 EXISTS
[04-Mar-2010 16:25:23 +0100]: S: * OK [UNSEEN 10]
[04-Mar-2010 16:25:23 +0100]: S: * 1 RECENT
[04-Mar-2010 16:25:23 +0100]: S: * FLAGS ($Forwarded \Answered \Flagged \Deleted \Seen \Draft \Forwarded)
[04-Mar-2010 16:25:23 +0100]: S: * OK [PERMANENTFLAGS ($Forwarded \* \Answered \Flagged \Deleted \Seen \Draft \Forwarded)] Permanent flags
[04-Mar-2010 16:25:23 +0100]: S: * OK [UIDVALIDITY 1207211647] UIDVALIDITY value
[04-Mar-2010 16:25:23 +0100]: S: * OK [UIDNEXT 520] may be the next UID value
[04-Mar-2010 16:25:23 +0100]: S: sel1 OK [READ-WRITE] SELECT completed
[04-Mar-2010 16:25:23 +0100]: C: srch1 SEARCH ALL UNDELETED
[04-Mar-2010 16:25:23 +0100]: S: * SEARCH 1 2 3 4 5 6 7 8 9 10
[04-Mar-2010 16:25:23 +0100]: S: srch1 OK SEARCH completed
[04-Mar-2010 16:25:23 +0100]: C: srch1 SEARCH ALL UNDELETED UNSEEN
[04-Mar-2010 16:25:23 +0100]: S: * SEARCH 10
[04-Mar-2010 16:25:23 +0100]: S: srch1 OK SEARCH completed
[04-Mar-2010 16:25:23 +0100]: C: I LOGOUT

[alec]

We need a log from the moment when check-recent is executed automaticaly and when you hit "check mail" button. Also, do you have caching enabled?

[alec]

New ticket opened, #1486535, so let's continue there.

[bswinnerton]

Excuse my ignorance on the matter,

But can I safely make the changes of ​[7c9d922b] and ​[9adef683] to my 0.3.1 installation to solve this problem?

I didn't see this added to the roadmap, will it be fixed in future versions?

[nagus69]

I can confirm that with the patch from 3325 in rcube_imap.php and a base install of 3316 everything works as i'd expect it. Thx for the quick fix!