Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.debian.user > #165078 > unrolled thread

exim4 maildir_tag

Started byAndrew McGlashan <andrew.mcglashan@affinityvision.com.au>
First post2016-03-07 16:50 +0100
Last post2016-03-07 20:30 +0100
Articles 9 — 5 participants

Back to article view | Back to linux.debian.user


Contents

  exim4 maildir_tag Andrew McGlashan <andrew.mcglashan@affinityvision.com.au> - 2016-03-07 16:50 +0100
    Re: exim4 maildir_tag Darac Marjal <mailinglist@darac.org.uk> - 2016-03-07 18:40 +0100
      Re: exim4 maildir_tag Andrew McGlashan <andrew.mcglashan@affinityvision.com.au> - 2016-03-07 19:40 +0100
        Re: exim4 maildir_tag Christian Schmidt <Christian.Schmidt@chemie.uni-hamburg.de> - 2016-03-08 10:40 +0100
          Re: exim4 maildir_tag Andrew McGlashan <andrew.mcglashan@affinityvision.com.au> - 2016-03-08 13:30 +0100
            Re: exim4 maildir_tag Darac Marjal <mailinglist@darac.org.uk> - 2016-03-08 23:10 +0100
              Re: exim4 maildir_tag Jonathan Dowland <jmtd@debian.org> - 2016-03-09 15:50 +0100
                Re: exim4 maildir_tag Sven Hartge <sven@svenhartge.de> - 2016-03-09 16:30 +0100
      Re: exim4 maildir_tag Andrew McGlashan <andrew.mcglashan@affinityvision.com.au> - 2016-03-07 20:30 +0100

#165078 — exim4 maildir_tag

FromAndrew McGlashan <andrew.mcglashan@affinityvision.com.au>
Date2016-03-07 16:50 +0100
Subjectexim4 maildir_tag
Message-ID<ra5zY-4I3-19@gated-at.bofh.it>
Hi,

I want to use this feature of dovecot [1].

But it requires that each Maildir filename include ",S=$message_size" in
the file names.

How can I get exim4 to create all new emails using the maildir_tag format?

I believe that I need to add this in to my config, but I've tried to do
so and am not getting the right result.

maildir_tag = ,S=$message_size


[I am also not concerned about quotas right now.]


I have a split files configuration.

Dovecot version detail:
dovecot-common                     1:2.1.7-7+deb7u1

Exim4 version detail:
exim4                              4.80-7+deb7u1
exim4-base                         4.80-7+deb7u1
exim4-config                       4.80-7+deb7u1
exim4-daemon-heavy                 4.80-7+deb7u1


[1] http://wiki2.dovecot.org/Plugins/Zlib

Kind Regards
AndrewM

[toc] | [next] | [standalone]


#165085

FromDarac Marjal <mailinglist@darac.org.uk>
Date2016-03-07 18:40 +0100
Message-ID<ra7iq-5Vi-25@gated-at.bofh.it>
In reply to#165078

[Multipart message — attachments visible in raw view] — view raw

On Tue, Mar 08, 2016 at 02:48:56AM +1100, Andrew McGlashan wrote:
>Hi,
>
>I want to use this feature of dovecot [1].
>
>But it requires that each Maildir filename include ",S=$message_size" in
>the file names.
>
>How can I get exim4 to create all new emails using the maildir_tag format?

Probably the easiest way is to get dovecot to create the files. Look at 
either http://wiki.dovecot.org/LDA/Exim or 
http://wiki.dovecot.org/LMTP/Exim for how to tell Exim to deliver 
messages to dovecot. Dovecot will then store the file in whatever mail 
storage format you dictate (compress maildirs as you want, or its own 
dbox format).

Basically, LDA or LMTP allow you to decouple the mail delivery task 
(exim) from the mail storage task (dovecot).

>
>I believe that I need to add this in to my config, but I've tried to do
>so and am not getting the right result.
>
>maildir_tag = ,S=$message_size
>
>
>[I am also not concerned about quotas right now.]
>
>
>I have a split files configuration.
>
>Dovecot version detail:
>dovecot-common                     1:2.1.7-7+deb7u1
>
>Exim4 version detail:
>exim4                              4.80-7+deb7u1
>exim4-base                         4.80-7+deb7u1
>exim4-config                       4.80-7+deb7u1
>exim4-daemon-heavy                 4.80-7+deb7u1
>
>
>[1] http://wiki2.dovecot.org/Plugins/Zlib
>
>Kind Regards
>AndrewM
>

-- 
For more information, please reread.

[toc] | [prev] | [next] | [standalone]


#165089

FromAndrew McGlashan <andrew.mcglashan@affinityvision.com.au>
Date2016-03-07 19:40 +0100
Message-ID<ra8ev-6wg-43@gated-at.bofh.it>
In reply to#165085

On 8/03/2016 4:31 AM, Darac Marjal wrote:
> On Tue, Mar 08, 2016 at 02:48:56AM +1100, Andrew McGlashan wrote:
> Probably the easiest way is to get dovecot to create the files. Look at
> either http://wiki.dovecot.org/LDA/Exim or
> http://wiki.dovecot.org/LMTP/Exim for how to tell Exim to deliver
> messages to dovecot. Dovecot will then store the file in whatever mail
> storage format you dictate (compress maildirs as you want, or its own
> dbox format).
> 
> Basically, LDA or LMTP allow you to decouple the mail delivery task
> (exim) from the mail storage task (dovecot).

So, mail queue handling will then be done by dovecot-lda instead of exim4.

Will mailq still give me results the same way?


Also, I do the following sometimes:
  exim4 -M msgid   # retry delivery
  exim4 -Mg msgid  # cancel delivery

  and others.... -Mvh  -Mvb and -Mvl

Will they all work the same or are there new ways to learn if I use
dovecot-lda ?

Thanks
AndrewM

[toc] | [prev] | [next] | [standalone]


#165107

FromChristian Schmidt <Christian.Schmidt@chemie.uni-hamburg.de>
Date2016-03-08 10:40 +0100
Message-ID<ramht-7tc-3@gated-at.bofh.it>
In reply to#165089

[Multipart message — attachments visible in raw view] — view raw

On 07.03.2016 19:34, Andrew McGlashan wrote:
> So, mail queue handling will then be done by dovecot-lda instead of exim4.

No, dovecot "only" does delivery to your local users' mailboxes/maildirs.

> Will mailq still give me results the same way?

Sure.

Regards,
Christian

-- 
No signature available.

[toc] | [prev] | [next] | [standalone]


#165125

FromAndrew McGlashan <andrew.mcglashan@affinityvision.com.au>
Date2016-03-08 13:30 +0100
Message-ID<raoVY-Mw-21@gated-at.bofh.it>
In reply to#165107
Hi,

On 8/03/2016 8:32 PM, Christian Schmidt wrote:
> On 07.03.2016 19:34, Andrew McGlashan wrote:
>> So, mail queue handling will then be done by dovecot-lda instead of exim4.
> 
> No, dovecot "only" does delivery to your local users' mailboxes/maildirs.

That's what I thought, thanks for confirming.

>> Will mailq still give me results the same way?
> 
> Sure.

Excellent, now I just need to work out how to gzip emails when they are
larger than the file system block size of 4KB -- although I do wonder,
does dovecot provide clients with non-zipped data or can it benefit form
less traffic by providing zipped data over the transport?  (like how a
web browser might receive zipped content and unzip it to build the
webpage on the client).

Oh and the system_filter saves files directly to backup areas that are
not users on the system; so I have some work to do on that as well.

Thanks
AndrewM

[toc] | [prev] | [next] | [standalone]


#165160

FromDarac Marjal <mailinglist@darac.org.uk>
Date2016-03-08 23:10 +0100
Message-ID<raxZg-730-11@gated-at.bofh.it>
In reply to#165125
On Tue, 8 Mar 2016 23:21:26 +1100
Andrew McGlashan <andrew.mcglashan@affinityvision.com.au> wrote:

> Hi,
> 
> On 8/03/2016 8:32 PM, Christian Schmidt wrote:
> > On 07.03.2016 19:34, Andrew McGlashan wrote:  
> >> So, mail queue handling will then be done by dovecot-lda instead
> >> of exim4.  
> > 
> > No, dovecot "only" does delivery to your local users'
> > mailboxes/maildirs.  
> 
> That's what I thought, thanks for confirming.
> 
> >> Will mailq still give me results the same way?  
> > 
> > Sure.  
> 
> Excellent, now I just need to work out how to gzip emails when they
> are larger than the file system block size of 4KB -- although I do
> wonder, does dovecot provide clients with non-zipped data or can it
> benefit form less traffic by providing zipped data over the
> transport?  (like how a web browser might receive zipped content and
> unzip it to build the webpage on the client).

Dovecot has two (relevant) plugins. zlib compresses the stored emails.
This is transparent to all clients - exim provides uncompressed emails,
dovecot compresses them to disk and on-the-fly decompresses them when
serving them back to mail clients.

There is also imap_zlib which works like the HTTP gzip extension. IMAP
communications are compressed, allowing fewer bytes to be sent between
the server and the clients.

> 
> Oh and the system_filter saves files directly to backup areas that are
> not users on the system; so I have some work to do on that as well.
> 
> Thanks
> AndrewM
> 

[toc] | [prev] | [next] | [standalone]


#165182

FromJonathan Dowland <jmtd@debian.org>
Date2016-03-09 15:50 +0100
Message-ID<raNB1-L2-35@gated-at.bofh.it>
In reply to#165160
On Tue, Mar 08, 2016 at 09:59:48PM +0000, Darac Marjal wrote:
> Dovecot has two (relevant) plugins. zlib compresses the stored emails.
> This is transparent to all clients - exim provides uncompressed emails,
> dovecot compresses them to disk and on-the-fly decompresses them when
> serving them back to mail clients.
> 
> There is also imap_zlib which works like the HTTP gzip extension. IMAP
> communications are compressed, allowing fewer bytes to be sent between
> the server and the clients.

Very cool. I wonder (not having looked) whether this means you get a compressed
file decompressed and then re-compressed if you enable both plugins, or if it's
smart enough to stream the compressed files without decompressing them in that
circumstance.

[toc] | [prev] | [next] | [standalone]


#165186

FromSven Hartge <sven@svenhartge.de>
Date2016-03-09 16:30 +0100
Message-ID<raOdI-1eq-17@gated-at.bofh.it>
In reply to#165182
Jonathan Dowland <jmtd@debian.org> wrote:
> On Tue, Mar 08, 2016 at 09:59:48PM +0000, Darac Marjal wrote:

>> Dovecot has two (relevant) plugins. zlib compresses the stored
>> emails.  This is transparent to all clients - exim provides
>> uncompressed emails, dovecot compresses them to disk and on-the-fly
>> decompresses them when serving them back to mail clients.
>> 
>> There is also imap_zlib which works like the HTTP gzip extension.
>> IMAP communications are compressed, allowing fewer bytes to be sent
>> between the server and the clients.

> Very cool. I wonder (not having looked) whether this means you get a
> compressed file decompressed and then re-compressed if you enable both
> plugins, or if it's smart enough to stream the compressed files
> without decompressing them in that circumstance.

Last time I asked that question Timo corrected me and said, the mail is
decompressed after reading from disk and then compressed again for the
transmission via IMAP/POP.

Grüße,
Sven.

-- 
Sigmentation fault. Core dumped.

[toc] | [prev] | [next] | [standalone]


#165090

FromAndrew McGlashan <andrew.mcglashan@affinityvision.com.au>
Date2016-03-07 20:30 +0100
Message-ID<ra90R-73k-7@gated-at.bofh.it>
In reply to#165085

[Multipart message — attachments visible in raw view] — view raw

On 8/03/2016 4:31 AM, Darac Marjal wrote:
> On Tue, Mar 08, 2016 at 02:48:56AM +1100, Andrew McGlashan wrote:
>> Hi,
>>
>> I want to use this feature of dovecot [1].
>>
>> But it requires that each Maildir filename include ",S=$message_size" in
>> the file names.
>>
>> How can I get exim4 to create all new emails using the maildir_tag
>> format?

I've actually added the maildir_tag entry to these transports:
   /etc/exim4/conf.d/transport/35_exim4-config_address_directory
   /etc/exim4/conf.d/transport/20_save_local_message

That covers all saves done by the system_filter and also by any .forward
files that have "save $home/Maildir/" or subfolders.

Now I just need to work out how to gzip the files whilst keeping the
file names in tact so as not to effect any dovecot-uuidlist handling.

I'm still open to using dovecot-lda though if that works out to be the
best option.

Thanks
AndrewM

[toc] | [prev] | [standalone]


Back to top | Article view | linux.debian.user


csiph-web