Forward ESD sound server with PulseAudio

Question

I have multiple speakers in my house and I'm trying to make them all available via Pulse Audio. One pair of speakers though is connected to a box which can't run pulseaudio but ESD is running fine. So I wonder how can I configure one of the pulseaudio servers to make this ESD server available for other pulseaudio clients?

So basically I want to do this:

PA Client 1    PA Client 2    PA Client 3
    |              |              |
    |              |              |
    +------------+ | +------------+
                 | | |
                 | | |
               PA Server
                  | |
                  | |
       +----------+ +---------+
       |                      |
       |                      |
   Speaker A              ESD Server
                              |
                              |
                           Speaker B

Means: The PA Server publishes Speaker A normally but also publishes Speaker B through the ESD sound server to which this Speaker is connected.

Problem is: I don't know how to configure the pulse audio server to achieve this goal. Anyone can help?