Directly access the brush and paint buffers rather than using GEGL iterators. Replicate the relevant parts of GimpApplicator using direct access.
Daniel Sabo