Fig. 2

Diagram of the transformer-based MPNN. The framework consists of A a D-MPNN, B an atom attention multi-head transformer, and C a FFN to predict the property of interest (in this case the molecule’s ability to cross a biological barrier). Each component in this figure represents different vector representations within the model, as defined in the pseudocode in Table 1