How does BERT produce contextualized rich text representations?

BERT (Bidirectional Encoder Representations from Transformer) published in 2018. It uses Transformer encoder (only, without decoder) to…