I dropped a TAdvRichEditorFormatButtonBar and TAdvRichEditor on the form but I could not reproduce such behavior.
What do you do different from this?
If a problem persists, please isolate this and send a sample source project with which we can reproduce this here.