I'm aware of how to add a glyphMarginClassName, linesDecorationsClassName, and inlineClassName to the options of the Monaco Editor. But is there a way to add alphabetical characters into the margin? Like this:

I'm aware of how to add a glyphMarginClassName, linesDecorationsClassName, and inlineClassName to the options of the Monaco Editor. But is there a way to add alphabetical characters into the margin? Like this:

You can do that, yes. However, not with dynamic text, but instead attaching a ::before or ::after element to that margin node.
Start by setting a custom CSS class name in the lines decoration:
And in your CSS add the text like this:
which results in this display: