That is a common issue with certain woods and trying to sand it down. It means too much pressure is being applied. If you want to use sand paper to bring it down, and I have done this plenty of times, it needs to be done with gentile pressure and occasional use of skew or scraper. Scrapers do better on hard woods and skews do better on softer wood. In this case Oak has softer tissue and hard at the same time. As said above, soak it in CA. Turn down a little and sand. After sanding, put the skew/scraper to it gently to keep it round.
BTW, you can cause similar issues by using too much pressure with a not-perfectly sharp instrument. "Sharp Tools" is relative and as such cases problems in discussions and practice. What one says is "sharp" would not dare be used by another. A "somewhat sharp" tool will cut but takes more pressure to cut down. This pressure with the tool forces the pen into a contorted position as little as .003 or .005 and will result in similar cuts as sanding too hard.
Sharp: gently touch the blank and see if it is cutting; sharp will, "not sharp enough" will require just a tad bit of pressure. Sharp tools should not need pressure on the blank to cut. The spinning blank will be cut as soon as it touches the sharp tool. A KEY part of turning pens is learning the steps outside of "making a pen": Sharp tools (and knowing how to correctly sharpen and keep sharp during the complete turning) , calipers, techniques, practice, "feel", and others too.
There is a chance that the bushing wholes were drilled off center. If you have calipers, check them. If you don't have calipers, you need them.