I'm giving Ghostty another shot and was able to get font settings so that text rendering looks as good as Alacritty (at least on my Framework and using Berkeley Mono).
Also, on Fedora Workstation 42 with GNOME, Alacritty doesn't respond to Surface Pen inputs or clicks on my Surface Pro 3. Both the default GNOME Terminal and Ghostty work fine with the Surface Pen, though. Not sure what's going on with Alacritty there.