Thanks for sharing @shixia226
As this issue relates to free version of handsontable (core) I allowed myself to redirect it at: Merge cells heigh with RowHeaders: false · Issue #3837 · handsontable/handsontable · GitHub
Please track changes to Merge cells heigh with RowHeaders: false · Issue #3837 · handsontable/handsontable · GitHub for updates.