Should the penalties be included in the expenses when calculating income tax?

No. Penalties and overdue fines paid by Representative offices can be excluded in the expenses when calculating income tax under expense gross-up method.