Can paralle 2 X1-Hybrid-G4 without connecting any EPS load， will it do harm to my inverter?

Yes, you can parallel them like that, it will not do the harm to your inverter, it is Normal usage scenario.