Must I connect battery to each inverter which are paralled?

Yes, you need to connect  same quantity battery for each inverter.