The two ministers met on the sidelines of the annual meeting of European Council on Foreign Relations (ECFR).
Schäuble, underlining the JCPOA implementation, welcomed banking cooperation between Tehran and Berlin.
He said German banks are ready to upgrade cooperation with Iran.
Zarif arrived in Berlin on Monday morning.
He is to meet President of Germany Frank-Walter Steinmeier and Foreign Minister Sigmar Gabriel later.